Temporally Consistent Disparity and Optical Flow via Efficient Spatio-temporal Filtering

Asmaa Hosni, Christoph Rhemann, Michael Bleyer, Margrit Gelautz
Institute for Software Technology and Interactive Systems, Vienna University of Technology, Vienna, Austria
Advances in Image and Video Technology, Lecture Notes in Computer Science, Volume 7087/2012, 2012


   title={Temporally Consistent Disparity and Optical Flow via Efficient Spatio-temporal Filtering},

   author={Hosni, A. and Rhemann, C. and Bleyer, M. and Gelautz, M.},

   journal={Advances in Image and Video Technology},





Download Download (PDF)   View View   Source Source   



This paper presents a new efficient algorithm for computing temporally consistent disparity maps from video footage. Our method is motivated by recent work [1] that achieves high quality stereo results by smoothing disparity costs with a fast edge-preserving filter. This previous approach was designed to work with single static image pairs and does not maintain temporal coherency of disparity maps when applied to video streams. The main contribution of our work is to transfer this concept to the spatio-temporal domain in order to efficiently achieve temporally consistent disparity maps, where disparity changes are aligned with spatiotemporal edges of the video sequence. We further show that our method can be used as spatio-temporal regularizer for optical flow estimation. Our approach can be implemented efficiently, achieving real-time results for stereo matching. Quantitative and qualitative results demonstrate that our approach (i) considerably improves over frame-by-frame methods for both stereo and optical flow; and (ii) outperforms the state-ofthe- art for local space-time stereo approaches.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: