Real-time arbitrary view rendering on GPU from stereo video and time-of-flight camera
Middle East Technical University, Department of Electrical and Electronics Engineering, Turkey
3DTV Conference: The True Vision – Capture, Transmission and Display of 3D Video (3DTV-CON), 2011
@inproceedings{ates2011real,
title={Real-time arbitrary view rendering on GPU from stereo video and time-of-flight camera},
author={Ates, T.K. and Aydin Alatan, A.},
booktitle={3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2011},
pages={1–4},
organization={IEEE},
year={2011}
}
Generating in-between images from multiple views of a scene is a crucial task for both computer vision and computer graphics fields. Photorealistic rendering, 3DTV and robot navigation are some of many applications which benefit from arbitrary view synthesis, if it is achieved in real-time. GPUs excel in achieving high computation power by processing arrays of data in parallel, which make them ideal for real-time computer vision applications. This paper proposes an arbitrary view rendering algorithm by using two high resolution color cameras along with a single low resolution time-of-flight depth camera and utilizing GPUs to achieve real-time processing rates. The presented ideas are examined in an experimental framework and based on the experimental results, it could be concluded that it is possible to realize content production and display stages of a free-viewpoint system in real-time by using only low-cost commodity computing devices.
June 23, 2011 by hgpu
