TransCAIP: A Live 3D TV System Using a Camera Array and an Integral Photography Display with Interactive Control of Viewing Parameters
Graduate School of Information, Science and Technology, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
IEEE Transactions on Visualization and Computer Graphics, 2009
@article{taguchi2009transcaip,
title={Transcaip: A live 3d tv system using a camera array and an integral photography display with interactive control of viewing parameters},
author={Taguchi, Y. and Koike, T. and Takahashi, K. and Naemura, T.},
journal={IEEE transactions on visualization and computer graphics},
pages={841–852},
issn={1077-2626},
year={2009},
publisher={Published by the IEEE Computer Society}
}
The system described in this paper provides a real-time 3D visual experience by using an array of 64 video cameras and an integral photography display with 60 viewing directions. The live 3D scene in front of the camera array is reproduced by the full-color, full-parallax autostereoscopic display with interactive control of viewing parameters. The main technical challenge is fast and flexible conversion of the data from the 64 multicamera images to the integral photography format. Based on image-based rendering techniques, our conversion method first renders 60 novel images corresponding to the viewing directions of the display, and then arranges the rendered pixels to produce an integral photography image. For real-time processing on a single PC, all the conversion processes are implemented on a GPU with GPGPU techniques. The conversion method also allows a user to interactively control viewing parameters of the displayed image for reproducing the dynamic 3D scene with desirable parameters. This control is performed as a software process, without reconfiguring the hardware system, by changing the rendering parameters such as the convergence point of the rendering cameras and the interval between the viewpoints of the rendering cameras.
April 18, 2011 by hgpu
