Inertial-aided KLT feature tracking for a moving camera

Myung Hwangbo, Jun-Sik Kim, Takeo Kanade
Robotics Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh 15213, USA
IEEE/RSJ International Conference on Intelligent Robots and Systems, 2009. IROS 2009, p.1909-1916


   title={Inertial-aided KLT feature tracking for a moving camera},

   author={Hwangbo, M. and Kim, J.S. and Kanade, T.},

   booktitle={Intelligent Robots and Systems, 2009. IROS 2009. IEEE/RSJ International Conference on},





Download Download (PDF)   View View   Source Source   



We propose a novel inertial-aided KLT feature tracking method robust to camera ego-motions. The conventional KLT uses images only and its working condition is inherently limited to small appearance change between images. When big optical flows are induced by a camera-ego motion, an inertial sensor attached to the camera can provide a good prediction to preserve the tracking performance. We use a low-grade MEMS-based gyroscope to refine an initial condition of the nonlinear optimization in the KLT. It increases the possibility for warping parameters to be in the convergence region of the KLT. For longer tracking with less drift, we use the affine photometric model and it can effectively deal with camera rolling and outdoor illumination change. Extra computational cost caused by this higher-order motion model is alleviated by restraining the Hessian update and GPU acceleration. Experimental results are provided for both indoor and outdoor scenes and GPU implementation issues are discussed.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: