Real-time eye blink detection with GPU-based SIFT tracking
R & D Dept., CRIM, 550 Sherbrooke West, Suite 100, Montreal, QC, Canada, H3A 1B9
Computer and Robot Vision, 2007. CRV ’07. Fourth Canadian Conference on In Computer and Robot Vision, 2007. CRV ’07. Fourth Canadian Conference on (2007), pp. 481-487.
@conference{lalonde2007real,
title={Real-time eye blink detection with GPU-based SIFT tracking},
author={Lalonde, M. and Byrns, D. and Gagnon, L. and Teasdale, N. and Laurendeau, D.},
booktitle={Computer and Robot Vision, 2007. CRV’07. Fourth Canadian Conference on},
pages={481–487},
year={2007},
organization={IEEE}
}
This paper reports on the implementation of a GPUbased, real-time eye blink detector on very low contrast images acquired under near-infrared illumination. This detector is part of a multi-sensor data acquisition and analysis system for driver performance assessment and training. Eye blinks are detected inside regions of interest that are aligned with the subject’s eyes at initialization. Alignment is maintained through time by tracking SIFT feature points that are used to estimate the affine transformation between the initial face pose and the pose in subsequent frames. The GPU implementation of the SIFT feature point extraction algorithm ensures real-time processing. An eye blink detection rate of 97% is obtained on a video dataset of 33,000 frames showing 237 blinks from 22 subjects.
October 28, 2010 by hgpu
