17307

DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications

Loc N. Huynh, Youngki Lee, Rajesh Krishna Balan
Singapore Management University
15th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys ’17), 2017

@inproceedings{huynh2017deepmon,

   title={DeepMon: Mobile GPU-based Deep Learning Framework for Continuous Vision Applications},

   author={Huynh, Loc N and Lee, Youngki and Balan, Rajesh Krishna},

   booktitle={Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services},

   pages={82–95},

   year={2017},

   organization={ACM}

}

The rapid emergence of head-mounted devices such as the Microsoft Holo-lens enables a wide variety of continuous vision applications. Such applications often adopt deep-learning algorithms such as CNN and RNN to extract rich contextual information from the first-person-view video streams. Despite the high accuracy, use of deep learning algorithms in mobile devices raises critical challenges, i.e., high processing latency and power consumption. In this paper, we propose DeepMon, a mobile deep learning inference system to run a variety of deep learning inferences purely on a mobile device in a fast and energy-efficient manner. For this, we designed a suite of optimization techniques to efficiently offload convolutional layers to mobile GPUs and accelerate the processing; note that the convolutional layers are the common performance bottleneck of many deep learning models. Our experimental results show that DeepMon can classify an image over the VGG-VeryDeep-16 deep learning model in 644ms on Samsung Galaxy S7, taking an important step towards continuous vision without imposing any privacy concerns nor networking cost.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: