16599

Implementation of Frequency Domain Convolution for the Caffe-Framework

Philipp Harzig
Fakultat fur Angewandte Informatik, Universitat Augsburg, D-86135 Augsburg, Germany
Universitat Augsburg, 2016

@article{harzig2016fakultat,

   title={Fakult{"a}t f{"u}r Angewandte Informatik Universit{"a}t Augsburg},

   author={Harzig, Philipp},

   year={2016}

}

Download Download (PDF)   View View   Source Source   

462

views

Deep Convolutional Neural Networks have received a lot of attention over the past few years as a promising technique for object classification in images. In this thesis, we implemented the frequency domain convolution for the popular Caffe framework. Deep Convolutional Neural Networks suffer from long training times even on contemporary hardware, which we want to address in this thesis. Particularly, the operation performed in a convolutional layer is computationally very expensive. We replaced the traditional convolution operation by a frequency domain convolution and achieved speed-ups of 2.2x and 1.8x in the forward pass and training of a well-known award-winning Deep Convolutional Neural Network, respectively. On self-designed convolutional layers, we achieved even higher speed-ups. Thus, we reduced long training and evaluation times of Deep Convolutional Neural Networks by a considerable factor. Moreover, we obtained a constant computation time for bigger kernels in a convolution layer, therefore, facilitating new structures for Deep Convolutional Neural Networks.
VN:F [1.9.22_1171]
Rating: 3.0/5 (2 votes cast)
Implementation of Frequency Domain Convolution for the Caffe-Framework, 3.0 out of 5 based on 2 ratings

* * *

* * *

HGPU group © 2010-2017 hgpu.org

All rights belong to the respective authors

Contact us: