Implementation of Frequency Domain Convolution for the Caffe-Framework

Philipp Harzig
Fakultat fur Angewandte Informatik, Universitat Augsburg, D-86135 Augsburg, Germany
Universitat Augsburg, 2016

   title={Fakult{"a}t f{"u}r Angewandte Informatik Universit{"a}t Augsburg},

   author={Harzig, Philipp},



Download Download (PDF)   View View   Source Source   



Deep Convolutional Neural Networks have received a lot of attention over the past few years as a promising technique for object classification in images. In this thesis, we implemented the frequency domain convolution for the popular Caffe framework. Deep Convolutional Neural Networks suffer from long training times even on contemporary hardware, which we want to address in this thesis. Particularly, the operation performed in a convolutional layer is computationally very expensive. We replaced the traditional convolution operation by a frequency domain convolution and achieved speed-ups of 2.2x and 1.8x in the forward pass and training of a well-known award-winning Deep Convolutional Neural Network, respectively. On self-designed convolutional layers, we achieved even higher speed-ups. Thus, we reduced long training and evaluation times of Deep Convolutional Neural Networks by a considerable factor. Moreover, we obtained a constant computation time for bigger kernels in a convolution layer, therefore, facilitating new structures for Deep Convolutional Neural Networks.
VN:F [1.9.22_1171]
Rating: 5.0/5 (1 vote cast)
Implementation of Frequency Domain Convolution for the Caffe-Framework, 5.0 out of 5 based on 1 rating

* * *

* * *

TwitterAPIExchange Object
    [oauth_access_token:TwitterAPIExchange:private] => 301967669-yDz6MrfyJFFsH1DVvrw5Xb9phx2d0DSOFuLehBGh
    [oauth_access_token_secret:TwitterAPIExchange:private] => o29ji3VLVmB6jASMqY8G7QZDCrdFmoTvCDNNUlb7s
    [consumer_key:TwitterAPIExchange:private] => TdQb63pho0ak9VevwMWpEgXAE
    [consumer_secret:TwitterAPIExchange:private] => Uq4rWz7nUnH1y6ab6uQ9xMk0KLcDrmckneEMdlq6G5E0jlQCFx
    [postfields:TwitterAPIExchange:private] => 
    [getfield:TwitterAPIExchange:private] => ?cursor=-1&screen_name=hgpu&skip_status=true&include_user_entities=false
    [oauth:protected] => Array
            [oauth_consumer_key] => TdQb63pho0ak9VevwMWpEgXAE
            [oauth_nonce] => 1477536965
            [oauth_signature_method] => HMAC-SHA1
            [oauth_token] => 301967669-yDz6MrfyJFFsH1DVvrw5Xb9phx2d0DSOFuLehBGh
            [oauth_timestamp] => 1477536965
            [oauth_version] => 1.0
            [cursor] => -1
            [screen_name] => hgpu
            [skip_status] => true
            [include_user_entities] => false
            [oauth_signature] => 3bpsq46m8zZJadlpNAhNPTnhEVs=

    [url] => https://api.twitter.com/1.1/users/show.json
Follow us on Facebook
Follow us on Twitter

HGPU group

2034 peoples are following HGPU @twitter

HGPU group © 2010-2016 hgpu.org

All rights belong to the respective authors

Contact us: