6830

Efficient mapping of the training of Convolutional Neural Networks to a CUDA-based cluster

Jonatan Ward, Sergey Andreev, Francisco Heredia, Bogdan Lazar, Zlatka Manevska
Eindhoven University of Technology, The Netherlands
Eindhoven University of Technology, 2011

@article{ward2011efficient,

   title={Efficient mapping of the training of Convolutional Neural Networks to a CUDA-based cluster},

   author={Ward, Jonatan and Andreev, Sergey and Heredia, Francisco and Lazar, Bogdan and Manevska, Zlatka},

   year={2011}

}

Download Download (PDF)   View View   Source Source   

1040

views

We propose a method to parallelize the training of a convolutional neural network by using a CUDA-based cluster. We attain a substantial increase in the performance of the algorithm itself. We research the feasibility of using batch versus online mode training and provide a performance comparison between them. Furthermore, we propose an implementation of an alternative algorithm to compute local gradients which increases the level of parallelism. To conclude, we give a set of best practices for implementing Convolutional Neural Networks on the cluster.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2017 hgpu.org

All rights belong to the respective authors

Contact us: