Scalability Analysis of Synchronous Data-Parallel Artificial Neural Network (ANN) Learners

Chang Sun
Virginia Tech
Virginia Tech, 2018


   title={Scalability Analysis of Synchronous Data-Parallel Artificial Neural Network (ANN) Learners},

   author={Sun, Chang},


   school={Virginia Tech}


Download Download (PDF)   View View   Source Source   



Artificial Neural Networks (ANNs) have been established as one of the most important algorithmic tools in the Machine Learning (ML) toolbox over the past few decades. ANNs’ recent rise to widespread acceptance can be attributed to two developments: (1) the availability of large-scale training and testing datasets; and (2) the availability of new computer architectures for which ANN implementations are orders of magnitude more efficient. In this thesis, I present research on two aspects of the second development. First, I present a portable, open source implementation of ANNs in OpenCL and MPI. Second, I present performance and scaling models for ANN algorithms on state-of-the-art Graphics Processing Unit (GPU) based parallel compute clusters.
Rating: 2.0/5. From 1 vote.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: