An MPI-Based Python Framework for Distributed Training with Keras

Dustin Anderson, Jean-Roch Vlimant, Maria Spiropulu
California Institute of Technology, 1200 E. California Blvd, Pasadena, CA 91125
arXiv:1712.05878 [cs.DC], (16 Dec 2017)


   title={An MPI-Based Python Framework for Distributed Training with Keras},

   author={Anderson, Dustin and Vlimant, Jean-Roch and Spiropulu, Maria},






We present a lightweight Python framework for distributed training of neural networks on multiple GPUs or CPUs. The framework is built on the popular Keras machine learning library. The Message Passing Interface (MPI) protocol is used to coordinate the training process, and the system is well suited for job submission at supercomputing sites. We detail the software’s features, describe its use, and demonstrate its performance on systems of varying sizes on a benchmark problem drawn from high-energy physics research.
Rating: 5.0/5. From 1 vote.
Please wait...

* * *

* * *

HGPU group © 2010-2023 hgpu.org

All rights belong to the respective authors

Contact us: