https://hgpu.org/?p=15924
Theano-MPI: a Theano-based Distributed Training Framework