18842

High Performance Monte Carlo Simulation of Ising Model on TPU Clusters

Kun Yang, Yi-Fan Chen, Georgios Roumpos, Chris Colby, John Anderson
Google Research
arXiv:1903.11714 [cs.DC], (27 Mar 2019)

@article{yang2019high,

   title={High Performance Monte Carlo Simulation of Ising Model on TPU Clusters},

   author={Yang, Kun and Chen, Yi-Fan and Roumpos, Georgios and Colby, Chris and Anderson, John},

   year={2019},

   month={mar},

   archivePrefix={"arXiv"},

   primaryClass={cs.DC}

}

Large scale deep neural networks profited from an emerging class of AI accelerators. Although the accelerators are specialized for machine learning, some of their designs are general enough for other computing intensive applications. Cloud TPU, as one of them, offers tremendous computing resources and is easily accessible through TensorFlow by expressing the computation in a graph. In this paper, we leverage this powerful hardware combined with the expressiveness of TensorFlow to simulate the Ising model on a 2-dimensional lattice. We modify the computationally intensive part of the checkerboard algorithm into matrix operations to exploit Cloud TPU’s highly efficient matrix unit. In our experiments, we demonstrate that our implementation outperforms the best published benchmarks to our knowledge by 60% in single core and 250% in multiple cores with linear scaling. We also show the performance improvement of using low precision arithmetic—bfloat16 instead of float32—without sacrificing any accuracy.
Rating: 2.0/5. From 1 vote.
Please wait...

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: