Scaling Multifluid Compressible Fluid Dynamics to 700,000 cores, 1.5 Pflop/s, and a Trillion Grid Cells
Laboratory for Computational Science & Engineering, University of Minnesota, Minneapolis, Minnesota, USA
28th IEEE International Parallel & Distributed Processing Symposium, 2014
@article{woodward2014scaling,
title={Scaling Multifluid Compressible Fluid Dynamics to 700,000 cores, 1.5 Pflop/s, and a Trillion Grid Cells},
author={Woodward, Paul R. and Jayaraj, Jagan and Lin, Pei-Hung and Knox, Michael and Anderson, Sarah E. and Greensky, James},
year={2014}
}
We are using the Blue Waters system at NCSA to study compressible, turbulent mixing of gases in the deep interiors of stars and also in the context of inertial confinement fusion (ICF). In December, 2012, during the Blue Waters friendly user access period, we carried out a simulation of an ICF test problem on a grid of 1.18 trillion cells at a sustained performance of 1.5 Pflop/s with 32-bit precision. Our PPM gas dynamics code, with its PPB multifluid mixing fraction advection, was able to follow the nonlinear, unstable growth of Richtmyer-Meshkov and Rayleigh-Taylor unstable modes, their mode-mode interactions, and the ultimate development of turbulence with an unprecedented level of detail and accuracy for this hydro-only representation of an ICF capsule and fuel compression. We describe results from this simulation and features that enable our code to perform at and scale to this level on classic MPP architectures like Blue Waters and also on accelerated systems using Intel’s Xeon Phi coprocessors.
July 30, 2014 by hgpu
