Use of Checkpoint-Restart for Complex HEP Software on Traditional Architectures and Intel MIC
College of Computer and Information Science, Northeastern University, Boston, MA, USA
arXiv:1311.0272 [physics.comp-ph], (1 Nov 2013)
@article{2013arXiv1311.0272A,
author={Arya}, K. and {Cooperman}, G. and {Dotti}, A. and {Elmer}, P.},
title={"{Use of Checkpoint-Restart for Complex HEP Software on Traditional Architectures and Intel MIC}"},
journal={ArXiv e-prints},
archivePrefix={"arXiv"},
eprint={1311.0272},
primaryClass={"physics.comp-ph"},
keywords={Physics – Computational Physics, Computer Science – Distributed, Parallel, and Cluster Computing, Computer Science – Numerical Analysis, High Energy Physics – Experiment},
year={2013},
month={nov},
adsurl={http://adsabs.harvard.edu/abs/2013arXiv1311.0272A},
adsnote={Provided by the SAO/NASA Astrophysics Data System}
}
Process checkpoint-restart is a technology with great potential for use in HEP workflows. Use cases include debugging, reducing the startup time of applications both in offline batch jobs and the High Level Trigger, permitting job preemption in environments where spare CPU cycles are being used opportunistically and efficient scheduling of a mix of multicore and single-threaded jobs. We report on tests of checkpoint-restart technology using CMS software, Geant4-MT (multi-threaded Geant4), and the DMTCP (Distributed Multithreaded Checkpointing) package. We analyze both single- and multi-threaded applications and test on both standard Intel x86 architectures and on Intel MIC. The tests with multi-threaded applications on Intel MIC are used to consider scalability and performance. These are considered an indicator of what the future may hold for many-core computing.
November 4, 2013 by hgpu
