SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu
School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, 510006, China
arXiv:2212.03410 [cs.DC], (7 Dec 2022)




   author={Du, Jiangsu and Li, Dongsheng and Wen, Yingpeng and Jiang, Jiazhi and Huang, Dan and Liao, Xiangke and Lu, Yutong},

   keywords={Distributed, Parallel, and Cluster Computing (cs.DC), Artificial Intelligence (cs.AI), Performance (cs.PF), FOS: Computer and information sciences, FOS: Computer and information sciences},

   title={SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems},



   copyright={arXiv.org perpetual, non-exclusive license}


Download Download (PDF)   View View   Source Source   



Novel artificial intelligence (AI) technology has expedited various scientific research, e.g., cosmology, physics and bioinformatics, inevitably becoming a significant category of workload on high performance computing (HPC) systems. Existing AI benchmarks tend to customize well-recognized AI applications, so as to evaluate the AI performance of HPC systems under predefined problem size, in terms of datasets and AI models. Due to lack of scalability on the problem size, static AI benchmarks might be under competent to help understand the performance trend of evolving AI applications on HPC systems, in particular, the scientific AI applications on large-scale systems. In this paper, we propose a scalable evaluation methodology (SAIH) for analyzing the AI performance trend of HPC systems with scaling the problem sizes of customized AI applications. To enable scalability, SAIH builds a set of novel mechanisms for augmenting problem sizes. As the data and model constantly scale, we can investigate the trend and range of AI performance on HPC systems, and further diagnose system bottlenecks. To verify our methodology, we augment a cosmological AI application to evaluate a real HPC system equipped with GPUs as a case study of SAIH.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Contact us: