Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure
Salzburg University of Applied Sciences, Salzburg, Austria
arXiv:2110.05156 [cs.DC], (11 Oct 2021)
@misc{uray2021desktop,
title={Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure},
author={Martin Uray and Eduard Hirsch and Gerold Katzinger and Michael Gadermayr},
year={2021},
eprint={2110.05156},
archivePrefix={arXiv},
primaryClass={cs.DC}
}
Enterprises and labs performing computationally expensive data science applications sooner or later face the problem of scale but unconnected infrastructure. For this up-scaling process, an IT service provider can be hired or in-house personnel can attempt to implement a software stack. The first option can be quite expensive if it is just about connecting several machines. For the latter option often experience is missing with the data science staff in order to navigate through the software jungle. In this technical report, we illustrate the decision process towards an on-premises infrastructure, our implemented system architecture, and the transformation of the software stack towards a scaleable GPU cluster system.
October 17, 2021 by hgpu