Generalizing the Utility of GPUs in Large-Scale Heterogeneous Computing Systems