high performance computing on graphics processing units: hgpu.org

Scalability is an important concept in the domain of parallel computing. Since Graphics Processing Unit (GPU) clusters are and will be widely utilized in high performance computing platforms, we investigate the factors influencing the scalability for combinations of parallel algorithms (PA) and GPU clusters (GC).We present a scalability model for combination PA-GC and then validate it by executing some well-known benchmarks on certain GPU cluster (i.e., TH-1A). Experimental results show that the proposed model can well predict the scalability of various PA-GC combinations. In particular, we have discussed the influencing factors for scalability and pointed out the corresponding techniques to improve the scalability of PA-GC combinations.