Adaptive Dynamic Load Balancing in Heterogeneous Multiple GPUs-CPUs Distributed Setting: Case Study of B&B Tree Search
DOLPHIN, INRIA Lille – Nord Europe, University Lille 1, France
7th International Learning and Intelligent OptimizatioN Conference (LION), 2013
@inproceedings{vu2013adaptive,
title={Adaptive Dynamic Load Balancing in Heterogenous Multiple GPUs-CPUs Distributed Setting: Case Study of B&B Tree Search},
author={Vu, T.T. and Derbel, B. and Melab, N. and others},
booktitle={7th International Learning and Intelligent OptimizatioN Conference (LION)},
year={2013}
}
The emergence of new hybrid and heterogenous multi-GPU multi-CPU large scale platforms offers new opportunities and pauses new challenges when solving difficult optimization problems. This paper targets irregular tree search algorithms in which workload is unpredictable. We propose an adaptive distributed approach allowing to distribute the load dynamically at runtime while taking into account the computing abilities of either GPUs or CPUs. Using Branch-and-Bound and Flowshop as a case study, we deployed our approach using up to 20 GPUs jointly to up to 128 CPUs. Through extensive experiments in different system configurations, we report near optimal speedups, thus providing new insights into how to take full advantage of both GPUs and CPUs power in modern computing platforms.
January 14, 2013 by hgpu
