Parallel Exact Inference on a CPU-GPGPU Heterogenous System

Hyeran Jeon, Yinglong Xia, Viktor K. Prasanna
Ming Hsieh Department of Electrical Engineering, University of Southern California, Los Angeles, CA 90089, USA
39th International Conference on Parallel Processing (ICPP), 2010


   title={Parallel Exact Inference on a CPU-GPGPU Heterogenous System},

   author={Jeon, H. and Xia, Y. and Prasanna, V.K.},

   booktitle={2010 39th International Conference on Parallel Processing},






Download Download (PDF)   View View   Source Source   



Exact inference is a key problem in exploring probabilistic graphical models. The computational complexity of inference increases dramatically with the parameters of the graphical model. To achieve scalability over hundreds of threads remains a fundamental challenge. In this paper, we use a lightweight scheduler hosted by the CPU to allocate cliques in junction trees to the GPGPU at run time. The scheduler merges multiple small cliques or splits large cliques dynamically so as to maximize the utilization of the GPGPU resources. We implement node level primitives on the GPGPU to process the cliques assigned by the CPU. We propose a conflict free potential table organization and an efficient data layout for coalescing memory accesses. In addition, we develop a double buffering based asynchronous data transfer between CPU and GPGPU to overlap clique processing on the GPGPU with data transfer and scheduling activities. Our implementation achieved 30x speedup compared with state-of-the-art multicore processors.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: