Optimization of the Gaussian Mixture Model Evaluation on GPU

Jan Vanek, Jan Trmal, Josef V. Psutka, Josef Psutka
Department of Cybernetics, University of West Bohemia, Univerzitni 8, 306 14 Plzen, Czech Republic


   title={Optimization of the Gaussian Mixture Model Evaluation on GPU},

   author={Vanek, J. and Trmal, J. and Psutka, J.V. and Psutka, J.},



Download Download (PDF)   View View   Source Source   



In this paper we present a highly optimized implementation of Gaussian mixture acoustic model evaluation algorithm. Evaluation of these likelihoods is one of the most computationally intensive parts of automatics speech recognizers but it can be well-parallelized and offloaded to GPU devices. Our approach offers significant speed-up compared to the recently published approaches, since it exploits the GPU architecture better. All the recent implementations were programmed either in CUDA or OpenCL GPU programming frameworks. We present results for both; CUDA as well as OpenCL. Results suggest that even very large acoustic models can be utilized in real-time speech recognition engines on computers and laptops equipped with a low-end GPU. Optimization of acoustic likelihoods computation on GPU enables to use the remaining GPU resources for offloading of other computeintensive parts of LVCSR decoder. Other possible use of the freed GPU resources is to evaluate several acoustic models at the same time and use fusion techniques or model selection techniques to improve the quality of resulting conditional likelihoods under diverse conditions.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2021 hgpu.org

All rights belong to the respective authors

Contact us: