high performance computing on graphics processing units: hgpu.org

hgpu.org » OpenCL

Scaling On-Device GPU Inference for Large Generative Models

Jiuqiang Tang, Raman Sarokin, Ekaterina Ignasheva, Grant Jensen, Lin Chen, Juhyun Lee, Andrei Kulik, Matthias Grundmann

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, OpenCL

May 4, 2025 by hgpu

Efficient deep learning inference on end devices

Ehsan Aghapour

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Heterogeneous systems, OpenCL, Package, Thesis

May 4, 2025 by hgpu

LLMPerf: GPU Performance Modeling meets Large Language Models

Khoi N.M. Nguyen, Hoang Duy Nguyen Do, Huyen Thao Le, Thanh Tuan Dao

View

Download (PDF)

Source codes

Tags: Computer science, LLM, Machine learning, nVidia, OpenCL, Performance, Tesla V100

March 23, 2025 by hgpu

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Changqing Shi, Yufei Sun, Rui Chen, Jiahao Wang, Qiang Guo, Chunye Gong, Yicheng Sui, Yutong Jin, Yuzhi Zhang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, HPC, Memory model, nVidia, OpenCL, Package

March 3, 2025 by hgpu

pyATF: Constraint-Based Auto-Tuning in Python

Richard Schulze, Sergei Gorlatch, Ari Rasch

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Compilers, Computer science, CUDA, nVidia A100, OpenCL, Package, Performance, Python

March 3, 2025 by hgpu

Teaching An Old Dog New Tricks: Porting Legacy Code to Heterogeneous Compute Architectures With Automated Code Translation

Nicolas Nytko, Andrew Reisner, J. David Moulton, Luke N. Olson, Matthew West

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Fortran, Heterogeneous systems, MPI, nVidia, nVidia A100, OpenCL

February 16, 2025 by hgpu

Towards autonomous resource management: Deep learning prediction of CPU-GPU load balancing

Inigo Gabirondo Lopez

View

Download (PDF)

Tags: AMD Radeon HD 7970, Artificial intelligence, ATI, Computer science, Deep learning, Heterogeneous systems, load balancing, nVidia, nVidia GeForce GTX 970, OpenCL

February 10, 2025 by hgpu

CPU-GPU co-execution through the exploitation of hybrid technologies via SYCL

Nozal Raúl, Jose Luis Bosque

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Hybrid computing, LLVM, load balancing, nVidia, nVidia GeForce GT 1030, oneAPI, OpenCL, performance portability, SYCL

February 3, 2025 by hgpu

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Dinei A. Rockenbach, Gabriell Araujo, Dalvan Griebler, Luiz Gustavo Fernandes

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, nVidia, nVidia GeForce RTX 3090, OpenCL, OpenMP, Package

January 20, 2025 by hgpu

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

Huanting Wang, Patrick Lenihan, Zheng Wang

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Machine learning, OpenCL, Optimization, Package, Software Engineering

January 6, 2025 by hgpu

A comparison of HPC-based quantum computing simulators using Quantum Volume

Lourens van Niekerk, Dhiraj Kumar, Aasish Kumar Sharma, Tino Meisel, Martin Leandro Paleico, Christian Boehme

View

Download (PDF)

Tags: Benchmarking, CUDA, nVidia, nVidia A100, OpenCL, Overview, Physics, Quantum computing, Review

January 6, 2025 by hgpu

FortranX: Harnessing Code Generation, Portability, and Heterogeneity in Fortran

Sanil Rao, Mike Franusich, , Mohammad Alaul Haque Monil, Het Mankad, Jeffrey S. Vetter, Franz Franchetti

View

Download (PDF)

Tags: AMD, ATI, Code generation, Computer science, CUDA, Differential equations, Fortran, Heterogeneous systems, HIP, nVidia, OpenCL, OpenMP, Partial differential equations, PDEs

December 8, 2024 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Scaling On-Device GPU Inference for Large Generative Models

Efficient deep learning inference on end devices

LLMPerf: GPU Performance Modeling meets Large Language Models

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

pyATF: Constraint-Based Auto-Tuning in Python

Teaching An Old Dog New Tricks: Porting Legacy Code to Heterogeneous Compute Architectures With Automated Code Translation

Towards autonomous resource management: Deep learning prediction of CPU-GPU load balancing

CPU-GPU co-execution through the exploitation of hybrid technologies via SYCL

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Enhancing Deployment-Time Predictive Model Robustness for Code Analysis and Optimization

A comparison of HPC-based quantum computing simulators using Quantum Volume

FortranX: Harnessing Code Generation, Portability, and Heterogeneity in Fortran

Recent source codes

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Most viewed papers (last 30 days)