high performance computing on graphics processing units: hgpu.org

hgpu.org » CUDA

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Aashaka Shah, Abhinav Jangda, Binyang Li, Caio Rocha, Changho Hwang, Jithin Jose, Madan Musuvathi, Olli Saarikivi, Peng Cheng, Qinghua Zhou, Roshan Dathathri, Saeed Maleki, Ziyue Yang

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI300X, ATI, Computer science, CUDA, Heterogeneous systems, HIP, nVidia, nVidia A100, nVidia H100, Package

April 27, 2025 by hgpu

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

David Algis, Berenger Bramas, Emmanuelle Darles, Lilian Aveneau

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, DirectX, nVidia, nVidia GeForce RTX 2070, OpenGL, Package, Rendering

April 27, 2025 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

Weijie Lv, Xuan Xia, Sheng-Jun Huang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Python, PyTorch

April 27, 2025 by hgpu

LithOS: An Operating System for Efficient Machine Learning on GPUs

Patrick H. Coppock, Brian Zhang, Eliot H. Solomon, Vasilis Kypriotis, Leon Yang, Bikash Sharma, Dan Schatzberg, Todd C. Mowry, Dimitrios Skarlatos

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A100, nVidia H100, Operating systems

April 27, 2025 by hgpu

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Masahiro Tanaka, Du Li, Umesh Chand, Ali Zafar, Haiying Shen, Olatunji Ruwase

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia H100, Package, Prefetch

April 27, 2025 by hgpu

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

Dimitar Mileski, Nikola Petrovski, Marjan Gusev

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, LLM, nVidia, nVidia A100, PTX, PyTorch

April 13, 2025 by hgpu

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

Meng Wang, Jinshuo Liu, Zimeng Xu, Chang Ding, Xiaomeng Huang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 4090, Package

April 13, 2025 by hgpu

GigaAPI for GPU Parallelization

M. Suvarna, O. Tehrani

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Image processing, nVidia, nVidia RTX 6000 Ada, Package

April 13, 2025 by hgpu

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

Michele Martone, Julia Lawall

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HIP, HPC, nVidia, OpenMP, Package, Programming Languages

March 30, 2025 by hgpu

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch

Abhishek Ghosh, Ajay Nayak, Ashish Panwar, Arkaprava Basu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Machine learning, nVidia, nVidia RTX A6000, PyTorch

March 30, 2025 by hgpu

Efficient allocation of image recognition and LLM tasks on multi-GPU system

Marcin Lawenda, Krzesimir Samborski, Kyrylo Khloponin, Łukasz Szustak

View

Download (PDF)

Tags: Computer science, CUDA, Data parallelism, Image recognition, LLM, Machine learning, nVidia, nVidia H100, Performance

March 30, 2025 by hgpu

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

Timothée David--Cléris, Guillaume Laibe, Yona Lapeyre

View

Download (PDF)

Source codes

Tags: AMD, AMD Radeon Instinct MI250X, Astrophysics, CUDA, MPI, nVidia, nVidia A100, OpenMP, Package, Physics, PTX, ROCm, SYCL

March 23, 2025 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

No More Shading Languages: Compiling C++ to Vulkan Shaders

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

Engineering Supercomputing Platforms for Biomolecular Applications

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

chemtrain-deploy: A parallel and scalable framework for machine learning potentials in million-atom MD simulations

microSYCL: SYCL micro-benchmarks repository

Exploring SYCL as a Portability Layer for High-Performance Computing on CPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

Data-efficient LLM Fine-tuning for Code Generation

LithOS: An Operating System for Efficient Machine Learning on GPUs

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI for GPU Parallelization

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch

Efficient allocation of image recognition and LLM tasks on multi-GPU system

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

Recent source codes

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

exa-AMD: Exascale Accelerated Materials Discovery

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

microSYCL: SYCL micro-benchmarks repository

Most viewed papers (last 30 days)