high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

LithOS: An Operating System for Efficient Machine Learning on GPUs

Patrick H. Coppock, Brian Zhang, Eliot H. Solomon, Vasilis Kypriotis, Leon Yang, Bikash Sharma, Dan Schatzberg, Todd C. Mowry, Dimitrios Skarlatos

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A100, nVidia H100, Operating systems

April 27, 2025 by hgpu

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

Dimitar Mileski, Nikola Petrovski, Marjan Gusev

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, LLM, nVidia, nVidia A100, PTX, PyTorch

April 13, 2025 by hgpu

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

Timothée David--Cléris, Guillaume Laibe, Yona Lapeyre

View

Download (PDF)

Source codes

Tags: AMD, AMD Radeon Instinct MI250X, Astrophysics, CUDA, MPI, nVidia, nVidia A100, OpenMP, Package, Physics, PTX, ROCm, SYCL

March 23, 2025 by hgpu

Concurrent Scheduling of High-Level Parallel Programs on Multi-GPU Systems

Fabian Knorr, Philip Salzmann, Peter Thoman, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, HPC, nVidia, nVidia A100, Package, performance portability, SYCL, Task scheduling

March 23, 2025 by hgpu

A Microbenchmark Framework for Performance Evaluation of OpenMP Target Offloading

Mohammad Atif, Tianle Wang, Zhihua Dong, Charles Leggett, Meifeng Lin

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Heterogeneous systems, nVidia A100, nVidia RTX A6000, nVidia V100, OpenMP, Package

March 10, 2025 by hgpu

SUperman: Efficient Permanent Computation on GPUs

Deniz Elbek, Fatih Taşyaran, Bora Uçar, Kamer Kaya

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HPC, Numerical Analysis, nVidia, nVidia A100, nVidia Quadro GV100, OpenMPI, Package

March 10, 2025 by hgpu

Can Tensor Cores Benefit Memory-Bound Kernels? (No!)

Lingqi Zhang, Jiajun Huang, Sheng Di, Satoshi Matsuoka, Mohamed Wahib

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, Performance

March 10, 2025 by hgpu

pyATF: Constraint-Based Auto-Tuning in Python

Richard Schulze, Sergei Gorlatch, Ari Rasch

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Compilers, Computer science, CUDA, nVidia A100, OpenCL, Package, Performance, Python

March 3, 2025 by hgpu

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

Jianling Li, Shangzhan Li, Zhenye Gao, Qi Shi, Yuxuan Li, Zefan Wang, Jiacheng Huang, Haojie Wang, Jianrong Wang, Xu Han, Zhiyuan Liu, Maosong Sun

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, CUDA, Deep learning, LLM, nVidia, nVidia A100, Package, Python

March 3, 2025 by hgpu

CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads

Radostin Stoyanov, Viktória Spišaková, Jesus Ramos, Steven Gurfinkel, Andrei Vagin, Adrian Reber, Wesley Armour, Rodrigo Bruno

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia H100, nVidia RTX A6000, Package, ROCm

March 3, 2025 by hgpu

Evaluating the Performance of the DeepSeek Model in Confidential Computing Environment

Ben Dong, Qian Wang

View

Download (PDF)

Tags: Benchmarking, Cloud, Computer science, LLM, nVidia, nVidia A100, Performance, Security

February 24, 2025 by hgpu

cuSZp2: A GPU Lossy Compressor with Extreme Throughput and Optimized Compression Ratio

Yafan Huang, Sheng Di, Guanpeng Li, Franck Cappello

View

Download (PDF)

Source codes

Tags: Compression, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3080, nVidia GeForce RTX 3090, Package, PTX

February 16, 2025 by hgpu

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

* * *

high performance computing on graphics processing units: hgpu.org

LithOS: An Operating System for Efficient Machine Learning on GPUs

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

Concurrent Scheduling of High-Level Parallel Programs on Multi-GPU Systems

A Microbenchmark Framework for Performance Evaluation of OpenMP Target Offloading

SUperman: Efficient Permanent Computation on GPUs

Can Tensor Cores Benefit Memory-Bound Kernels? (No!)

pyATF: Constraint-Based Auto-Tuning in Python

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads

cuSZp2: A GPU Lossy Compressor with Extreme Throughput and Optimized Compression Ratio

Recent source codes

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)