high performance computing on graphics processing units: hgpu.org

hgpu.org » Machine learning

Scaling On-Device GPU Inference for Large Generative Models

Jiuqiang Tang, Raman Sarokin, Ekaterina Ignasheva, Grant Jensen, Lin Chen, Juhyun Lee, Andrei Kulik, Matthias Grundmann

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, OpenCL

May 4, 2025 by hgpu

LithOS: An Operating System for Efficient Machine Learning on GPUs

Patrick H. Coppock, Brian Zhang, Eliot H. Solomon, Vasilis Kypriotis, Leon Yang, Bikash Sharma, Dan Schatzberg, Todd C. Mowry, Dimitrios Skarlatos

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A100, nVidia H100, Operating systems

April 27, 2025 by hgpu

GPU-centric Communication Schemes for HPC and ML Applications

Naveen Namashivayam

View

Download (PDF)

Tags: Computer science, Deep learning, Heterogeneous systems, HPC, Machine learning, MPI, survey

April 13, 2025 by hgpu

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch

Abhishek Ghosh, Ajay Nayak, Ashish Panwar, Arkaprava Basu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Machine learning, nVidia, nVidia RTX A6000, PyTorch

March 30, 2025 by hgpu

Efficient allocation of image recognition and LLM tasks on multi-GPU system

Marcin Lawenda, Krzesimir Samborski, Kyrylo Khloponin, Łukasz Szustak

View

Download (PDF)

Tags: Computer science, CUDA, Data parallelism, Image recognition, LLM, Machine learning, nVidia, nVidia H100, Performance

March 30, 2025 by hgpu

LLMPerf: GPU Performance Modeling meets Large Language Models

Khoi N.M. Nguyen, Hoang Duy Nguyen Do, Huyen Thao Le, Thanh Tuan Dao

View

Download (PDF)

Source codes

Tags: Computer science, LLM, Machine learning, nVidia, OpenCL, Performance, Tesla V100

March 23, 2025 by hgpu

Forecasting time series with constraints

Nathan Doumèche, Francis Bach, Éloi Bedek, Gérard Biau, Claire Boyer, Yannig Goude

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, Linear Algebra, Machine learning, nVidia, nVidia L4, Package

February 24, 2025 by hgpu

KernelBench: Can LLMs Write Efficient GPU Kernels?

Anne Ouyang, Simon Guo, Simran Arora, Alex L. Zhang, William Hu, Christopher Ré, Azalia Mirhoseini

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia L40s, Package, PyTorch

February 24, 2025 by hgpu

Ilargi: a GPU Compatible Factorized ML Model Training Framework

Wenbo Sun, Rihan Hai

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, Machine learning, nVidia, nVidia A40, Package

February 10, 2025 by hgpu

On the Partitioning of GPU Power among Multi-Instances

Tirth Vamja, Kaustabha Ray, Felix George, UmaMaheswari C Devi

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia V100, Performance

February 3, 2025 by hgpu

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Download (PDF)

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

Adaptive Optimization Techniques for High-Performance Computing

Gulsum Gudukbay Akbulut

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, Machine learning, nVidia, Optimization, Performance, Tesla K80, Thesis

January 27, 2025 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Scaling On-Device GPU Inference for Large Generative Models

LithOS: An Operating System for Efficient Machine Learning on GPUs

GPU-centric Communication Schemes for HPC and ML Applications

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch

Efficient allocation of image recognition and LLM tasks on multi-GPU system

LLMPerf: GPU Performance Modeling meets Large Language Models

Forecasting time series with constraints

KernelBench: Can LLMs Write Efficient GPU Kernels?

Ilargi: a GPU Compatible Factorized ML Model Training Framework

On the Partitioning of GPU Power among Multi-Instances

Profiling Apple Silicon Performance for ML Training

Adaptive Optimization Techniques for High-Performance Computing

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

LLM.Q: Quantized LLM training in pure CUDA/C++

Most viewed papers (last 30 days)