high performance computing on graphics processing units: hgpu.org

hgpu.org » Performance

Reusing Auto-Schedules for Efficient DNN Compilation

Perry Gibson, José Cano

View

Download (PDF)

Tags: Algorithms, Computer science, Machine learning, Neural networks, Performance, Programming Languages

January 23, 2022 by hgpu

Building a Performance Model for Deep Learning Recommendation Model Training on GPUs

Zhongyi Lin, Louis Feng, Ehsan K. Ardestani, Jaewon Lee, John Lundell, Changkyu Kim, Arun Kejariwal, John D. Owens

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce GTX Titan XP, Package, Performance, Tesla P100, Tesla V100

January 23, 2022 by hgpu

Fancier: A Unified Framework for Java, C, and OpenCL Integration

Sergio Afonso, Francisco Almeida

View

Download (PDF)

Source codes

Tags: Computer science, Image processing, Java, OpenACC, OpenCL, Package, Performance

January 16, 2022 by hgpu

A Compiler Framework for Optimizing Dynamic Parallelism on GPUs

Mhd Ghaith Olabi, Juan Gómez Luna, Onur Mutlu, Wen-mei Hwu, Izzat El Hajj

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, Package, Performance, Tesla V100

January 16, 2022 by hgpu

Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment

Hulin Dai, Xuan Peng, Xuanhua Shi, Ligang He, Qian Xiong, Hai Jin

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, Neural networks, nVidia, Performance, PyTorch, TensorFlow, Tesla P100

January 9, 2022 by hgpu

A Variant of Concurrent Constraint Programming on GPU

Pierre Talbot, Frederic Pinel, Pascal Bouvry

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia Quadro RTX 5000, Package, Performance

January 2, 2022 by hgpu

PROGRAML: A Graph-based Program Representation for Data Flow Analysis and Compiler Optimizations

Chris Cummins, Zacharias V. Fisches, Tal Ben-Nun, Torsten Hoefler, Michael O'Boyle, Hugh Leather

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Flow analysis, Machine learning, OpenCL, Package, Performance

January 2, 2022 by hgpu

Optimization of Compiler-generated OpenCL CNN Kernels and Runtime for FPGAs

Seung-Hun Chung

View

Download (PDF)

Tags: Computer science, FPGA, Neural networks, nVidia, nVidia GeForce GTX 1060, OpenCL, Performance, Thesis

December 19, 2021 by hgpu

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

Christopher Noel Hesse

View

Download (PDF)

Tags: Benchmarking, Computer science, Deep learning, FPGA, Neural networks, nVidia, nVidia DGX-1, nVidia GeForce RTX 2070, nVidia Jetson Nano, Performance, Tesla V100

December 5, 2021 by hgpu

Bayesian Optimization for auto-tuning GPU kernels

Floris-Jan Willemsen, Rob van Nieuwpoort, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Bayesian, Computer science, CUDA, Machine learning, nVidia, nVidia A100, nVidia GeForce GTX Titan X, nVidia GeForce RTX 2070, OpenCL, Package, Performance

December 5, 2021 by hgpu

Generating GPU Compiler Heuristics using Reinforcement Learning

Ian Colbert, Jake Daly, Norm Rubin

View

Download (PDF)

Tags: AMD Radeon 6800 XT, AMD Radeon RX 5700 XT, ATI, Compilers, Computer science, Machine learning, Performance

November 28, 2021 by hgpu

Predictive Data Race Detection for GPUs

Sagnik Dey, Mayant Mukul, Parth Sharma, Swarnendu Biswas

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia Quadro RTX 5000, Performance

November 28, 2021 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Reusing Auto-Schedules for Efficient DNN Compilation

Building a Performance Model for Deep Learning Recommendation Model Training on GPUs

Fancier: A Unified Framework for Java, C, and OpenCL Integration

A Compiler Framework for Optimizing Dynamic Parallelism on GPUs

Reveal training performance mystery between TensorFlow and PyTorch in the single GPU environment

A Variant of Concurrent Constraint Programming on GPU

PROGRAML: A Graph-based Program Representation for Data Flow Analysis and Compiler Optimizations

Optimization of Compiler-generated OpenCL CNN Kernels and Runtime for FPGAs

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

Bayesian Optimization for auto-tuning GPU kernels

Generating GPU Compiler Heuristics using Reinforcement Learning

Predictive Data Race Detection for GPUs

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

LLM.Q: Quantized LLM training in pure CUDA/C++

Most viewed papers (last 30 days)