high performance computing on graphics processing units: hgpu.org

hgpu.org » Code generation

A Domain-Extensible Compiler with Controllable Automation of Optimisations

Thomas Kœhler

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, DSL, Heterogeneous systems, Image processing, Machine learning, OpenCL, Package, Thesis

January 8, 2023 by hgpu

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

Jianhui Li, Zhennan Qin, Yijie Mei, Jingze Cui, Yunfei Song, Ciyong Chen, Yifei Zhang, Longsheng Du, Xianhang Cheng, Baihui Jin, Jason Ye, Eric Lin, Dan Lavery

View

Download (PDF)

Source codes

Tags: Code generation, Compilers, Computer science, Deep learning, OpenCL, Package

January 8, 2023 by hgpu

Code Generation from Functional to Imperative: Combining Destination-Passing Style and Views

Zhitao Lin

View

Download (PDF)

Tags: Code generation, Computer science, nVidia, nVidia GeForce GTX 940 M, OpenCL, Thesis

December 19, 2022 by hgpu

BenchPress: A Deep Active Benchmark Generator

Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu, Chris Cummins, Kim Hazelwood, Ajitha Rajan, Hugh Leather

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, PyTorch

August 21, 2022 by hgpu

Real-Time High-Performance Computing for Embedded Control Systems

Alejandro Josué Calderón Torres

View

Download (PDF)

Tags: Code generation, Computer science, Embedded high-performance computing, nVidia, nVidia Jetson AGX Xavier, nVidia Jetson Nano, nVidia Jetson TX2, OpenCL, Tesla T4, Tesla V100, Thesis

August 7, 2022 by hgpu

On the Compilation Performance of Current SYCL Implementations

Peter Thoman, Facundo Molina Heredia, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Code generation, Compilers, Computer science, Heterogeneous systems, OpenCL, Package, Performance, SYCL

June 12, 2022 by hgpu

Analytical Performance Estimation during Code Generation on Modern GPUs

Dominik Ernst, Markus Holzer, Georg Hager, Matthias Knorr, Gerhard Wellein

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Lattice Boltzmann model, Machine learning, nVidia, OpenCL, Package, Tesla A100, Tesla V100

May 8, 2022 by hgpu

The Celerity High-level API: C++20 for Accelerator Clusters

Peter Thoman, Florian Tischler, Philip Salzmann, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Data parallelism, MPI, nVidia, nVidia GeForce RTX 2070, Package, Programming techniques, SYCL

May 1, 2022 by hgpu

Efficient Execution of OpenMP on GPUs

Joseph Huber, Melanie Cornelius, Giorgis Georgakoudis, Shilei Tian, Jose M Monsalve Diaz, Kuter Dinel, Barbara Chapman, Johannes Doerfert

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Heterogeneous systems, HPC, LLVM, nVidia, OpenMP, Package, Tesla V100

May 1, 2022 by hgpu

DISTAL: The Distributed Tensor Algebra Compiler

Rohan Yadav, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Heterogeneous systems, nVidia, Tesla V100

March 20, 2022 by hgpu

Romou: Rapidly Generate High-Performance Tensor Kernels for Mobile GPUs

Rendong Liang, Ting Cao, Jicheng Wen, Manni Wang, Yang Wang, Jianhua Zou, Yunxin Liu

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, OpenCL, Package, Performance, Vulkan

March 6, 2022 by hgpu

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

Wenzel Jakob, Sébastien Speierer, Nicolas Roussel, Delio Vicini

View

Download (PDF)

Tags: 3D Graphics and Realism, Algorithms, Code generation, CUDA, nVidia, nVidia RTX A6000, Python, Rendering

February 6, 2022 by hgpu

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

* * *

high performance computing on graphics processing units: hgpu.org

A Domain-Extensible Compiler with Controllable Automation of Optimisations

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

Code Generation from Functional to Imperative: Combining Destination-Passing Style and Views

BenchPress: A Deep Active Benchmark Generator

Real-Time High-Performance Computing for Embedded Control Systems

On the Compilation Performance of Current SYCL Implementations

Analytical Performance Estimation during Code Generation on Modern GPUs

The Celerity High-level API: C++20 for Accelerator Clusters

Efficient Execution of OpenMP on GPUs

DISTAL: The Distributed Tensor Algebra Compiler

Romou: Rapidly Generate High-Performance Tensor Kernels for Mobile GPUs

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

Recent source codes

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)