high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

August Ernstsson

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, High-level Languages, nVidia, OpenCL, Tesla K20, Thesis

February 13, 2022 by hgpu

The Ecological Footprint of Neural Machine Translation Systems

Dimitar Sherionov, Eva Vanmassenhove

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, nVidia GeForce GTX 1080 Ti, Package, Tesla P100

February 13, 2022 by hgpu

Flashlight: Enabling Innovation in Tools for Machine Learning

Jacob Kahn, Vineel Pratap, Tatiana Likhomanenko, Qiantong Xu, Awni Hannun, Jeff Cai, Paden Tomasello, Ann Lee, Edouard Grave, Gilad Avidov, Benoit Steiner, Vitaliy Liptchinsky, Gabriel Synnaeve, Ronan Collobert

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, Package, Tesla V100

February 6, 2022 by hgpu

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

Wenzel Jakob, Sébastien Speierer, Nicolas Roussel, Delio Vicini

View

Download (PDF)

Tags: 3D Graphics and Realism, Algorithms, Code generation, CUDA, nVidia, nVidia RTX A6000, Python, Rendering

February 6, 2022 by hgpu

SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets

Xiaodong Yu, Sheng Di, Kai Zhao, jiannan Tian, Dingwen Tao, Xin Liang, Franck Cappello

View

Download (PDF)

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia A100, Tesla V100

February 6, 2022 by hgpu

GC3: An Optimizing Compiler for GPU Collective Communication

Meghan Cowan, Saeed Maleki, Madanlal Musuvathi, Olli Saarikivi, Yifan Xiong

View

Download (PDF)

Tags: Algorithms, Compilers, Computer science, CUDA, Machine learning, nVidia, nVidia A100

February 6, 2022 by hgpu

Teaching Parallel Programming in Containers: Virtualization of a Heterogeneous Local Infrastructure

Naylor Garcia Bachiega

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, HPC, nVidia, nVidia GeForce GTX 650, Package, Thesis, Virtualization

January 30, 2022 by hgpu

Optimizing Huffman Decoding for Error-Bounded Lossy Compression on GPUs

Cody Rivera, Sheng Di, Jiannan Tian, Xiaodong Yu, Dingwen Tao, Franck Cappello

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, Package, Tesla V100

January 30, 2022 by hgpu

Bit-GraphBLAS: Bit-Level Optimizations of Matrix-Centric Graph Processing on GPU

Jou-An Chen, Hsin-Hsuan Sung, Nathan Tallent, Kevin Barker, Xipeng Shen, Ang Li

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUDA, Linear Algebra, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX Titan V, Package, Sparse

January 30, 2022 by hgpu

A tool set for random number generation on GPUs in R

Ruoyong Xu, Patrick Brown, Pierre L'Ecuyer

View

Download (PDF)

Source codes

Tags: Computer science, OpenCL, Package, Pseudo-random number generators, R

January 23, 2022 by hgpu

Reusing Auto-Schedules for Efficient DNN Compilation

Perry Gibson, José Cano

View

Download (PDF)

Tags: Algorithms, Computer science, Machine learning, Neural networks, Performance, Programming Languages

January 23, 2022 by hgpu

Multi-hetero Acceleration by GPU and FPGA for Astrophysics Simulation on oneAPI Environment

Ryuta Kashino, Ryohei Kobayashi, Norihisa Fujita, Taisuke Boku

View

Download (PDF)

Tags: Astrophysics, CUDA, FPGA, Heterogeneous systems, nVidia, OpenCL, Physics, SYCL

January 23, 2022 by hgpu

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

PortLBM: A Portable Lattice Boltzmann Tool Leveraging SYCL on AMD, NVIDIA, and Intel GPUs

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Compiler-Grounded Hierarchical Diagnosis for LLM-Based Triton Kernel Optimization

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

The Ecological Footprint of Neural Machine Translation Systems

Flashlight: Enabling Innovation in Tools for Machine Learning

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets

GC3: An Optimizing Compiler for GPU Collective Communication

Teaching Parallel Programming in Containers: Virtualization of a Heterogeneous Local Infrastructure

Optimizing Huffman Decoding for Error-Bounded Lossy Compression on GPUs

Bit-GraphBLAS: Bit-Level Optimizations of Matrix-Centric Graph Processing on GPU

A tool set for random number generation on GPUs in R

Reusing Auto-Schedules for Efficient DNN Compilation

Multi-hetero Acceleration by GPU and FPGA for Astrophysics Simulation on oneAPI Environment

Recent source codes

FP4 FlashAttention forward, backward, and TorchTitan reproduction code

EinsummableV3 - graph-based computation with tensor operations support

MaxKernel: Intelligent TPU Kernel Engineering Agents

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Most viewed papers (last 30 days)