high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Automatic generation of warp-level primitives and atomic instructions for fast and portable parallel reduction on GPUs

Simon Garcia De Gonzalo, Sitao Huang, Juan Gomez-Luna, Simon Hammond, Onur Mutlu, Wen-mei Hwu

View

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia GeForce GTX 980, Performance, performance portability, Tesla K40, Tesla P100

May 26, 2019 by hgpu

Comparing Energy Efficiency of CPU, GPU and FPGA Implementations for Vision Kernels

Murad Qasaimeh, Kristof Denolf, Jack Lo, Kees Vissers, Joseph Zambreno, Phillip H. Jones

View

Download (PDF)

Source codes

Tags: ARM, Benchmarking, Computer science, Computer vision, CUDA, FPGA, nVidia, nVidia Jetson TX2, OpenCV, Package

May 26, 2019 by hgpu

A Hybrid Framework for Fast and Accurate GPU Performance Estimation through Source-Level Analysis and Trace-Based Simulation

Xiebing Wang, Kai Huang, Alois Knoll, Xuehai Qian

View

Download (PDF)

Tags: Computer science, nVidia, nVidia GeForce GTX 645, nVidia GeForce GTX 940 M, nVidia Quadro K600, nVidia Quadro K620, OpenCL, Performance

May 26, 2019 by hgpu

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

Yihui Ren, Shinjae Yoo, Adolfy Hoisie

View

Download (PDF)

Tags: Cloud, Computer science, Computer vision, CUDA, Deep learning, Machine learning, NLP, nVidia, nVidia DGX-2, nVidia GeForce RTX 2080 Ti, Performance, Tesla V100

May 23, 2019 by hgpu

A Case Study: Exploiting Neural Machine Translation to Translate CUDA to OpenCL

Yonghae Kim, Hyesoon Kim

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, OpenCL

May 23, 2019 by hgpu

Instructions’ Latencies Characterization for NVIDIA GPGPUs

Yehia Arafa, Abdel-Hameed Badawy, Gopinath Chennupati, Nandakishore Santhi, Stephan Eidenbenz

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia GeForce GTX Titan X, nVidia Titan RTX, Performance, PTX, Tesla K40, Tesla P100, Tesla V100

May 23, 2019 by hgpu

Optimizing the Linear Fascicle Evaluation Algorithm for Multi-Core and Many-Core Systems

Karan Aggarwal, Uday Bondhugula, Varsha Sreenivasan, Devarajan Sridharan

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Neuroscience, nVidia, nVidia GeForce RTX 2080 Ti, Sparse matrix

May 19, 2019 by hgpu

Accelerating Deterministic and Stochastic Binarized Neural Networks on FPGAs Using OpenCL

Corey Lammie, Wei Xiang, Mostafa Rahimi Azghadi

View

Download (PDF)

Tags: Computer science, Deep learning, FPGA, Heterogeneous systems, Neural networks, OpenCL

May 19, 2019 by hgpu

OpenDNN: An Open-source, cuDNN-like Deep Learning Primitive Library

Daeyeon Kim

View

Download (PDF)

Tags: Computer science, Deep learning, FPGA, Neural networks, OpenCL, Performance, Thesis

May 19, 2019 by hgpu

CUDA au Coq: A Framework for Machine-validating GPU Assembly Programs

Benjamin Ferrell, Jun Duan, Kevin W. Hamlen

View

Download (PDF)

Tags: Algorithms, Compilers, Computer science, CUDA, nVidia, PTX

May 15, 2019 by hgpu

A Unified Approach to Variable Renaming for Enhanced Vectorization

Prasanth Chatarasi, Jun Shirako, Albert Cohen, Vivek Sarkar

View

Download (PDF)

Tags: Benchmarking, Compilers, Computer science, CUDA, Intel Xeon Phi, nVidia, Tesla V100

May 15, 2019 by hgpu

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

PortLBM: A Portable Lattice Boltzmann Tool Leveraging SYCL on AMD, NVIDIA, and Intel GPUs

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Compiler-Grounded Hierarchical Diagnosis for LLM-Based Triton Kernel Optimization

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Automatic generation of warp-level primitives and atomic instructions for fast and portable parallel reduction on GPUs

Comparing Energy Efficiency of CPU, GPU and FPGA Implementations for Vision Kernels

A Hybrid Framework for Fast and Accurate GPU Performance Estimation through Source-Level Analysis and Trace-Based Simulation

A Case Study: Exploiting Neural Machine Translation to Translate CUDA to OpenCL

Instructions’ Latencies Characterization for NVIDIA GPGPUs

Optimizing the Linear Fascicle Evaluation Algorithm for Multi-Core and Many-Core Systems

Accelerating Deterministic and Stochastic Binarized Neural Networks on FPGAs Using OpenCL

OpenDNN: An Open-source, cuDNN-like Deep Learning Primitive Library

CUDA au Coq: A Framework for Machine-validating GPU Assembly Programs

A Unified Approach to Variable Renaming for Enhanced Vectorization

Recent source codes

FP4 FlashAttention forward, backward, and TorchTitan reproduction code

EinsummableV3 - graph-based computation with tensor operations support

MaxKernel: Intelligent TPU Kernel Engineering Agents

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Most viewed papers (last 30 days)