high performance computing on graphics processing units: hgpu.org

Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, Jing Dong, Brandon Amos, Mustafa Mukadam

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Nonlinear optimization, nVidia, Package, Tesla V100

July 24, 2022 by hgpu

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Philip Jon Børgesen

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Performance, Thesis

July 17, 2022 by hgpu

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

Vortex-Optimized Light-weight Toolchain (VOLT)

Inside VOLT: Designing an Open-Source GPU Compiler (Tool)

SciDef: Automated Definition Extraction from Scientific Literature

SciDef: Automating Definition Extraction from Academic Literature with Large Language Models

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

* * *

high performance computing on graphics processing units: hgpu.org

Programming

GGArray: A Dynamically Growable GPU Array

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Fully Concurrent GPU Data Structures

Optimization of GPU workloads using natural language processing based on deep learning techniques

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

COX: Exposing CUDA Warp-Level Functions to CPUs

Design and Implementation of ShenWei Universal C/C++

Demystifying Dependency Bugs in Deep Learning Stack

Theseus: A Library for Differentiable Nonlinear Optimization

Reducing Synchronous GPU Memory Transfers: Design and implementation of a Futhark compiler optimisation

Recent source codes

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Vortex-Optimized Light-weight Toolchain (VOLT)

SciDef: Automated Definition Extraction from Scientific Literature

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Awesome LLM-Driven Kernel Generation

Most viewed papers (last 30 days)