high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, NLP, nVidia, nVidia A100, Package

September 11, 2022 by hgpu

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Genghan Zhang, Yuetong Zhao, Yanting Tao, Zhongming Yu, Guohao Dai, Sitao Huang, Yuan Wen, Pavlos Petoumenos, Yu Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

September 11, 2022 by hgpu

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

Tsung-Wei Huang

View

Download (PDF)

Tags: AMD Radeon RX 6900 XT, ATI, Computer science, Deep learning, nVidia, nVidia GeForce RTX 3090, OpenCL, performance portability, PyTorch, SYCL

September 11, 2022 by hgpu

GGArray: A Dynamically Growable GPU Array

Enzo meneses, Cristóbal A. Navarro, Héctor Ferrada

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Memory, nVidia, nVidia A100, nVidia Titan RTX

September 4, 2022 by hgpu

Lina: a fast design optimisation tool for software-based FPGA programming

Andre Bannwart Perina

View

Download (PDF)

Source codes

Tags: Computer science, Design space exploration, FPGA, nVidia, nVidia Quadro K620, OpenCL, Package, Thesis

September 4, 2022 by hgpu

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Jhe-Yu Liou, Muaaz Awan, Steven Hofmeyr, Stephanie Forrest, Carole-Jean Wu

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, nVidia GeForce GTX 1080 Ti, Package, performance portability, Sequence alignment, Tesla P100, Tesla V100

September 4, 2022 by hgpu

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Petros Vavaroutsos, Ioannis Oroutzoglou, Dimosthenis Masouros, Dimitrios Soudris

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX 970, OpenCL

September 4, 2022 by hgpu

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Mohammad K. Dashti

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Memory model, nVidia, nVidia GeForce RTX 2070, nVidia Jetson TK1, OpenCL, Package, Thesis

August 28, 2022 by hgpu

Fully Concurrent GPU Data Structures

Muhammad Abdelghaffar Awad

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data Structures and Algorithms, nVidia, nVidia GeForce GTX Titan V, Package, Tesla V100

August 28, 2022 by hgpu

Exploring Thread Coarsening on FPGA

Mostafa Eghbali Zarch, Reece Neff, Michela Becchi

View

Download (PDF)

Tags: Compilers, Computer science, FPGA, OpenCL, Performance, performance portability

August 28, 2022 by hgpu

BenchPress: A Deep Active Benchmark Generator

Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu, Chris Cummins, Kim Hazelwood, Ajitha Rajan, Hugh Leather

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, PyTorch

August 21, 2022 by hgpu

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Igor Baratta, Chris Richardson, Garth Wells

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Latency, nVidia, nVidia A100, OpenCL, Package, Performance, SYCL

August 21, 2022 by hgpu

CUDAnalyst (CUDA + Analyst)

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

CodegenBench

CodegenBench: Can LLMs Write Efficient Code Across Architectures?

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

GGArray: A Dynamically Growable GPU Array

Lina: a fast design optimisation tool for software-based FPGA programming

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Fully Concurrent GPU Data Structures

Exploring Thread Coarsening on FPGA

BenchPress: A Deep Active Benchmark Generator

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Recent source codes

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Device Virtual Machine (DVM)

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

Most viewed papers (last 30 days)