high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications » Computer science

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, NLP, nVidia, nVidia A100, Package

September 11, 2022 by hgpu

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

Genghan Zhang, Yuetong Zhao, Yanting Tao, Zhongming Yu, Guohao Dai, Sitao Huang, Yuan Wen, Pavlos Petoumenos, Yu Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Matrix multiplication, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

September 11, 2022 by hgpu

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Re'em Harel, Matan Rusanovsky, Ron Wagner, Harel Levin, Gal Oren

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Fortran, HPC, MPI, Package, Performance

September 11, 2022 by hgpu

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

Tsung-Wei Huang

View

Download (PDF)

Tags: AMD Radeon RX 6900 XT, ATI, Computer science, Deep learning, nVidia, nVidia GeForce RTX 3090, OpenCL, performance portability, PyTorch, SYCL

September 11, 2022 by hgpu

GGArray: A Dynamically Growable GPU Array

Enzo meneses, Cristóbal A. Navarro, Héctor Ferrada

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Memory, nVidia, nVidia A100, nVidia Titan RTX

September 4, 2022 by hgpu

Lina: a fast design optimisation tool for software-based FPGA programming

Andre Bannwart Perina

View

Download (PDF)

Source codes

Tags: Computer science, Design space exploration, FPGA, nVidia, nVidia Quadro K620, OpenCL, Package, Thesis

September 4, 2022 by hgpu

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Petros Vavaroutsos, Ioannis Oroutzoglou, Dimosthenis Masouros, Dimitrios Soudris

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX 970, OpenCL

September 4, 2022 by hgpu

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Jhe-Yu Liou, Muaaz Awan, Steven Hofmeyr, Stephanie Forrest, Carole-Jean Wu

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, nVidia GeForce GTX 1080 Ti, Package, performance portability, Sequence alignment, Tesla P100, Tesla V100

September 4, 2022 by hgpu

Fully Concurrent GPU Data Structures

Muhammad Abdelghaffar Awad

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data Structures and Algorithms, nVidia, nVidia GeForce GTX Titan V, Package, Tesla V100

August 28, 2022 by hgpu

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Mohammad K. Dashti

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Memory model, nVidia, nVidia GeForce RTX 2070, nVidia Jetson TK1, OpenCL, Package, Thesis

August 28, 2022 by hgpu

Long Code for Code Search

Fan Hu, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Xirong Li

View

Download (PDF)

Tags: Computer science, Deep learning, NLP, nVidia, Software Engineering, Tesla V100

August 28, 2022 by hgpu

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Hamdy Abdelkhalik, Yehia Arafa, Nandakishore Santhi, Abdel-Hameed Badawy

View

Download (PDF)

Tags: Benchmarking, Computer science, Hardware Architecture, Latency, nVidia, nVidia A100, Performance, PTX

August 28, 2022 by hgpu

True 4-Bit Quantized CNN Training on CPU

True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

Hunting CUDA Bugs at Scale with cuFuzz

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

CONCUR: Benchmarking LLMs for Concurrent Code Generation

HIPRT: Ray Tracing using HIP

Ray Tracing using HIP

MXFP4 Training Support Codebase

Practical FP4 Training for Large-Scale MoE Models on Hopper GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Sgap: Towards Efficient Sparse Tensor Algebra Compilation for GPU

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

GGArray: A Dynamically Growable GPU Array

Lina: a fast design optimisation tool for software-based FPGA programming

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Fully Concurrent GPU Data Structures

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Long Code for Code Search

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Recent source codes

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

HIPRT: Ray Tracing using HIP

MXFP4 Training Support Codebase

Most viewed papers (last 30 days)