high performance computing on graphics processing units: hgpu.org

Xiaojie Wu, Qiming Sun, Zhichen Pu, Tianze Zheng, Wenzhi Ma, Wen Yan, Xia Yu, Zhengxiao Wu, Mian Huo, Xiang Li, Weiluo Ren, Sheng Gong, Yumin Zhang, Weihao Gao

View

Download (PDF)

Source codes

Tags: Chemical Physics, Chemistry, Computational Physics, CUDA, nVidia, nVidia A100, Package, Python, Quantum Physics

April 21, 2024 by hgpu

A Systematic Literature Survey of Sparse Matrix-Vector Multiplication

Jianhua Gao, Bingjie Liu, Weixing Ji, Hua Huang

View

Download (PDF)

Tags: Computer science, FPGA, Heterogeneous systems, Linear Algebra, Machine learning, Overview, Sparse matrix

April 14, 2024 by hgpu

QArray: a GPU-accelerated constant capacitance model simulator for large quantum dot arrays

Barnaby van Straaten, Joseph Hickie, Lucas Schorling, Jonas Schuff, Federico Fedele, Natalia Ares

View

Download (PDF)

Source codes

Tags: Condensed matter, Machine learning, Mesoscale and Nanoscale Physics, nVidia, nVidia GeForce GTX 1080 Ti, Package, Physics, Python, Rust

April 14, 2024 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

A Survey of Deep Learning Library Testing Methods

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Porting HPC Applications to AMD Instinct MI300A Using Unified Memory and OpenMP

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

Experiences with implementing Kokkos’ SYCL backend

Software Optimization and Orchestration for Heterogeneous and Distributed Architectures

SimSYCL: A SYCL Implementation Targeting Development, Debugging, Simulation and Conformance

Efficient Approaches for GEMM Acceleration on Leading AI-Optimized FPGAs

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

Python-Based Quantum Chemistry Calculations with GPU Acceleration

A Systematic Literature Survey of Sparse Matrix-Vector Multiplication

QArray: a GPU-accelerated constant capacitance model simulator for large quantum dot arrays

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

Most viewed papers (last 30 days)