high performance computing on graphics processing units: hgpu.org

hgpu.org » paper

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Hongyuan Liu, Qiang Wang, Xiaowen Chu

View

Tags: Benchmarking, Computer science, CUDA, Hardware Architecture, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

January 27, 2025 by hgpu

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Naifeng Zhang, Franz Franchetti

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Linear Algebra, Modular arithmetic, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia V100, Package, Security

January 20, 2025 by hgpu

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Dinei A. Rockenbach, Gabriell Araujo, Dalvan Griebler, Luiz Gustavo Fernandes

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, nVidia, nVidia GeForce RTX 3090, OpenCL, OpenMP, Package

January 20, 2025 by hgpu

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

Jonah Ekelund, Stefano Markidis, Ivy Peng

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, FDTD, HIP, nVidia, nVidia A100, nVidia H100, Package, Performance

January 20, 2025 by hgpu

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

Rémi Genet, Hugo Inzirillo

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Python, TensorFlow

January 20, 2025 by hgpu

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

Csaba Tóth, Danilo Jr Dela Cruz, Harald Oberhauser

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A100, Package, Python

January 20, 2025 by hgpu

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

Ruijun Feng, Hammond Pearce, Pietro Liguori, Yulei Sui

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Python, PyTorch, Security

January 13, 2025 by hgpu

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

Manos Pavlidakis, Chris Kitching, Nicholas Tomlinson, Michael Søndergaard

View

Download (PDF)

Tags: ATI, Compilers, Computer science, CUDA, HIP, nVidia, Package, Portability, PTX

January 13, 2025 by hgpu

Validation of GPU Computation in Decentralized, Trustless Networks

Eric Boniardi, Stanley Bishop, Alison Haire

View

Download (PDF)

Tags: Computer science, Distributed computing

January 13, 2025 by hgpu

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Jiaping Wang, Simiao Zhang, Qiao-Chu He, Yifan Chen

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia RTX A6000, Package, Python, PyTorch

January 13, 2025 by hgpu

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

Stefan Zellmann

View

Download (PDF)

Source codes

Tags: 3D Graphics and Realism, HPC, MPI, nVidia, nVidia H100, Package, Rendering, Visualization

January 13, 2025 by hgpu

Finding Missed Code Size Optimizations in Compilers using LLMs

Davide Italiano, Chris Cummins

View

Download (PDF)

Tags: Computer science, LLM, Machine learning, Optimization, Programming Languages, Software Engineering

January 6, 2025 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

SCALE-Ahead-Of-Time Compilation of CUDA for AMD GPUs

Validation of GPU Computation in Decentralized, Trustless Networks

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Data Parallel Visualization and Rendering on the RAMSES Supercomputer with ANARI

Finding Missed Code Size Optimizations in Compilers using LLMs

Recent source codes

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Most viewed papers (last 30 days)