high performance computing on graphics processing units: hgpu.org

hgpu.org » Performance

The VerCors Verifier: A Progress Report

Lukas Armborst, Pieter Bos, Lars B. van den Haak, Marieke Huisman, Robert Rubbens, Ömer Şakar, Philip Tasche

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, OpenCL, OpenMP, Package, Performance, SYCL

August 18, 2024 by hgpu

HiCCL: A Hierarchical Collective Communication Library

Mert Hidayetoglu, Simon Garcia de Gonzalo, Elliott Slaughter, Pinku Surana, Wen-mei Hwu, William Gropp, Alex Aiken

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, HIP, nVidia, nVidia A100, Package, Performance, SYCL

August 18, 2024 by hgpu

Anatomizing Deep Learning Inference in Web Browsers

Qipeng Wang, Shiqi Jiang, Zhenpeng Chen, Xu Cao, Yuanchun Li, Aoyu Li, Yun Ma, Ting Cao, Xuanzhe Liu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1060, nVidia GeForce GTX 980, nVidia GeForce RTX 2060, OpenCL, Package, Performance, TensorFlow

August 18, 2024 by hgpu

In-Situ Techniques on GPU-Accelerated Data-Intensive Applications

Yi Ju, Mingshuai Li, Adalberto Perez, Laura Bellentani, Niclas Jansson, Stefano Markidis, Philipp Schlatter, Erwin Laure

View

Download (PDF)

Tags: Computer science, CUDA, Fluid dynamics, HPC, Molecular dynamics, nVidia, nVidia A100, PC cluster, Performance

August 14, 2024 by hgpu

Evaluating Operators in Deep Neural Networks for Improving Performance Portability of SYCL

Zheming Jin

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, HIP, Machine learning, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, nVidia H100, oneAPI, Performance, performance portability, SYCL, Tesla A100, Tesla V100

August 14, 2024 by hgpu

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Junqing Lin, Jingwei Sun, Xiaolong Shi, Honghe Zhang, Xianzhi Yu, Xinzhi Wang, Jun Yao, Guangzhong Sun

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080 Ti, Performance, Sparse matrix, Tesla V100

August 4, 2024 by hgpu

Data-driven Forecasting of Deep Learning Performance on GPUs

Seonho Lee, Amar Phanishayee, Divya Mahajan

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia H100, nVidia P100, nVidia V100, Performance, PyTorch, Tesla T4

August 4, 2024 by hgpu

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Milo Lurati, Stijn Heldens, Alessio Sclocco, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, AMD Radeon Pro W6600, ATI, Computer science, CUDA, HIP, nVidia, nVidia A100, nVidia RTX A4000, Package, Performance, Python

July 28, 2024 by hgpu

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer, Jacob Wahlgren, Jie Ren, Jennifer Faj, Ivy Peng

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia H100, Performance, Quantum computing

July 14, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

A methodology for comparing optimization algorithms for auto-tuning

Floris-Jan Willemsen, Richard Schoonhoven, Jiří Filipovič, Jacob O. Tørring, Rob van Nieuwpoort, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, Package, Performance

June 16, 2024 by hgpu

high performance computing on graphics processing units: hgpu.org

The VerCors Verifier: A Progress Report

HiCCL: A Hierarchical Collective Communication Library

Anatomizing Deep Learning Inference in Web Browsers

In-Situ Techniques on GPU-Accelerated Data-Intensive Applications

Evaluating Operators in Deep Neural Networks for Improving Performance Portability of SYCL

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Data-driven Forecasting of Deep Learning Performance on GPUs

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

A methodology for comparing optimization algorithms for auto-tuning

Recent source codes

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

NVIDIA Object Oriented Agents

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

CuFuzz: An API-Knowledge-Graph Coverage-Driven Fuzzing Framework for CUDA Libraries

Most viewed papers (last 30 days)