high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming » CUDA

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Milo Lurati, Stijn Heldens, Alessio Sclocco, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, AMD Radeon Pro W6600, ATI, Computer science, CUDA, HIP, nVidia, nVidia A100, nVidia RTX A4000, Package, Performance, Python

July 28, 2024 by hgpu

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, NLP, nVidia, nVidia A800

July 28, 2024 by hgpu

RBMD: A molecular dynamics package enabling to simulate 10 million all-atom particles in a single graphics processing unit

Weihang Gao, Teng Zhao, Yongfa Guo, Jiuyang Liang, Huan Liu, Maoying Luo, Zedong Luo, Wei Qin, Yichao Wang, Qi Zhou, Shi Jin, Zhenli Xu

View

Download (PDF)

Source codes

Tags: Computational Physics, CUDA, Heterogeneous systems, Molecular dynamics, nVidia, nVidia GeForce RTX 4090, Package, Physics, Tesla A100, Tesla V100

July 28, 2024 by hgpu

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Jianhua Gao, Weixing Ji, Yizhuo Wang

View

Download (PDF)

Tags: Computer science, CUDA, Linear Algebra, nVidia, Optimization, Sparse matrix, Tesla V100

July 14, 2024 by hgpu

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer, Jacob Wahlgren, Jie Ren, Jennifer Faj, Ivy Peng

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia H100, Performance, Quantum computing

July 14, 2024 by hgpu

Automating Heterogeneous Parallelism in Numerical Differential Equations

Utkarsh

View

Download (PDF)

Source codes

Tags: AMD RX Vega 64, ATI, Computer science, CUDA, Differential equations, Factorization, Heterogeneous systems, Intel, Intel Arc A770, Julia, Numerical Analysis, nVidia, nVidia Quadro RTX 5000, Package, Tesla V100, Thesis

July 14, 2024 by hgpu

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

Hani Khader

View

Download (PDF)

Tags: AMD Radeon RX 6800, ATI, Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, OpenCL, Security, Thesis

July 14, 2024 by hgpu

PSCToolkit: solving sparse linear systems with a large number of GPUs

Pasqua D'Ambra, Fabio Durastante, Salvatore Filippone

View

Download (PDF)

Source codes

Tags: CUDA, Linear Algebra, Mathematical Software, Mathematics, Numerical Analysis, nVidia, nVidia A100, Package, Sparse

July 7, 2024 by hgpu

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, nVidia DGX-A100, Python

June 30, 2024 by hgpu

Adapting database components to heterogeneous environments

Dimitrios Koutsoukos

View

Download (PDF)

Tags: Computer science, CUDA, Databases, Heterogeneous systems, nVidia, nVidia P100, Thesis

June 30, 2024 by hgpu

A Survey of General-purpose Polyhedral Compilers

Arun Thangamani, Vincent Loechner, Stéphane Genaud

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Package, survey

June 30, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

VibeCodeHPC - Multi Agentic Vibe Coding for HPC

VibeCodeHPC: An Agent-Based Iterative Prompting Auto-Tuner for HPC Code Generation Using LLMs

Compile-Time Resource Safety for GPU APIs: A Low-Overhead Typestate Framework

Towards Robust Agentic CUDA Kernel Benchmarking, Verification, and Optimization

HPC Benchmark Survey

An HPC Benchmark Survey and Taxonomy for Characterization

HDM: Home made Diffusion Models

Home-made Diffusion Model from Scratch to Hatch

General Matrix Multiplication (GEMM)

High Performance Matrix Multiplication

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

RBMD: A molecular dynamics package enabling to simulate 10 million all-atom particles in a single graphics processing unit

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Automating Heterogeneous Parallelism in Numerical Differential Equations

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

PSCToolkit: solving sparse linear systems with a large number of GPUs

Composing Distributed Computations Through Task and Kernel Fusion

Adapting database components to heterogeneous environments

A Survey of General-purpose Polyhedral Compilers

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Recent source codes

VibeCodeHPC - Multi Agentic Vibe Coding for HPC

Compile-Time Resource Safety for GPU APIs: A Low-Overhead Typestate Framework

exa-AMD: Exascale Accelerated Materials Discovery

TRUST: a thermalhydraulic software package for CFD simulations

Modular: The Modular Platform (includes MAX & Mojo)

Allo: Accelerator Design Language

Towards Robust Agentic CUDA Kernel Benchmarking, Verification, and Optimization

HPC Benchmark Survey

HDM: Home made Diffusion Models

General Matrix Multiplication (GEMM)

Most viewed papers (last 30 days)