high performance computing on graphics processing units: hgpu.org

hgpu.org » Performance

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer, Jacob Wahlgren, Jie Ren, Jennifer Faj, Ivy Peng

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia H100, Performance, Quantum computing

July 14, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Johannes Pekkilä, Oskar Lappi, Fredrik Robertsén, Maarit J. Korpi-Lagg

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Energy-efficient computing, HIP, nVidia, nVidia A100, nVidia V100, Package, Performance, PyTorch, Stencil computation

June 16, 2024 by hgpu

Understanding GPU Triggering APIs for MPI+X Communication

Patrick G. Bridges, Anthony Skjellum, Evan D. Suggs, Derek Schafer, Purushotham V. Bangalore

View

Download (PDF)

Tags: Computer science, HPC, MPI, Performance

June 16, 2024 by hgpu

A methodology for comparing optimization algorithms for auto-tuning

Floris-Jan Willemsen, Richard Schoonhoven, Jiří Filipovič, Jacob O. Tørring, Rob van Nieuwpoort, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, Package, Performance

June 16, 2024 by hgpu

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

L.A. Torres, Carlos J. Barrios H, Yves Denneulin

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia A100, Package, Performance, SYCL

June 2, 2024 by hgpu

Enabling full-speed random access to the entire memory on the A100 GPU

Alden Walker

View

Download (PDF)

Tags: Computer science, nVidia, nVidia A100, Performance, PTX

May 26, 2024 by hgpu

GPU Implementations for Midsize Integer Addition and Multiplication

Cosmin E. Oancea, Stephen M. Watt

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia A100, Performance, Programming Languages

May 26, 2024 by hgpu

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

Ruixin Wang, Minghai Lu, Cody Hao Yu, Yi-Hsiang Lai, Tianyi Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, DSL, nVidia, Package, Performance, PyTorch, Tesla T4

May 12, 2024 by hgpu

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

Eishi Arima, Minjoon Kang, Issa Saba, Josef Weidendorfer, Carsten Trinitis, Martin Schulz

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, Performance

May 12, 2024 by hgpu

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Andrey Alekseenko, Szilárd Páll, Erik Lindahl

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, Biomolecules, Computational Physics, Computer science, Heterogeneous systems, Molecular dynamics, Molecular simulation, Performance, SYCL

May 5, 2024 by hgpu

GPUODEBenchmarks: Comparsion of Julia's GPU Kernel based ODE solvers with other open-source GPU ODE solvers

Automating Heterogeneous Parallelism in Numerical Differential Equations

Dat3M: Memory Model Aware Verification

Towards Unified Analysis of GPU Consistency

NVIDIA Federated Learning Application Runtime Environment

Supercharging Federated Learning with Flower and NVIDIA FLARE

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

PSCToolkit: solving sparse linear systems with a large number of GPUs

CATBench: Benchmarking Framework

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

General-purpose Polyhedral Compilers

A Survey of General-purpose Polyhedral Compilers

Optimal Kernel Orchestration for Tensor Programs with Korch

Astaroth: A Scalable Multi-GPU Library for Stencil Computations

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Understanding GPU Triggering APIs for MPI+X Communication

A methodology for comparing optimization algorithms for auto-tuning

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

Enabling full-speed random access to the entire memory on the A100 GPU

GPU Implementations for Midsize Integer Addition and Multiplication

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Recent source codes

GPUODEBenchmarks: Comparsion of Julia's GPU Kernel based ODE solvers with other open-source GPU ODE solvers

Dat3M: Memory Model Aware Verification

NVIDIA Federated Learning Application Runtime Environment

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

PSCToolkit: solving sparse linear systems with a large number of GPUs

CATBench: Benchmarking Framework

General-purpose Polyhedral Compilers

Optimal Kernel Orchestration for Tensor Programs with Korch

Astaroth: A Scalable Multi-GPU Library for Stencil Computations

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking

Most viewed papers (last 30 days)