high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Shiwei Zhang, Lansong Diao, Chuan Wu, Zongyan Cao, Siyu Wang, Wei Lin

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia A100, nVidia P100, nVidia V100, Package, PyTorch

January 14, 2024 by hgpu

Orion: Interference-aware, Fine-grained GPU Sharing for ML Applications

Foteini Strati, Xianzhe Ma, Ana Klimovic

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

January 14, 2024 by hgpu

Gaiwan: a Size-Polymorphic Typesystem for GPU Programs

Robbert Gurdeep Singha, Christophe Scholliers

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, nVidia, nVidia A100, OpenCL, Package, Programming Languages

December 31, 2023 by hgpu

Optimization of Ported CFD Kernels on Intel Data Center GPU Max 1550 using oneAPI ESIMD

Mohammad Zubair, Aaron Walden, Gabriel Nastac, Eric Nielsen, Christoph Bauinger, Xiao Zhu

View

Download (PDF)

Tags: cfd, CUDA, Fluid dynamics, Intel, Intel Data Center GPU Max 1550, nVidia, nVidia A100, oneAPI, Performance, SYCL

December 31, 2023 by hgpu

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Aristotle Martin, Geng Liu, William Ladd, Seyong Lee, John Gounley, Jeffrey Vetter, Saumil Patel, Silvio Rizzi, Victor Mateevitsi, Joseph Insley, Amanda Randles

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, cfd, CUDA, Fluid dynamics, Heterogeneous systems, HIP, nVidia, nVidia A100, nVidia V100, performance portability, SYCL

December 31, 2023 by hgpu

Enabling Quantum Computer Simulations on AMD GPUs: a HIP Backend for Google’s qsim

Stefano Markidis

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, Computer science, CUDA, HIP, nVidia, nVidia A100, Quantum computing

December 31, 2023 by hgpu

KeSCo: Compiler-based Kernel Scheduling for Multi-task GPU Applications

Zejia Lin, Zewei Mo, Xuanteng Huang, Xianwei Zhang, Yutong Lu

View

Download (PDF)

Tags: Benchmarking, Compilers, Computer science, CUDA, nVidia, nVidia A100, Task scheduling

December 24, 2023 by hgpu

Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models

Xin Jin, Jonathan Larson, Weiwei Yang, Zhiqiang Lin

View

Download (PDF)

Tags: Benchmarking, Computer science, nVidia, nVidia A100, Software Engineering

December 24, 2023 by hgpu

cuSZ-I: High-Fidelity Error-Bounded Lossy Compression for Scientific Data on GPUs

Jinyang Liu, Jiannan Tian, Shixun Wu, Sheng Di, Boyuan Zhang, Yafan Huang, Kai Zhao, Guanpeng Li, Dingwen Tao, Zizhong Chen, Franck Cappello

View

Download (PDF)

Tags: Compression, Computer science, CUDA, nVidia, nVidia A100, nVidia A40

December 18, 2023 by hgpu

Efficiently Processing Large Relational Joins on GPUs

Bowen Wu, Dimitrios Koutsoukos, Gustavo Alonso

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Databases, nVidia, nVidia A100, nVidia GeForce RTX 3090, Package

December 10, 2023 by hgpu

GenVectorX: A performance-portable SYCL library for Lorentz Vectors operations

Monica Dessole, Jolly Chen, Axel Naumann

View

Download (PDF)

Source codes

Tags: CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3060, nVidia L4, oneAPI, Package, Performance, Physics, SYCL

December 10, 2023 by hgpu

FIKIT: Priority-Based Real-time GPU Multi-tasking Scheduling with Kernel Identification

Wenqing Wu

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, nVidia GeForce RTX 4080 Ti, nVidia H100, Task scheduling

November 27, 2023 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis

Orion: Interference-aware, Fine-grained GPU Sharing for ML Applications

Gaiwan: a Size-Polymorphic Typesystem for GPU Programs

Optimization of Ported CFD Kernels on Intel Data Center GPU Max 1550 using oneAPI ESIMD

Performance Evaluation of Heterogeneous GPU Programming Frameworks for Hemodynamic Simulations

Enabling Quantum Computer Simulations on AMD GPUs: a HIP Backend for Google’s qsim

KeSCo: Compiler-based Kernel Scheduling for Multi-task GPU Applications

Binary Code Summarization: Benchmarking ChatGPT/GPT-4 and Other Large Language Models

cuSZ-I: High-Fidelity Error-Bounded Lossy Compression for Scientific Data on GPUs

Efficiently Processing Large Relational Joins on GPUs

GenVectorX: A performance-portable SYCL library for Lorentz Vectors operations

FIKIT: Priority-Based Real-time GPU Multi-tasking Scheduling with Kernel Identification

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)