high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia H100

Confidential Computing on Heterogeneous Systems: Survey and Implications

Qifan Wang, David Oswald

View

Download (PDF)

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, nVidia, nVidia H100, Review, Security

August 25, 2024 by hgpu

CI/CD Efforts for Validation, Verification and Benchmarking OpenMP Implementations

Aaron Jarmusch, Felipe Cabarcas, Swaroop Pophale, Andrew Kallai, Johannes Doerfert, Luke Peyralans, Seyong Lee, Joel Denny, Sunita Chandrasekaran

View

Download (PDF)

Tags: AMD Radeon Instinct MI210, AMD Radeon Instinct MI250X, ATI, Compilers, Computer science, Fortran, Heterogeneous systems, HPC, nVidia, nVidia H100, OpenMP

August 25, 2024 by hgpu

Portability of Fortran’s ‘do concurrent’ on GPUs

Ronald M. Caplan, Miko M. Stulajter, Jon A. Linker, Jeff Larkin, Henry A. Gabb, Shiquan Su, Ivan Rodriguez, Zachary Tschirhart, Nicholas Malaya

View

Download (PDF)

Source codes

Tags: Computer science, Fortran, Intel, Intel Data Center GPU Max 1550, Intel Ponte Vecchio Max 1100, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenACC, OpenMP, Package

August 18, 2024 by hgpu

Evaluating Operators in Deep Neural Networks for Improving Performance Portability of SYCL

Zheming Jin

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, HIP, Machine learning, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, nVidia H100, oneAPI, Performance, performance portability, SYCL, Tesla A100, Tesla V100

August 14, 2024 by hgpu

Data-driven Forecasting of Deep Learning Performance on GPUs

Seonho Lee, Amar Phanishayee, Divya Mahajan

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia H100, nVidia P100, nVidia V100, Performance, PyTorch, Tesla T4

August 4, 2024 by hgpu

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer, Jacob Wahlgren, Jie Ren, Jennifer Faj, Ivy Peng

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia H100, Performance, Quantum computing

July 14, 2024 by hgpu

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

Ali Doosthosseini, Jonathan Decker, Hendrik Nolte, Julian M. Kunkel

View

Download (PDF)

Source codes

Tags: AI, Cloud, Computer science, HPC, LLM, nVidia, nVidia H100, Package, PC cluster

July 7, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

How much can we gain from Tensor Kernel Fusion on GPUs?

Wei Sun, Ang Li, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, nVidia H100

June 16, 2024 by hgpu

Porting HPC Applications to AMD Instinct MI300A Using Unified Memory and OpenMP

Suyash Tandon, Leopold Grinberg, Gheorghe-Teodor Bercea, Carlo Bertolli, Mark Olesen, Simone Bnà, Nicholas Malaya

View

Download (PDF)

Tags: AMD Radeon Instinct MI210, AMD Radeon Instinct MI300A, ATI, cfd, Computer science, Fluid dynamics, HPC, nVidia, nVidia A100, nVidia H100, OpenMP

May 5, 2024 by hgpu

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

Junjie Li, Yinzhi Wang, Xiao Liang, Hang Liu

View

Download (PDF)

Tags: BLAS, Chemistry, CUDA, nVidia, nVidia GH200, nVidia H100, Performance, Physics

May 5, 2024 by hgpu

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Xinyi Li, Ang Li, Bo Fang, Katarzyna Swirydowicz, Ignacio Laguna, Ganesh Gopalakrishnan

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, Hardware Architecture, HPC, Matrix multiplication, nVidia, nVidia A100, nVidia H100, nVidia V100, PTX

March 10, 2024 by hgpu

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

PortLBM: A Portable Lattice Boltzmann Tool Leveraging SYCL on AMD, NVIDIA, and Intel GPUs

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Compiler-Grounded Hierarchical Diagnosis for LLM-Based Triton Kernel Optimization

NVIDIA Object Oriented Agents

NVIDIA-labs OO Agents: Native Python Object-Oriented Agents

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

CuFuzz: An API-Knowledge-Graph Coverage-Driven Fuzzing Framework for CUDA Libraries

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

Probe-and-Refine Tuning of Repository Guidance for AI Coding Agents

Probe-and-Refine Tuning of Repository Guidance for Coding Agents

CUDAnalyst (CUDA + Analyst)

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Confidential Computing on Heterogeneous Systems: Survey and Implications

CI/CD Efforts for Validation, Verification and Benchmarking OpenMP Implementations

Portability of Fortran’s ‘do concurrent’ on GPUs

Evaluating Operators in Deep Neural Networks for Improving Performance Portability of SYCL

Data-driven Forecasting of Deep Learning Performance on GPUs

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

How much can we gain from Tensor Kernel Fusion on GPUs?

Porting HPC Applications to AMD Instinct MI300A Using Unified Memory and OpenMP

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Recent source codes

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

NVIDIA Object Oriented Agents

UniCoder: Unified Visual-to-Code Generation via Symbolic Rewards and Reference-Guided Code Optimization

CuFuzz: An API-Knowledge-Graph Coverage-Driven Fuzzing Framework for CUDA Libraries

AutoPass: Evidence-Guided LLM Agents for Compiler Performance Tuning

Probe-and-Refine Tuning of Repository Guidance for AI Coding Agents

CUDAnalyst (CUDA + Analyst)

Most viewed papers (last 30 days)