high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

Retargeting and Respecializing GPU Workloads for Performance Portability

Ivan R. Ivanov, Oleksandr Zinenko, Jens Domke, Toshio Endo, William S. Moses

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, AMD Radeon RX 6800, ATI, Computer science, CUDA, HIP, HPC, nVidia, nVidia A100, nVidia RTX A4000, Package, performance portability

March 24, 2024 by hgpu

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

John Tramm, Paul Romano, Patrick Shriwise, Amanda Lund, Johannes Doerfert, Patrick Steinbrecher, Andrew Siegel, Gavin Ridley

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Intel, Intel Data Center GPU Max 1550, Intel Ponte Vecchio Max 1100, nVidia, nVidia A100, OpenMP, Package, performance portability

March 24, 2024 by hgpu

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality

Adrian Perez Dieguez, Min Choi, Mahmut Okyay, Mauro Del Ben, Bryan M. Wong, Khaled Z. Ibrahim

View

Download (PDF)

Tags: Computer science, CUDA, HPC, MPI, nVidia, nVidia A100, OpenMP, Performance

March 18, 2024 by hgpu

Fast Truncated SVD of Sparse and Dense Matrices on Graphics Processors

Andres E. Tomas, Enrique S. Quintana-Orti, Hartwig Anzt

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Linear Algebra, nVidia, nVidia A100

March 18, 2024 by hgpu

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Xinyi Li, Ang Li, Bo Fang, Katarzyna Swirydowicz, Ignacio Laguna, Ganesh Gopalakrishnan

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, Hardware Architecture, HPC, Matrix multiplication, nVidia, nVidia A100, nVidia H100, nVidia V100, PTX

March 10, 2024 by hgpu

Hybrid quantum programming with PennyLane Lightning on HPC platforms

Ali Asadi, Amintor Dusko, Chae-Yeun Park, Vincent Michaud-Rioux, Isidor Schoch, Shuli Shu, Trevor Vincent, Lee James O'Riordan

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, HPC, nVidia, nVidia A100, OpenMP, Package, Physics, Quantum Physics

March 10, 2024 by hgpu

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Dan Zhao, Siddharth Samsi, Joseph McDonald, Baolin Li, David Bestor, Michael Jones, Devesh Tiwari, Vijay Gadepally

View

Download (PDF)

Tags: AI, Computer science, Energy-efficient computing, HPC, nVidia, nVidia A100

March 3, 2024 by hgpu

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

February 25, 2024 by hgpu

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Taesu Kim, Jongho Lee, Daehyun Ahn, Sarang Kim, Jiwoong Choi, Minkyu Kim, Hyungjun Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, Mixed precision, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia RTX A6000, Package

February 18, 2024 by hgpu

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Y. Wu, Y.K. Li, Fuli Luo, Yingfei Xiong, Wenfeng Liang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, nVidia, nVidia A100, Package

February 12, 2024 by hgpu

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Gianmarco Accordi, Davide Gadioli, Emanele Vitali, Luigi Crisci, Biagio Cosenza, Andrea Beccari, Gianluca Palermo

View

Download (PDF)

Tags: Computer science, CUDA, HPC, molecular docking, nVidia, nVidia A100, oneAPI, Performance, SYCL

February 12, 2024 by hgpu

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

Robert Jendersie, Christian Lessig, Thomas Richter

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Earth and Space Sciences, Finite element method, Numerical Analysis, nVidia, nVidia A100, nVidia GeForce RTX 3090, OpenMP, Package, PyTorch, SYCL

February 4, 2024 by hgpu

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

Exploring Scalability in C++ Parallel STL Implementations

* * *

high performance computing on graphics processing units: hgpu.org

Retargeting and Respecializing GPU Workloads for Performance Portability

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality

Fast Truncated SVD of Sparse and Dense Matrices on Graphics Processors

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Hybrid quantum programming with PennyLane Lightning on HPC platforms

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

Recent source codes

HPCToolkit

Open Catalog of Best Practices for Modernization and Optimization

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

GPU-Smash: Compression abstraction library

Noarr Structures

3D-fractal-generators

SyncPerformance

VerCors: a verification toolset for verifying parallel and concurrent software

HiCCL: A hierarchical collective communications library with portable optimizations

Most viewed papers (last 30 days)