high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Jinfan Chen, Shigang Li, Ran Gun, Jinhui Yuan, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia A100, Package, Tesla P100

January 22, 2023 by hgpu

Understanding the Impact of Input Entropy on FPU, CPU, and GPU Power

Sridutt Bhalachandra, Brian Austin, Samuel Williams, Nicholas J. Wright

View

Download (PDF)

Source codes

Tags: Computer science, Hardware Architecture, nVidia, nVidia A100, Package, Performance

December 25, 2022 by hgpu

GPU Load Balancing

Muhammad Osama

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, load balancing, Matrix multiplication, nVidia, nVidia A100, Package, Sparse, Thesis

December 25, 2022 by hgpu

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

René Caspart, Sebastian Ziegler, Arvid Weyrauch, Holger Obermaier, Simon Raffeiner, Leon Pascal Schuhmacher, Jan Scholtyssek, Darya Trofimova, Marco Nolden, Ines Reinartz, Fabian Isensee, Markus Götz, Charlotte Debus

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Package

December 11, 2022 by hgpu

SciAI4Industry – Solving PDEs for industry-scale problems with deep learning

Philipp A. Witte, Russell J. Hewett, Kumar Saurabh, AmirHossein Sojoodi, Ranveer Chandra

View

Download (PDF)

Tags: AI, Cloud, Computational Physics, Computer science, Deep learning, Differential equations, Neural networks, nVidia, nVidia A100, nVidia DGX-A100, Partial differential equations, PDEs

November 27, 2022 by hgpu

Capturing the Memory Topology of GPUs

Dominik Größler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce 840 M, nVidia GeForce RTX 2080 Ti, nVidia Quadro P 6000, Package, Performance, PTX, Tesla K20, Tesla V100, Thesis

November 13, 2022 by hgpu

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

Guyue Huang, Yang Bai, Liu Liu, Yuke Wang, Bei Yu, Yufei Ding, Yuan Xie

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100

November 6, 2022 by hgpu

Apple Silicon Performance in Scientific Computing

Connor Kenyon, Collin Capano

View

Download (PDF)

Tags: Benchmarking, Computer science, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, OpenCL, Performance

November 6, 2022 by hgpu

Benchmarking GPU and TPU Performance with Graph Neural Networks

Xiangyang Ju, Yunsong Wang, Daniel Murnane, Nicholas Choma, Steven Farrell, Paolo Calafiura

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia A100, Pattern recognition, Tesla V100, TPU

October 30, 2022 by hgpu

Providing performance portable numerics for Intel GPUs

Yu-Hsiang M. Tsai, Terry Cojean, Hartwig Anzt

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, Linear Algebra, nVidia, nVidia A100, OpenCL, Package, performance portability, Sparse, SYCL

October 30, 2022 by hgpu

From Task-Based GPU Work Aggregation to Stellar Mergers: Turning Fine-Grained CPU Tasks into Portable GPU Kernels

Gregor Daiß, Patrick Diehl, Dominic Marcello, Alireza Kheirkhahan, Hartmut Kaiser, Dirk Pflüger

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, Astrophysics, ATI, CUDA, HIP, nVidia, nVidia A100, Package, performance portability, Physics

October 23, 2022 by hgpu

Benchmarking optimization algorithms for auto-tuning GPU kernels

Richard Schoonhoven, Ben van Werkhoven, Kees Joost Batenburg

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Auto-Tuning, Benchmarking, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce GTX 1080 Ti, nVidia GeForce GTX Titan X, nVidia Titan RTX, OpenCL, Performance, pyCUDA, PyOpenCL, Tesla K20, Tesla P100, Tesla V100

October 9, 2022 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Understanding the Impact of Input Entropy on FPU, CPU, and GPU Power

GPU Load Balancing

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

Capturing the Memory Topology of GPUs

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

Apple Silicon Performance in Scientific Computing

Benchmarking GPU and TPU Performance with Graph Neural Networks

Providing performance portable numerics for Intel GPUs

From Task-Based GPU Work Aggregation to Stellar Mergers: Turning Fine-Grained CPU Tasks into Portable GPU Kernels

Benchmarking optimization algorithms for auto-tuning GPU kernels

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)