high performance computing on graphics processing units: hgpu.org

Laksono Adhianto, Jonathon Anderson, Robert Matthew Barnett, Dragana Grbic, Vladimir Indic, Mark Krentel, Yumeng Liu, Srdan Milakovíc, Wileam Phan, John Mellor-Crumme

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI300A, ATI, Computer science, CUDA, HPC, MPI, OpenCL, Package, Performance

September 15, 2024 by hgpu

VitBit: Enhancing Embedded GPU Performance for AI Workloads through Register Operand Packing

Jaebeom Jeon, Minseong Gil, Junsu Kim, Jaeyong Park, Gunjae Koo, Myung Kuk Yoon, Yunho Oh

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia Jetson AGX Orin, Performance

September 1, 2024 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Data-Driven Dynamic Autotuning: Optimizing Autotuning Overhead with Prior Tuning Data

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Using modern C++ to improve CUDA programs

Sound and Partially-Complete Static Analysis of Data-Races in GPU Programs

Effects of OpenCL-Based Parallelization Methods on Explicit Numerical Methods to Solve the Heat Equation

Understanding Data Movement in AMD Multi-GPU Systems with Infinity Fabric

Event-Based OpenMP Tasks for Time-Sensitive GPU-Accelerated Systems

The Landscape of GPU-Centric Communication

A Study of Performance Programming of CPU, GPU accelerated Computers and SIMD Architecture

Optimal Workload Placement on Multi-Instance GPUs

Refining HPCToolkit for application performance analysis at exascale