high performance computing on graphics processing units: hgpu.org

Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale, Farah Ferdaus, Aditya Tanikanti, Ken Raffenetti, Valerie Taylor, Murali Emani, Venkatram Vishwanath

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, ATI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenCL, Performance

November 10, 2024 by hgpu

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

Pascal Jahan Elahi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, MPI, nVidia, nVidia GH200, OpenMP, Package, Performance

November 10, 2024 by hgpu

LLload: An Easy-to-Use HPC Utilization Tool

Chansup Byun, Albert Reuther, Julie Mullen, LaToya Anderson, William Arcand, Bill Bergeron, David Bestor, Alexander Bonn, Daniel Burrill, Vijay Gadepally, Michael Houle, Matthew Hubbell, Hayden Jananthan, Michael Jones, Piotr Luszczek, Peter Michaleas, Lauren Milechin, Guillermo Morales, Andrew Prout, Antonio Rosa, Charles Yee, Jeremy Kepner

View

Download (PDF)

Tags: Computer science, CUDA, HPC, nVidia, Performance

November 3, 2024 by hgpu

Scheduling Languages: A Past, Present, and Future Taxonomy

Mary Hall, Cosmin Oancea, Anne C. Elster, Ari Rasch, Sameeran Joshi, Amir Mohammad Tavakkoli, Richard Schulze

View

Download (PDF)

Tags: Auto-Tuning, Compilers, Computer science, Performance, Programming Languages, Task scheduling

November 3, 2024 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach

Hardware Accelerators for Artificial Intelligence

Understanding GEMM Performance and Energy on NVIDIA Ada Lovelace: A Machine Learning-Based Analytical Approach

Performance portability via C++ PSTL, SYCL, OpenMP, and HIP: the Gaia AVU-GSR case study

GPUVM: GPU-driven Unified Virtual Memory

Context Parallelism for Scalable Million-Token Inference

The Rewriting of DataRaceBench Benchmark for OpenCL Program Validations

Over-synchronization in GPU Programs

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

LLload: An Easy-to-Use HPC Utilization Tool

Scheduling Languages: A Past, Present, and Future Taxonomy

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)