high performance computing on graphics processing units: hgpu.org

Ka Hei Martin Kwok, Matti Kortelainen, Giuseppe Cerati, Alexei Strelchenko, Oliver Gutsche, Allison Reinsvold Hall, Steve Lantz, Michael Reid, Daniel Riley, Sophie Berkman, Seyong Lee, Hammad Ather, Boyana Norris, Cong Wang

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, HEP, Intel, Intel Arc A770, nVidia, nVidia A100, nVidia V100, OpenMP, performance portability, Physics, SYCL

January 28, 2024 by hgpu

A Survey on Hardware Accelerators for Large Language Models

Christoforos Kachris

View

Download (PDF)

Tags: Computer science, Energy-efficient computing, FPGA, Hardware Architecture, NLP, survey

January 21, 2024 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Gallatin: A General-Purpose GPU Memory Manager

Deductive verification for SYCL

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

High-order thread-safe lattice Boltzmann model for HPC turbulent flow simulations

Assessing the Impact of Compiler Optimizations on GPUs Reliability

BANG: Billion-Scale Approximate Nearest Neighbor Search using a Single GPU

A Heterogeneous Inference Framework for a Deep Neural Network

Lessons Learned Migrating CUDA to SYCL: A HEP Case Study with ROOT RDataFrame

Application of performance portability solutions for GPUs and many-core CPUs to track reconstruction kernels