high performance computing on graphics processing units: hgpu.org

Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale, Farah Ferdaus, Aditya Tanikanti, Ken Raffenetti, Valerie Taylor, Murali Emani, Venkatram Vishwanath

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, ATI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenCL, Performance

November 10, 2024 by hgpu

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, Minlan Yu

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, LLM, Memory, nVidia, nVidia A10, nVidia H100, Tesla T4

November 10, 2024 by hgpu

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Ferdi Kossmann, Bruce Fontaine, Daya Khudia, Michael Cafarella, Samuel Madden

View

Download (PDF)

Tags: Computer science, LLM, NLP, nVidia, nVidia A100, nVidia H100, Task scheduling

November 3, 2024 by hgpu

Fastrack: Fast IO for Secure ML using GPU TEEs

Yongqin Wang, Rachit Rajat, Jonghyun Lee, Tingting Tang, Murali Annavaram

View

Download (PDF)

Tags: Cloud, Computer science, CUDA, Machine learning, nVidia, nVidia H100, Security

October 27, 2024 by hgpu

Benchmarking Thread Block Cluster

Tim Lühnen, Tobias Marschner, Sohan Lal

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia H100, PTX

October 6, 2024 by hgpu

Optimal Workload Placement on Multi-Instance GPUs

Bekir Turkkan, Pavankumar Murali, Pavithra Harsha, Rohan Arora, Gerard Vanloo, Chandra Narayanaswami

View

Download (PDF)

Tags: Benchmarking, Computer science, nVidia, nVidia A100, nVidia H100, Performance

September 15, 2024 by hgpu

high performance computing on graphics processing units: hgpu.org

Unified schemes for directive-based GPU offloading

Scaling SU(2) to 1000 GPUs using HiRep

A Distributed-memory Tridiagonal Solver Based on a Specialised Data Structure Optimised for CPU and GPU Architectures

gpuPairHMM: High-speed Pair-HMM Forward Algorithm for DNA Variant Calling on GPUs

Performance portability via C++ PSTL, SYCL, OpenMP, and HIP: the Gaia AVU-GSR case study

Context Parallelism for Scalable Million-Token Inference

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Benchmarking Thread Block Cluster

Optimal Workload Placement on Multi-Instance GPUs

Recent source codes

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

LC Framework

pplx-garden: Perplexity open source garden for inference technology

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

OpScanner

INT v.s. FP: A framework to compare low-bit integer and float-point formats

AutoDock-GPU: AutoDock for GPUs and other accelerators

NCCLX: collective communication framework

Tutoring LLM into a Better CUDA Optimizer

Most viewed papers (last 30 days)