high performance computing on graphics processing units: hgpu.org

Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale, Farah Ferdaus, Aditya Tanikanti, Ken Raffenetti, Valerie Taylor, Murali Emani, Venkatram Vishwanath

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, ATI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenCL, Performance

November 10, 2024 by hgpu

On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures

Nathaniel Morgan, Caleb Yenusah, Adrian Diaz, Daniel Dunning,Jacob Moore,Erin Heilman, Calvin Roth, Evan Lieberman, Steven Walton, Sarah Brown, Daniel Holladay, Marko Knezevic, Gavin Whetstone, Zachary Baker, Robert Robey

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Fortran, HIP, nVidia, Package, performance portability, Pthreads

November 10, 2024 by hgpu

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

Pascal Jahan Elahi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, MPI, nVidia, nVidia GH200, OpenMP, Package, Performance

November 10, 2024 by hgpu

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Xuanlin Jiang, Yang Zhou, Shiyi Cao, Ion Stoica, Minlan Yu

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, LLM, Memory, nVidia, nVidia A10, nVidia H100, Tesla T4

November 10, 2024 by hgpu

high performance computing on graphics processing units: hgpu.org

CLUEstering: a high-performance density-based clustering library for scientific computing

Scaling SU(2) to 1000 GPUs using HiRep

Understanding GEMM Performance and Energy on NVIDIA Ada Lovelace: A Machine Learning-Based Analytical Approach

A Distributed-memory Tridiagonal Solver Based on a Specialised Data Structure Optimised for CPU and GPU Architectures

gpuPairHMM: High-speed Pair-HMM Forward Algorithm for DNA Variant Calling on GPUs

Performance portability via C++ PSTL, SYCL, OpenMP, and HIP: the Gaia AVU-GSR case study

GPUVM: GPU-driven Unified Virtual Memory

Over-synchronization in GPU Programs

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference

Recent source codes

CLUEstering: a high-performance density-based clustering library for scientific computing

PyOMP: OpenMP for Python in Numba

HiRep

GPPerf: Energy-Aware GPU Performance Prediction and Optimization Framework

gpuPairHMM: Ultra-fast GPU-based PairHMM for DNA Variant Calling

Gaia AVU-GSR

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

Most viewed papers (last 30 days)