high performance computing on graphics processing units: hgpu.org

hgpu.org » AMD Radeon Instinct MI300X

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale, Farah Ferdaus, Aditya Tanikanti, Ken Raffenetti, Valerie Taylor, Murali Emani, Venkatram Vishwanath

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, ATI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenCL, Performance

November 10, 2024 by hgpu

LLOR: Automatic Repair of OpenMP Programs

LLOR: Automated Repair of OpenMP Programs

Solomon: Simple Off-LOading Macros Orchestrating multiple Notations

Unified schemes for directive-based GPU offloading

CLUEstering: a high-performance density-based clustering library for scientific computing

* * *

high performance computing on graphics processing units: hgpu.org

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Recent source codes

LLOR: Automatic Repair of OpenMP Programs

Solomon: Simple Off-LOading Macros Orchestrating multiple Notations

CLUEstering: a high-performance density-based clustering library for scientific computing

PyOMP: OpenMP for Python in Numba

GPPerf: Energy-Aware GPU Performance Prediction and Optimization Framework

HiRep

gpuPairHMM: Ultra-fast GPU-based PairHMM for DNA Variant Calling

Gaia AVU-GSR

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

Most viewed papers (last 30 days)