high performance computing on graphics processing units: hgpu.org

Ka Hei Martin Kwok, Matti Kortelainen, Giuseppe Cerati, Alexei Strelchenko, Oliver Gutsche, Allison Reinsvold Hall, Steve Lantz, Michael Reid, Daniel Riley, Sophie Berkman, Seyong Lee, Hammad Ather, Boyana Norris, Cong Wang

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, HEP, Intel, Intel Arc A770, nVidia, nVidia A100, nVidia V100, OpenMP, performance portability, Physics, SYCL

January 28, 2024 by hgpu

BANG: Billion-Scale Approximate Nearest Neighbor Search using a Single GPU

Karthik V., Saim Khan, Somesh Singh, Harsha Vardhan Simhadri, Jyothi Vedurada

View

Download (PDF)

Tags: Computer science, CUDA, Nearest neighbour, nVidia, nVidia A100

January 28, 2024 by hgpu

MATLAB Tensor Core models

Accurate Models of NVIDIA Tensor Cores

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

An MLIR pipeline for offloading Fortran to FPGAs via OpenMP

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Training DNN Models over Heterogeneous Clusters with Optimal Performance

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Evaluating the Wide Area Classroom After 24,000 HPC Students

Deductive verification for SYCL

Gallatin: A General-Purpose GPU Memory Manager

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Towards a GPU-Parallelization of the neXtSIM-DG Dynamical Core

High-order thread-safe lattice Boltzmann model for HPC turbulent flow simulations

Assessing the Impact of Compiler Optimizations on GPUs Reliability

Lessons Learned Migrating CUDA to SYCL: A HEP Case Study with ROOT RDataFrame

Application of performance portability solutions for GPUs and many-core CPUs to track reconstruction kernels