high performance computing on graphics processing units: hgpu.org

Krishna Teja Chitty-Venkata, Siddhisanket Raskar, Bharat Kale, Farah Ferdaus, Aditya Tanikanti, Ken Raffenetti, Valerie Taylor, Murali Emani, Venkatram Vishwanath

View

Download (PDF)

Source codes

Tags: AI, AMD Radeon Instinct MI250, AMD Radeon Instinct MI300X, Artificial intelligence, ATI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia GH200, nVidia H100, OpenCL, Performance

November 10, 2024 by hgpu

Over-synchronization in GPU Programs

Ajay Nayak, Arkaprava Basu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, Package, Performance, PTX

November 10, 2024 by hgpu

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Ferdi Kossmann, Bruce Fontaine, Daya Khudia, Michael Cafarella, Samuel Madden

View

Download (PDF)

Tags: Computer science, LLM, NLP, nVidia, nVidia A100, nVidia H100, Task scheduling

November 3, 2024 by hgpu

Accelerating Drug Discovery in AutoDock-GPU with Tensor Cores

Gabin Schieffer, Ivy Peng

View

Download (PDF)

Tags: Chemistry, Computer science, CUDA, Macromolecule, molecular docking, nVidia, nVidia A100, nVidia V100, Physics, Tesla T4

October 20, 2024 by hgpu

Optimized Code Generation for Parallel and Polyhedral Loop Nests using MLIR

Arun Thangamani

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Code generation, Computer science, CUDA, Heterogeneous systems, nVidia, nVidia A100, OpenCL, Thesis

October 13, 2024 by hgpu

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach

PyOMP: Parallel programming for CPUs and GPUs with OpenMP and Python

A Distributed-memory Tridiagonal Solver Based on a Specialised Data Structure Optimised for CPU and GPU Architectures

gpuPairHMM: High-speed Pair-HMM Forward Algorithm for DNA Variant Calling on GPUs

Performance portability via C++ PSTL, SYCL, OpenMP, and HIP: the Gaia AVU-GSR case study

Kokkidio: Fast, expressive, portable code, based on Kokkos and Eigen

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

Over-synchronization in GPU Programs

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Accelerating Drug Discovery in AutoDock-GPU with Tensor Cores

Optimized Code Generation for Parallel and Polyhedral Loop Nests using MLIR

Recent source codes

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

Most viewed papers (last 30 days)