high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Managing Multi Instance GPUs for High Throughput and Energy Savings

Abhijeet Saraha, Yuanbo Li, Chris Porter, Santosh Pande

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, LLM, nVidia, nVidia A100, PyTorch, Security

September 7, 2025 by hgpu

Profiling Concurrent Vision Inference Workloads on NVIDIA Jetson – Extended

Abhinaba Chakraborty, Wouter Tavernier, Akis Kourtis, Mario Pickavet, Andreas Oikonomakis, Didier Colle

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia Jetson Nano, nVidia Jetson Orin Nano, Performance

August 24, 2025 by hgpu

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Jiarong Xing, Yifan Qiao, Simon Mo, Xingqi Cui, Gur-Eyal Sela, Yang Zhou, Joseph Gonzalez, Ion Stoica

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Performance, PyTorch

August 24, 2025 by hgpu

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Ryan R. Curtin, Marcus Edel, Conrad Sanderson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, nVidia, nVidia GeForce RTX 2080 Ti, OpenCL, Package, Programming techniques

August 24, 2025 by hgpu

Fuzz4cuda: Fuzzing Your Nvidia Gpu Libraries Through Debug Interface

Yuhao Zhou, Peng Jia, Jiayong Liu, Ximing Fan

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia RTX A6000, PTX, Security

August 24, 2025 by hgpu

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

Oscar Amoros, Albert Andaluz, Johnny Nunez, Antonio J. Pena

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, Package, Performance

August 17, 2025 by hgpu

Performant Unified GPU Kernels for Portable Singular Value Computation Across Hardware and Precision

Evelyne Ringoot, Rabab Alomairy, Valentin Churavy, Alan Edelman

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, Apple M1 Pro, ATI, Computer science, HIP, Intel, Intel Ponte Vecchio Max 1100, Kokkos, Linear Algebra, Machine learning, nVidia, nVidia A100, nVidia GeForce RTX 4060, nVidia H100, OpenCL, SYCL

August 17, 2025 by hgpu

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Chris S. Lin, Joyce Qu, Gururaj Saileshwar

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia RTX A6000, Package, Security

August 17, 2025 by hgpu

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

Wei Da, Evangelia Kalyvianaki

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, LLM, nVidia, nVidia A30, Package, Task scheduling

August 17, 2025 by hgpu

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

Antonio De Caro, Gennaro Cordasco, Federico Ficarelli, Biagio Cosenza

View

Download (PDF)

Source codes

Tags: Biology, Chemistry, Computer science, CUDA, MPI, nVidia, nVidia V100, oneAPI, Package

August 10, 2025 by hgpu

ConTraPh: Contrastive Learning for Parallelization and Performance Optimization

Quazi Ishtiaque Mahmud, Ali TehraniJamsaz, Nesreen K. Ahmed, Theodore L. Willke, Ali Jannesari

View

Download (PDF)

Tags: Code generation, Computer science, Heterogeneous systems, HPC, LLM, nVidia, OpenACC, OpenCL, OpenMP, Tesla V100

August 10, 2025 by hgpu

OpenDwarfs 2025: Modernizing the OpenDwarfs Benchmark Suite for Heterogeneous Computing

Juan José Ropero, Manuel de Castro, Diego R. Llanos

View

Download (PDF)

Source codes

Tags: AMD FirePro W7800, ATI, Benchmarking, Computer science, Heterogeneous systems, nVidia, nVidia RTX 4500 Ada, OpenCL, Package

August 3, 2025 by hgpu

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

BioAgent Bench: An AI Agent Evaluation Suite for Bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)

Awesome LLM-Driven Kernel Generation

Towards Automated Kernel Generation in the Era of LLMs

PhysProver: Advancing Automatic Theorem Proving for Physics

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Tilus: A Tile-Level GPGPU Programming Language for Low-Precision Computation

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Managing Multi Instance GPUs for High Throughput and Energy Savings

Profiling Concurrent Vision Inference Workloads on NVIDIA Jetson – Extended

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Fuzz4cuda: Fuzzing Your Nvidia Gpu Libraries Through Debug Interface

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

Performant Unified GPU Kernels for Portable Singular Value Computation Across Hardware and Precision

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

ConTraPh: Contrastive Learning for Parallelization and Performance Optimization

OpenDwarfs 2025: Modernizing the OpenDwarfs Benchmark Suite for Heterogeneous Computing

Recent source codes

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Awesome LLM-Driven Kernel Generation

PhysProver: Advancing Automatic Theorem Proving for Physics

ParaCodex: A Profiling-Guided Autonomous Coding Agent for Reliable Parallel Code Generation and Translation

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

Most viewed papers (last 30 days)