high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs

Youhe Jiang, Fangcheng Fu, Xiaozhe Yao, Guoliang He, Xupeng Miao, Ana Klimovic, Bin Cui, Binhang Yuan, Eiko Yoneki

View

Download (PDF)

Source codes

Tags: Benchmarking, Cloud, Computer science, Heterogeneous systems, LLM, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia RTX A6000, Package

February 10, 2025 by hgpu

Towards autonomous resource management: Deep learning prediction of CPU-GPU load balancing

Inigo Gabirondo Lopez

View

Download (PDF)

Tags: AMD Radeon HD 7970, Artificial intelligence, ATI, Computer science, Deep learning, Heterogeneous systems, load balancing, nVidia, nVidia GeForce GTX 970, OpenCL

February 10, 2025 by hgpu

On the Partitioning of GPU Power among Multi-Instances

Tirth Vamja, Kaustabha Ray, Felix George, UmaMaheswari C Devi

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia V100, Performance

February 3, 2025 by hgpu

Fully-Automated Code Generation for Efficient Computation of Sparse Matrix Permanents on GPUs

Deniz Elbek, Kamer Kaya

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, nVidia, nVidia A100, nVidia Quadro GV100, PTX, Sparse matrix

February 3, 2025 by hgpu

CPU-GPU co-execution through the exploitation of hybrid technologies via SYCL

Nozal Raúl, Jose Luis Bosque

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Hybrid computing, LLVM, load balancing, nVidia, nVidia GeForce GT 1030, oneAPI, OpenCL, performance portability, SYCL

February 3, 2025 by hgpu

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Download (PDF)

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

Column-Oriented Datalog on the GPU

Yihao Sun, Sidharth Kumar, Thomas Gilray, Kristopher Micinski

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, nVidia, nVidia H100, Package

January 27, 2025 by hgpu

Adaptive Optimization Techniques for High-Performance Computing

Gulsum Gudukbay Akbulut

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, Machine learning, nVidia, Optimization, Performance, Tesla K80, Thesis

January 27, 2025 by hgpu

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Hongyuan Liu, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Hardware Architecture, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

January 27, 2025 by hgpu

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Naifeng Zhang, Franz Franchetti

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Linear Algebra, Modular arithmetic, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia V100, Package, Security

January 20, 2025 by hgpu

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Dinei A. Rockenbach, Gabriell Araujo, Dalvan Griebler, Luiz Gustavo Fernandes

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, nVidia, nVidia GeForce RTX 3090, OpenCL, OpenMP, Package

January 20, 2025 by hgpu

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

Csaba Tóth, Danilo Jr Dela Cruz, Harald Oberhauser

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A100, Package, Python

January 20, 2025 by hgpu

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

pyATF: The Auto-Tuning Framework (ATF) in Python

pyATF: Constraint-Based Auto-Tuning in Python

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Towards autonomous resource management: Deep learning prediction of CPU-GPU load balancing

On the Partitioning of GPU Power among Multi-Instances

Fully-Automated Code Generation for Efficient Computation of Sparse Matrix Permanents on GPUs

CPU-GPU co-execution through the exploitation of hybrid technologies via SYCL

Profiling Apple Silicon Performance for ML Training

Column-Oriented Datalog on the GPU

Adaptive Optimization Techniques for High-Performance Computing

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

Recent source codes

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

pyATF: The Auto-Tuning Framework (ATF) in Python

TritonBench: Benchmarking Large Language Model Capabilities for Generating Triton Operators

Most viewed papers (last 30 days)