high performance computing on graphics processing units: hgpu.org

hgpu.org » Computer science

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Heejun Lee, Geon Park, Jaduk Suh, Sung Ju Hwang

View

Download (PDF)

Source codes

Tags: Computer science, LLM, NLP, nVidia, nVidia GeForce RTX 4090, Package

February 16, 2025 by hgpu

Teaching An Old Dog New Tricks: Porting Legacy Code to Heterogeneous Compute Architectures With Automated Code Translation

Nicolas Nytko, Andrew Reisner, J. David Moulton, Luke N. Olson, Matthew West

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Fortran, Heterogeneous systems, MPI, nVidia, nVidia A100, OpenCL

February 16, 2025 by hgpu

Vortex: Overcoming Memory Capacity Limitations in GPU-Accelerated Large-Scale Data Analytics

Yichao Yuan, Advait Iyer, Lin Ma, Nishil Talati

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, Databases, HIP, nVidia, nVidia A40, Package

February 16, 2025 by hgpu

Optimizing the optimizer increasing performance efficiency of modern compilers

Hafsah Shahzad

View

Download (PDF)

Tags: Compilers, Computer science, FPGA, HLS, Intel, nVidia, nVidia GeForce RTX 4070, Thesis

February 10, 2025 by hgpu

Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs

Youhe Jiang, Fangcheng Fu, Xiaozhe Yao, Guoliang He, Xupeng Miao, Ana Klimovic, Bin Cui, Binhang Yuan, Eiko Yoneki

View

Download (PDF)

Source codes

Tags: Benchmarking, Cloud, Computer science, Heterogeneous systems, LLM, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia RTX A6000, Package

February 10, 2025 by hgpu

Compiler Support for Speculation in Decoupled Access/Execute Architectures

Robert Szafarczyk, Syed Waqar Nabi, Wim Vanderbauwhede

View

Download (PDF)

Tags: Compilers, Computer science, HLS, Performance, Prefetch

February 10, 2025 by hgpu

Towards autonomous resource management: Deep learning prediction of CPU-GPU load balancing

Inigo Gabirondo Lopez

View

Download (PDF)

Tags: AMD Radeon HD 7970, Artificial intelligence, ATI, Computer science, Deep learning, Heterogeneous systems, load balancing, nVidia, nVidia GeForce GTX 970, OpenCL

February 10, 2025 by hgpu

Ilargi: a GPU Compatible Factorized ML Model Training Framework

Wenbo Sun, Rihan Hai

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Linear Algebra, Machine learning, nVidia, nVidia A40, Package

February 10, 2025 by hgpu

Fully-Automated Code Generation for Efficient Computation of Sparse Matrix Permanents on GPUs

Deniz Elbek, Kamer Kaya

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, nVidia, nVidia A100, nVidia Quadro GV100, PTX, Sparse matrix

February 3, 2025 by hgpu

CPU-GPU co-execution through the exploitation of hybrid technologies via SYCL

Nozal Raúl, Jose Luis Bosque

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Hybrid computing, LLVM, load balancing, nVidia, nVidia GeForce GT 1030, oneAPI, OpenCL, performance portability, SYCL

February 3, 2025 by hgpu

Modernization and Optimization of MPI Codes

Tim Jammer

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, HPC, MPI, OpenMP, Package, Performance, Thesis

February 3, 2025 by hgpu

On the Partitioning of GPU Power among Multi-Instances

Tirth Vamja, Kaustabha Ray, Felix George, UmaMaheswari C Devi

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia V100, Performance

February 3, 2025 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Teaching An Old Dog New Tricks: Porting Legacy Code to Heterogeneous Compute Architectures With Automated Code Translation

Vortex: Overcoming Memory Capacity Limitations in GPU-Accelerated Large-Scale Data Analytics

Optimizing the optimizer increasing performance efficiency of modern compilers

Compiler Support for Speculation in Decoupled Access/Execute Architectures

Towards autonomous resource management: Deep learning prediction of CPU-GPU load balancing

Ilargi: a GPU Compatible Factorized ML Model Training Framework

Fully-Automated Code Generation for Efficient Computation of Sparse Matrix Permanents on GPUs

CPU-GPU co-execution through the exploitation of hybrid technologies via SYCL

Modernization and Optimization of MPI Codes

On the Partitioning of GPU Power among Multi-Instances

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)