high performance computing on graphics processing units: hgpu.org

hgpu.org » CUDA

Lightning: Scaling the GPU Programming Model Beyond a Single GPU

Stijn Heldens, Pieter Hijma, Ben van Werkhoven, Jason Maassen, Rob V. van Nieuwpoort

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Distributed computing, nVidia, OpenCL, Package, Performance, Tesla P100

February 20, 2022 by hgpu

Heuristic Adaptability to Input Dynamics for SpMM on GPUs

Guohao Dai, Guyue Huang, Shang Yang, Zhongming Yu, Hengrui Zhang, Yufei Ding, Yuan Xie, Huazhong Yang, Yu Wang

View

Download (PDF)

Source codes

Tags: Algorithms, CUDA, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Package, Sparse matrix, Tesla V100

February 20, 2022 by hgpu

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

August Ernstsson

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, High-level Languages, nVidia, OpenCL, Tesla K20, Thesis

February 13, 2022 by hgpu

The Ecological Footprint of Neural Machine Translation Systems

Dimitar Sherionov, Eva Vanmassenhove

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, nVidia GeForce GTX 1080 Ti, Package, Tesla P100

February 13, 2022 by hgpu

Flashlight: Enabling Innovation in Tools for Machine Learning

Jacob Kahn, Vineel Pratap, Tatiana Likhomanenko, Qiantong Xu, Awni Hannun, Jeff Cai, Paden Tomasello, Ann Lee, Edouard Grave, Gilad Avidov, Benoit Steiner, Vitaliy Liptchinsky, Gabriel Synnaeve, Ronan Collobert

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, Package, Tesla V100

February 6, 2022 by hgpu

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

Wenzel Jakob, Sébastien Speierer, Nicolas Roussel, Delio Vicini

View

Download (PDF)

Tags: 3D Graphics and Realism, Algorithms, Code generation, CUDA, nVidia, nVidia RTX A6000, Python, Rendering

February 6, 2022 by hgpu

SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets

Xiaodong Yu, Sheng Di, Kai Zhao, jiannan Tian, Dingwen Tao, Xin Liang, Franck Cappello

View

Download (PDF)

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia A100, Tesla V100

February 6, 2022 by hgpu

GC3: An Optimizing Compiler for GPU Collective Communication

Meghan Cowan, Saeed Maleki, Madanlal Musuvathi, Olli Saarikivi, Yifan Xiong

View

Download (PDF)

Tags: Algorithms, Compilers, Computer science, CUDA, Machine learning, nVidia, nVidia A100

February 6, 2022 by hgpu

Teaching Parallel Programming in Containers: Virtualization of a Heterogeneous Local Infrastructure

Naylor Garcia Bachiega

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, HPC, nVidia, nVidia GeForce GTX 650, Package, Thesis, Virtualization

January 30, 2022 by hgpu

Optimizing Huffman Decoding for Error-Bounded Lossy Compression on GPUs

Cody Rivera, Sheng Di, Jiannan Tian, Xiaodong Yu, Dingwen Tao, Franck Cappello

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, Package, Tesla V100

January 30, 2022 by hgpu

Bit-GraphBLAS: Bit-Level Optimizations of Matrix-Centric Graph Processing on GPU

Jou-An Chen, Hsin-Hsuan Sung, Nathan Tallent, Kevin Barker, Xipeng Shen, Ang Li

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUDA, Linear Algebra, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX Titan V, Package, Sparse

January 30, 2022 by hgpu

Multi-hetero Acceleration by GPU and FPGA for Astrophysics Simulation on oneAPI Environment

Ryuta Kashino, Ryohei Kobayashi, Norihisa Fujita, Taisuke Boku

View

Download (PDF)

Tags: Astrophysics, CUDA, FPGA, Heterogeneous systems, nVidia, OpenCL, Physics, SYCL

January 23, 2022 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Lightning: Scaling the GPU Programming Model Beyond a Single GPU

Heuristic Adaptability to Input Dynamics for SpMM on GPUs

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

The Ecological Footprint of Neural Machine Translation Systems

Flashlight: Enabling Innovation in Tools for Machine Learning

Dr.Jit: A Just-In-Time Compiler for Differentiable Rendering

SZx: an Ultra-fast Error-bounded Lossy Compressor for Scientific Datasets

GC3: An Optimizing Compiler for GPU Collective Communication

Teaching Parallel Programming in Containers: Virtualization of a Heterogeneous Local Infrastructure

Optimizing Huffman Decoding for Error-Bounded Lossy Compression on GPUs

Bit-GraphBLAS: Bit-Level Optimizations of Matrix-Centric Graph Processing on GPU

Multi-hetero Acceleration by GPU and FPGA for Astrophysics Simulation on oneAPI Environment

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)