high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

Avinash Maurya

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, HPC, nVidia, nVidia DGX-A100, Package, Thesis

December 29, 2024 by hgpu

Asynchronous-Many-Task Systems: Challenges and Opportunities – Scaling an AMR Astrophysics Code on Exascale machines using Kokkos and HPX

Gregor Daiß, Patrick Diehl, Jiakun Yan, John K. Holmen, Rahulkumar Gayatri, Christoph Junghans, Alexander Straub, Jeff R. Hammond, Dominic Marcello, Miwako Tsuji, Dirk Pflüger, Hartmut Kaiser

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, Astrophysics, ATI, Computer science, CUDA, Heterogeneous systems, HIP, HPC, nVidia, nVidia A100, Package, performance portability, Physics

December 29, 2024 by hgpu

Utilizing Tensor Cores in Futhark

Kristoffer August Kortbæk, Rune Ejnar Bang Lejbølle

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, High-level Languages, Matrix multiplication, nVidia, nVidia A100, Package, PTX

December 24, 2024 by hgpu

CPPJoules: An Energy Measurement Tool for C++

Shivadharshan S, Akilesh P, Rajrupa Chattaraj, Sridhar Chimalakonda

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, nVidia, Package, Software Engineering

December 24, 2024 by hgpu

Accelerating Sparse Graph Neural Networks with Tensor Core Optimization

Ka Wai Wu

View

Download (PDF)

Tags: Computer science, CUDA, Graph, Heterogeneous systems, Neural networks, nVidia, PyTorch, Tesla V100

December 24, 2024 by hgpu

HPC-Coder-V2: Studying Code LLMs Across Low-Resource Parallel Languages

Aman Chaturvedi, Daniel Nichols, Siddharth Singh, Abhinav Bhatele

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, HIP, HPC, LLM, MPI, nVidia, nVidia A100, OpenMP, Package

December 24, 2024 by hgpu

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Ezhilmathi Krishnasamy, Pascal Bouvry

View

Download (PDF)

Source codes

Tags: BLAS, Computer science, CUDA, Differential equations, HPC, Linear Algebra, Matrix multiplication, nVidia, nVidia A100, OpenACC, Package, Partial differential equations, PDEs, Performance

December 24, 2024 by hgpu

Analyzing the Performance Portability of SYCL across CPUs, GPUs, and Hybrid Systems with Protein Database Search

Manuel Costanzo, Enzo Rucci, Carlos García-Sánchez, Marcelo Naiouf, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 6700 XT, AMD Radeon RX Vega 6, ATI, Bioinformatics, Biology, Computer science, CUDA, Databases, Heterogeneous systems, HPC, Intel, Intel Arc A770, Intel UHD 630, Intel UHD 770, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 980, nVidia GeForce RTX 2070, nVidia GeForce RTX 3070, nVidia GeForce RTX 3090, oneAPI, Package, performance portability, SYCL, Tesla V100

December 15, 2024 by hgpu

RTCUDB: Building Databases with RT Processors

Xuri Shi, Kai Zhang, X. Sean Wang, Xiaodong Zhang, Rubao Lee

View

Download (PDF)

Tags: Computer science, CUDA, Databases, nVidia, nVidia GeForce GTX Titan X, nVidia GeForce RTX 4090

December 15, 2024 by hgpu

Leveraging the potential of task-based programming with OpenMP task graphs

Chenle Yu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia V100, OpenMP, Package, Thesis

December 15, 2024 by hgpu

FortranX: Harnessing Code Generation, Portability, and Heterogeneity in Fortran

Sanil Rao, Mike Franusich, , Mohammad Alaul Haque Monil, Het Mankad, Jeffrey S. Vetter, Franz Franchetti

View

Download (PDF)

Tags: AMD, ATI, Code generation, Computer science, CUDA, Differential equations, Fortran, Heterogeneous systems, HIP, nVidia, OpenCL, OpenMP, Partial differential equations, PDEs

December 8, 2024 by hgpu

Guardian: Safe GPU Sharing in Multi-Tenant Environments

Manos Pavlidakis, Giorgos Vasiliadis, Anargyros Argyros, Stelios Mavridis, Antony Chazapis, Angelos Bilas

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 3080 Ti, nVidia RTX A4000, PTX, Security

December 8, 2024 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Scalable Access-Pattern Aware I/O Acceleration and Multi-Tiered Data Management for HPC and AI Workloads

Asynchronous-Many-Task Systems: Challenges and Opportunities – Scaling an AMR Astrophysics Code on Exascale machines using Kokkos and HPX

Utilizing Tensor Cores in Futhark

CPPJoules: An Energy Measurement Tool for C++

Accelerating Sparse Graph Neural Networks with Tensor Core Optimization

HPC-Coder-V2: Studying Code LLMs Across Low-Resource Parallel Languages

Reproducible Study and Performance Analysis of GPU Programming Paradigms: OpenACC vs. CUDA in Key Linear Algebra Computations

Analyzing the Performance Portability of SYCL across CPUs, GPUs, and Hybrid Systems with Protein Database Search

RTCUDB: Building Databases with RT Processors

Leveraging the potential of task-based programming with OpenMP task graphs

FortranX: Harnessing Code Generation, Portability, and Heterogeneity in Fortran

Guardian: Safe GPU Sharing in Multi-Tenant Environments

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)