high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, nVidia DGX-A100, Python

June 30, 2024 by hgpu

Adapting database components to heterogeneous environments

Dimitrios Koutsoukos

View

Download (PDF)

Tags: Computer science, CUDA, Databases, Heterogeneous systems, nVidia, nVidia P100, Thesis

June 30, 2024 by hgpu

A Survey of General-purpose Polyhedral Compilers

Arun Thangamani, Vincent Loechner, Stéphane Genaud

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Package, survey

June 30, 2024 by hgpu

GPU Parallelization of Astronomical Image Subtraction

Gustav Arneving, Hugo Wilhelmsson

View

Download (PDF)

Tags: Astrophysics, nVidia, nVidia GeForce GTX 1050, OpenCL, OpenMP, Physics, Thesis

June 23, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

Optimal Kernel Orchestration for Tensor Programs with Korch

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

June 23, 2024 by hgpu

COOK Access Control on an embedded Volta GPU

Benjamin Lesage, Frédéric Boniol, Claire Pagetti

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia Jetson AGX Xavier

June 23, 2024 by hgpu

How much can we gain from Tensor Kernel Fusion on GPUs?

Wei Sun, Ang Li, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, nVidia H100

June 16, 2024 by hgpu

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Johannes Pekkilä, Oskar Lappi, Fredrik Robertsén, Maarit J. Korpi-Lagg

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Energy-efficient computing, HIP, nVidia, nVidia A100, nVidia V100, Package, Performance, PyTorch, Stencil computation

June 16, 2024 by hgpu

A methodology for comparing optimization algorithms for auto-tuning

Floris-Jan Willemsen, Richard Schoonhoven, Jiří Filipovič, Jacob O. Tørring, Rob van Nieuwpoort, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, Package, Performance

June 16, 2024 by hgpu

Memory Interference and Performance Prediction in GPU-Accelerated Heterogeneous Systems

Alessio Masola

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, nVidia, nVidia GeForce RTX 2070, nVidia GeForce RTX 2080, nVidia Jetson AGX Xavier, Rendering, Thesis, Visualization

June 9, 2024 by hgpu

Gaining Cross-Platform Parallelism for HAL’s Molecular Dynamics Package using SYCL

Viktor Skoblin, Felix Höfling, Steffen Christgau

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Computer science, CUDA, Molecular dynamics, nVidia, nVidia A100, nVidia A40, Package, Physics, SYCL

June 9, 2024 by hgpu

GEAK-agent: LLM-based AI agent, which can write correct and efficient GPU kernels automatically

Geak: Introducing Triton Kernel AI Agent & Evaluation Benchmarks

OpenDwarfs 2025: re-engineered version of the OpenDwarfs benchmark suite, for compatibility with modern platforms

OpenDwarfs 2025: Modernizing the OpenDwarfs Benchmark Suite for Heterogeneous Computing

Specx: Speculative task-based runtime system

Specx: a C++ task-based runtime system for heterogeneous distributed architectures

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

KISim: Kubernetes Intelligent Scheduling Simulator

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Efficient GPU Implementation of Multi-Precision Integer Division

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Composing Distributed Computations Through Task and Kernel Fusion

Adapting database components to heterogeneous environments

A Survey of General-purpose Polyhedral Compilers

GPU Parallelization of Astronomical Image Subtraction

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Optimal Kernel Orchestration for Tensor Programs with Korch

COOK Access Control on an embedded Volta GPU

How much can we gain from Tensor Kernel Fusion on GPUs?

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

A methodology for comparing optimization algorithms for auto-tuning

Memory Interference and Performance Prediction in GPU-Accelerated Heterogeneous Systems

Gaining Cross-Platform Parallelism for HAL’s Molecular Dynamics Package using SYCL

Recent source codes

GEAK-agent: LLM-based AI agent, which can write correct and efficient GPU kernels automatically

OpenDwarfs 2025: re-engineered version of the OpenDwarfs benchmark suite, for compatibility with modern platforms

Specx: Speculative task-based runtime system

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

KISim: Kubernetes Intelligent Scheduling Simulator

Efficient GPU Implementation of Multi-Precision Integer Division

exa-AMD: Exascale Accelerated Materials Discovery

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Most viewed papers (last 30 days)