high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

SYCL-Bench 2020: Benchmarking SYCL 2020 on AMD, Intel, and NVIDIA GPUs

Luigi Crisci, Lorenzo Carpentieri, Peter Thoman, Aksel Alpay, Vincent Heuveline, Biagio Cosenza

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, Heterogeneous systems, HPC, Intel, Intel Ponte Vecchio Max 1100, nVidia, oneAPI, Portability, SYCL, Tesla V100

March 10, 2024 by hgpu

Using AI libraries for Incompressible Computational Fluid Dynamics

Boyang Chen, Claire E. Heaney, Christopher C. Pain

View

Download (PDF)

Tags: AI, Artificial intelligence, cfd, CUDA, Fluid dynamics, Neural networks, nVidia, Partial differential equations, PDEs, Tesla T4

March 3, 2024 by hgpu

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Dan Zhao, Siddharth Samsi, Joseph McDonald, Baolin Li, David Bestor, Michael Jones, Devesh Tiwari, Vijay Gadepally

View

Download (PDF)

Tags: AI, Computer science, Energy-efficient computing, HPC, nVidia, nVidia A100

March 3, 2024 by hgpu

Spyx: A Library for Just-In-Time Compiled Optimization of Spiking Neural Networks

Kade M. Heckel, Thomas Nowotny

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia RTX A6000, Package, Python

March 3, 2024 by hgpu

Parallel programming in mobile devices with FancyJCL

Sergio Afonso, Óscar Gómez-Cárdenes, Paula Expósito, Vicente Blanco, Francisco Almeida

View

Download (PDF)

Source codes

Tags: Computer science, DSP, Heterogeneous systems, Image processing, Java, OpenCL, Package

March 3, 2024 by hgpu

Low-Overhead Trace Collection and Profiling on GPU Compute Kernels

Sébastien Darche, Michel R. Dagenais

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, CUDA, HIP, nVidia, Package, Performance, Profiling

March 3, 2024 by hgpu

APPy: Annotated Parallelism for Python on GPUs

Tong Zhou, Jun Shirako, Vivek Sarkar

View

Download (PDF)

Tags: Code generation, Compilers, Computer science, CUDA, Machine learning, nVidia, nVidia GeForce RTX 3090, Python

February 25, 2024 by hgpu

Analyzing GPU Performance in Virtualized Environments: A Case Study

Adel Belkhiri, Michel Dagenais

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Java, nVidia, OpenCL, Package, Performance, Virtualization

February 25, 2024 by hgpu

Assessing opportunities of SYCL for biological sequence alignment on GPU-based systems

Manuel Costanzo, Enzo Rucci, Carlos García-Sanchez, Marcelo Naiouf, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 6700 XT, AMD Radeon RX Vega 6, ATI, Bioinformatics, Biology, Computational biology, CUDA, Heterogeneous systems, Intel Arc A770, Intel UHD 630, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 980, nVidia GeForce RTX 2070, nVidia GeForce RTX 3090, nVidia V100, oneAPI, Package, Sequence alignment, SYCL

February 25, 2024 by hgpu

Green AI: A Preliminary Empirical Study on Energy Consumption in DL Models Across Different Runtime Infrastructures

Negar Alizadeh, Fernando Castor

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Energy-efficient computing, nVidia, nVidia GeForce RTX 3070, Package, PyTorch, TensorFlow

February 25, 2024 by hgpu

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

February 25, 2024 by hgpu

An Evaluative Comparison of Performance Portability across GPU Programming Models

Joshua H. Davis, Pranav Sivaraman, Isaac Minn, Konstantinos Parasyris, Harshitha Menon, Giorgis Georgakoudis, Abhinav Bhatele

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, AMD Radeon Instinct Mi50, ATI, Computer science, CUDA, Heterogeneous systems, HIP, MPI, nVidia, nVidia V100, OpenACC, OpenMP, Performance, performance portability, SYCL

February 18, 2024 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

SYCL-Bench 2020: Benchmarking SYCL 2020 on AMD, Intel, and NVIDIA GPUs

Using AI libraries for Incompressible Computational Fluid Dynamics

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Spyx: A Library for Just-In-Time Compiled Optimization of Spiking Neural Networks

Parallel programming in mobile devices with FancyJCL

Low-Overhead Trace Collection and Profiling on GPU Compute Kernels

APPy: Annotated Parallelism for Python on GPUs

Analyzing GPU Performance in Virtualized Environments: A Case Study

Assessing opportunities of SYCL for biological sequence alignment on GPU-based systems

Green AI: A Preliminary Empirical Study on Energy Consumption in DL Models Across Different Runtime Infrastructures

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

An Evaluative Comparison of Performance Portability across GPU Programming Models

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Most viewed papers (last 30 days)