high performance computing on graphics processing units: hgpu.org

hgpu.org » Computer science

Predicting GPUDirect Benefits for HPC Workloads

Harsh Khetawat, Nikhil Jain, Abhinav Bhatele, Frank Mueller

View

Download (PDF)

Tags: Computer science, HPC, Performance prediction

March 18, 2024 by hgpu

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Xinyi Li, Ang Li, Bo Fang, Katarzyna Swirydowicz, Ignacio Laguna, Ganesh Gopalakrishnan

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, Hardware Architecture, HPC, Matrix multiplication, nVidia, nVidia A100, nVidia H100, nVidia V100, PTX

March 10, 2024 by hgpu

SYCL-Bench 2020: Benchmarking SYCL 2020 on AMD, Intel, and NVIDIA GPUs

Luigi Crisci, Lorenzo Carpentieri, Peter Thoman, Aksel Alpay, Vincent Heuveline, Biagio Cosenza

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, Heterogeneous systems, HPC, Intel, Intel Ponte Vecchio Max 1100, nVidia, oneAPI, Portability, SYCL, Tesla V100

March 10, 2024 by hgpu

Parallel Implementation of Lightweight Secure Hash Algorithm on CPU and GPU Environments

Hojin Choi, SeongJun Choi, SeogChung Seo

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Hashing, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, Package, PTX, Security

March 10, 2024 by hgpu

Parallel programming in mobile devices with FancyJCL

Sergio Afonso, Óscar Gómez-Cárdenes, Paula Expósito, Vicente Blanco, Francisco Almeida

View

Download (PDF)

Source codes

Tags: Computer science, DSP, Heterogeneous systems, Image processing, Java, OpenCL, Package

March 3, 2024 by hgpu

Low-Overhead Trace Collection and Profiling on GPU Compute Kernels

Sébastien Darche, Michel R. Dagenais

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, CUDA, HIP, nVidia, Package, Performance, Profiling

March 3, 2024 by hgpu

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Dan Zhao, Siddharth Samsi, Joseph McDonald, Baolin Li, David Bestor, Michael Jones, Devesh Tiwari, Vijay Gadepally

View

Download (PDF)

Tags: AI, Computer science, Energy-efficient computing, HPC, nVidia, nVidia A100

March 3, 2024 by hgpu

Spyx: A Library for Just-In-Time Compiled Optimization of Spiking Neural Networks

Kade M. Heckel, Thomas Nowotny

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia RTX A6000, Package, Python

March 3, 2024 by hgpu

APPy: Annotated Parallelism for Python on GPUs

Tong Zhou, Jun Shirako, Vivek Sarkar

View

Download (PDF)

Tags: Code generation, Compilers, Computer science, CUDA, Machine learning, nVidia, nVidia GeForce RTX 3090, Python

February 25, 2024 by hgpu

Analyzing GPU Performance in Virtualized Environments: A Case Study

Adel Belkhiri, Michel Dagenais

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Java, nVidia, OpenCL, Package, Performance, Virtualization

February 25, 2024 by hgpu

Green AI: A Preliminary Empirical Study on Energy Consumption in DL Models Across Different Runtime Infrastructures

Negar Alizadeh, Fernando Castor

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Energy-efficient computing, nVidia, nVidia GeForce RTX 3070, Package, PyTorch, TensorFlow

February 25, 2024 by hgpu

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

February 25, 2024 by hgpu

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

* * *

high performance computing on graphics processing units: hgpu.org

Predicting GPUDirect Benefits for HPC Workloads

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

SYCL-Bench 2020: Benchmarking SYCL 2020 on AMD, Intel, and NVIDIA GPUs

Parallel Implementation of Lightweight Secure Hash Algorithm on CPU and GPU Environments

Parallel programming in mobile devices with FancyJCL

Low-Overhead Trace Collection and Profiling on GPU Compute Kernels

Sustainable Supercomputing for AI: GPU Power Capping at HPC Scale

Spyx: A Library for Just-In-Time Compiled Optimization of Spiking Neural Networks

APPy: Annotated Parallelism for Python on GPUs

Analyzing GPU Performance in Virtualized Environments: A Case Study

Green AI: A Preliminary Empirical Study on Energy Consumption in DL Models Across Different Runtime Infrastructures

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

Recent source codes

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)