high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

Graphtoy: Fast Software Simulation of Applications for AMD’s AI Engines

Jonathan Strobl, Leonardo Solis-Vasquez, Yannick Lavan, Andreas Koch

View

Download (PDF)

Source codes

Tags: ATI, Computer science, FPGA, molecular docking, Package

February 18, 2024 by hgpu

An Evaluative Comparison of Performance Portability across GPU Programming Models

Joshua H. Davis, Pranav Sivaraman, Isaac Minn, Konstantinos Parasyris, Harshitha Menon, Giorgis Georgakoudis, Abhinav Bhatele

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, AMD Radeon Instinct Mi50, ATI, Computer science, CUDA, Heterogeneous systems, HIP, MPI, nVidia, nVidia V100, OpenACC, OpenMP, Performance, performance portability, SYCL

February 18, 2024 by hgpu

pSTL-Bench: A Micro-Benchmark Suite for Assessing Scalability of C++ Parallel STL Implementations

Ruben Laso, Diego Krupitza, Sascha Hunold

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia Ampere A2, OpenMP, performance portability, Tesla P4

February 18, 2024 by hgpu

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Taesu Kim, Jongho Lee, Daehyun Ahn, Sarang Kim, Jiwoong Choi, Minkyu Kim, Hyungjun Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, Mixed precision, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia RTX A6000, Package

February 18, 2024 by hgpu

Multi-line AI-assisted Code Authoring

Omer Dunay, Daniel Cheng, Adam Tait, Parth Thakkar, Peter C Rigby, Andy Chiu, Imad Ahmad, Arun Ganesan, Chandra Maddila, Vijayaraghavan Murali, Ali Tayyebi, Nachiappan Nagappan

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, Software Engineering

February 12, 2024 by hgpu

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Y. Wu, Y.K. Li, Fuli Luo, Yingfei Xiong, Wenfeng Liang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, nVidia, nVidia A100, Package

February 12, 2024 by hgpu

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Gianmarco Accordi, Davide Gadioli, Emanele Vitali, Luigi Crisci, Biagio Cosenza, Andrea Beccari, Gianluca Palermo

View

Download (PDF)

Tags: Computer science, CUDA, HPC, molecular docking, nVidia, nVidia A100, oneAPI, Performance, SYCL

February 12, 2024 by hgpu

Evaluating the Wide Area Classroom After 24,000 HPC Students

John Urbanic, Thomas Maiden, Valerie Rossi

View

Download (PDF)

Tags: Education, HPC, Machine learning, MPI, OpenACC, OpenMP, Physics

February 12, 2024 by hgpu

Training DNN Models over Heterogeneous Clusters with Optimal Performance

Chengyi Nie, Jessica Maghakian, Zhenhua Liu

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, load balancing, Neural networks, nVidia, nVidia RTX 6000 Ada

February 12, 2024 by hgpu

Gallatin: A General-Purpose GPU Memory Manager

Hunter McCoy, Prashant Pandey

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia A40, Package

February 4, 2024 by hgpu

Deductive verification for SYCL

Ellen Wittingen

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, HIP, nVidia, OpenCL, OpenMP, Package, SYCL, Thesis

February 4, 2024 by hgpu

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Tyler Sorensen, Heidy Khlaaf

View

Download (PDF)

Source codes

Tags: Computer science, Data recovery, nVidia, nVidia GeForce RTX 4070, OpenCL, Package, Security, Vulkan

February 4, 2024 by hgpu

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Graphtoy: Fast Software Simulation of Applications for AMD’s AI Engines

An Evaluative Comparison of Performance Portability across GPU Programming Models

pSTL-Bench: A Micro-Benchmark Suite for Assessing Scalability of C++ Parallel STL Implementations

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Multi-line AI-assisted Code Authoring

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Evaluating the Wide Area Classroom After 24,000 HPC Students

Training DNN Models over Heterogeneous Clusters with Optimal Performance

Gallatin: A General-Purpose GPU Memory Manager

Deductive verification for SYCL

LeftoverLocals: Listening to LLM Responses Through Leaked GPU Local Memory

Recent source codes

QArray

Celerity: High-level C++ for Accelerator Clusters

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

OpenMC Monte Carlo Code

Polygeist: C/C++ frontend for MLIR

Parallel Gaussian process with kernel approximation in CUDA

Optical flow algorithms for SYCL

OpenMP5-Offload-OpenMC-Intel-PVC

Most viewed papers (last 30 days)