high performance computing on graphics processing units: hgpu.org

Jiajun Huang, Sheng Di, Xiaodong Yu, Yujia Zhai, Jinyang Liu, Yafan Huang, Ken Raffenetti, Hui Zhou, Kai Zhao, Zizhong Chen, Franck Cappello, Yanfei Guo, Rajeev Thakur

View

Download (PDF)

Tags: Compression, Computer science, GPU cluster, MPI, nVidia, nVidia A100

August 13, 2023 by hgpu

A Model Extraction Attack on Deep Neural Networks Running on GPUs

Jonah G. O'Brien Weiss

View

Download (PDF)

Tags: Computer science, Neural networks, nVidia, nVidia Quadro RTX 8000, Security, Tesla T4

August 13, 2023 by hgpu

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Kaijie Fan, Marco D'Antonio, Lorenzo Carpentieri, Biagio Cosenza, Federico Ficarelli, Daniele Cesarini

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, Energy-efficient computing, GPU cluster, Heterogeneous systems, Machine learning, nVidia, nVidia V100, SYCL

August 13, 2023 by hgpu

Static and Dynamic Analyses for Efficient GPU Execution

Philip Munksgaard

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Benchmarking, Computer science, nVidia, nVidia A100, OpenCL, Performance, Thesis

August 13, 2023 by hgpu

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Xinchi Han, Weihao Jiang, Peirui Cao, Qinwei Yang, Yunzhuo Liu, Shuyao Qi, Shengkai Lin, Shizhen Zhao

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Machine learning, Neural networks, nVidia, nVidia V100, Package

August 13, 2023 by hgpu

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

* * *

high performance computing on graphics processing units: hgpu.org

Sieve: Stratified GPU-Compute Workload Sampling

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Novel insights on atomic synchronization for sort-based group-by on GPUs

Generating Parallel OpenCL and OpenMP Programs from Dataflow Graphs

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Increased reliability on Intel GPUs via software diverse redundancy

Quantifying OpenMP: Statistical Insights into Usage and Adoption

gZCCL: Compression-Accelerated Collective Communication Framework for GPU Clusters

A Model Extraction Attack on Deep Neural Networks Running on GPUs

SYnergy: Fine-grained Energy-Efficient Heterogeneous Computing for Scalable Energy Saving

Static and Dynamic Analyses for Efficient GPU Execution

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Recent source codes

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)