high performance computing on graphics processing units: hgpu.org

Jeffrey Krupa, Kelvin Lin, Maria Acosta Flechas, Jack Dinsmore, Javier Duarte, Philip Harris, Scott Hauck, Burt Holzman, Shih-Chieh Hsu, Thomas Klijnsma, Mia Liu, Kevin Pedro, Natchanon Suaysom, Matt Trahms, Nhan Tran

View

Download (PDF)

Source codes

Tags: Deep learning, FPGA, HEP, nVidia, Package, Physics, Tesla T4, Tesla V100

July 26, 2020 by hgpu

UVMBench: A Comprehensive Benchmark Suite for Researching Unified Virtual Memory in GPUs

Yongbin Gu, Wenxuan Wu, Yunfan Li, Lizhong Chen

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Memory, nVidia, nVidia GeForce GTX 1080 Ti, Package, Performance

July 26, 2020 by hgpu

Offload Annotations: Bringing Heterogeneous Computing to Existing Libraries and Workloads

Gina Yuan, Shoumik Palkar, Deepak Narayanan, Matei Zaharia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, nVidia, Package, Python, Tesla P100

July 19, 2020 by hgpu

Compyle: a Python package for parallel computing

Aditya Bhosale, Prabhu Ramachandran

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, HPC, nVidia, OpenCL, Package, Python, Tesla P100

July 19, 2020 by hgpu

Accelerating Deep Learning Inference with Cross-Layer Data Reuse on GPUs

Xueying Wang, Guangli Li, Xiao Dong, Jiansong Li, Lei Liu, Xiaobing Feng

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce GTX Titan XP, Tesla P4

July 19, 2020 by hgpu

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

* * *

high performance computing on graphics processing units: hgpu.org

Applications

OpenSBLI: Automated code-generation for heterogeneous computing architectures applied to compressible fluid dynamics on structured grids

Deep Learning Application in Plant Stress Imaging: A Review

Biomedical and Clinical English Model Packages in the Stanza Python NLP Library

Optimizing Block-Sparse Matrix Multiplications on CUDA with TVM

Darknet on OpenCL: a multi-platform tool for object detection and classification

EDSSA: An Encoder-Decoder Semantic Segmentation Networks Accelerator on OpenCL-Based FPGA Platform

Bit-level Parallelization of 3DES Encryption on GPU

GPU coprocessors as a service for deep learning inference in high energy physics

UVMBench: A Comprehensive Benchmark Suite for Researching Unified Virtual Memory in GPUs

Offload Annotations: Bringing Heterogeneous Computing to Existing Libraries and Workloads

Compyle: a Python package for parallel computing

Accelerating Deep Learning Inference with Cross-Layer Data Reuse on GPUs

Recent source codes

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)