high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Performance Analysis and Automatic Tuning of Hash Aggregation on GPUs

Viktor Rosenfeld, Sebastian Bress, Steffen Zeuch, Tilmann Rabl, Volker Markl

View

Tags: Algorithms, AMD Radeon R9 Fury, ATI, Computer science, Hashing, nVidia, nVidia GeForce GXT 1080, nVidia GeForce GXT 980, OpenCL, Performance, Tesla K40, Tesla V100

June 16, 2019 by hgpu

Tensor Processing Units for Financial Monte Carlo

Francois Belletti, Davis King, Kun Yang, Roland Nelet, Yusef Shafi, Yi-Fan Chen, John Anderson

View

Download (PDF)

Tags: Cloud, Deep learning, Finance, Mixed precision, Neural networks, nVidia, Option pricing, Tesla V100, TPU

June 12, 2019 by hgpu

Parallel scalable simulations of biological neural networks using TensorFlow: A beginner’s guide

Saptarshi Soham Mohanta, Collins Assisi

View

Download (PDF)

Source codes

Tags: Biology, Computer science, CUDA, Deep learning, Differential equations, Machine learning, Neural networks, nVidia, ODEs, Ordinary differential equations, Package, Partial differential equations, PDEs, Python, TensorFlow, Tutorial

June 12, 2019 by hgpu

ParPaRaw: Massively Parallel Parsing of Delimiter-Separated Raw Data

Elias Stehle, Hans-Arno Jacobsen

View

Download (PDF)

Tags: Computer science, CUDA, Data Structures and Algorithms, Databases, nVidia, nVidia GeForce GTX Titan X

June 5, 2019 by hgpu

Dynamic Distribution Pruning for Efficient Network Architecture Search

Xiawu Zheng, Rongrong Ji, Lang Tang, Yan Wan, Baochang Zhang, Yongjian Wu, Yunsheng Wu, Ling Shao

View

Download (PDF)

Source codes

Tags: Computer science, Computer vision, CUDA, Deep learning, Machine learning, nVidia, Package, Tesla V100

June 5, 2019 by hgpu

A Development Platform for Embedded Domain-Specific Languages

Shigeru Chiba, YungYu Zhuang, Thanh-Chung Dao

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, DSL, High-level Languages, Java, nVidia, Package

June 2, 2019 by hgpu

Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models

Yunfei Teng, Wenbo Gao, Francois Chalus, Anna Choromanska, Donald Goldfarb, Adrian Weller

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 1080

June 2, 2019 by hgpu

Breadth-First Search using Dynamic Parallelism on the GPU

Dominik Todling

View

Download (PDF)

Source codes

Tags: Algorithms, Breadth-First Search, Computer science, CUDA, nVidia, Package

May 30, 2019 by hgpu

The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study

Zhenheng Tang, Yuxin Wang, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Computer science, Computer vision, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce GTX 2080 Ti, Performance, Tesla P100, Tesla V100

May 30, 2019 by hgpu

Massively Parallel GPU Memory Compaction

Matthias Springer, Hidehiko Masuhara

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia GeForce GTX Titan XP, Performance

May 30, 2019 by hgpu

Multi-GPU Rendering with Vulkan API

Lars Olav Tolo

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 460, ATI, Computer science, Heterogeneous systems, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 970, Package, Thesis, Vulkan

May 26, 2019 by hgpu

Automatic generation of warp-level primitives and atomic instructions for fast and portable parallel reduction on GPUs

Simon Garcia De Gonzalo, Sitao Huang, Juan Gomez-Luna, Simon Hammond, Onur Mutlu, Wen-mei Hwu

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia GeForce GTX 980, Performance, performance portability, Tesla K40, Tesla P100

May 26, 2019 by hgpu

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

* * *

high performance computing on graphics processing units: hgpu.org

Performance Analysis and Automatic Tuning of Hash Aggregation on GPUs

Parallel scalable simulations of biological neural networks using TensorFlow: A beginner’s guide

ParPaRaw: Massively Parallel Parsing of Delimiter-Separated Raw Data

Dynamic Distribution Pruning for Efficient Network Architecture Search

A Development Platform for Embedded Domain-Specific Languages

Leader Stochastic Gradient Descent for Distributed Training of Deep Learning Models

Breadth-First Search using Dynamic Parallelism on the GPU

The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study

Massively Parallel GPU Memory Compaction

Multi-GPU Rendering with Vulkan API

Automatic generation of warp-level primitives and atomic instructions for fast and portable parallel reduction on GPUs

Recent source codes

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)