high performance computing on graphics processing units: hgpu.org

hgpu.org » Package

Towards Co-execution on Commodity Heterogeneous Systems: Optimizations for Time-Constrained Scenarios

Raúl Nozal, Jose Luis Bosque, Ramon Beivide

View

Download (PDF)

Source codes

Tags: AMD Radeon R7, ATI, Computer science, Heterogeneous systems, load balancing, nVidia, nVidia GeForce GTX 950, OpenCL, Package, performance portability, Task scheduling

November 1, 2020 by hgpu

Out-of-core Training for Extremely Large-Scale Neural Networks With Adaptive Window-Based Scheduling

Akio Hayakawa, Takuya Narihira

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Deep learning, Neural networks, nVidia, Package, Tesla V100

November 1, 2020 by hgpu

Memory Optimization for Deep Networks

Aashaka Shah, Chao-Yuan Wu, Jayashree Mohan, Vijay Chidambaram, Philipp Krähenbühl

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Memory, nVidia, Optimization, Package, PyTorch, Tesla P100

November 1, 2020 by hgpu

FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver

Chirag Modi, Francois Lanusse, Uros Seljak

View

Download (PDF)

Source codes

Tags: Astrophysics, Cosmology, CUDA, N-body simulation, nVidia, Package, Physics, TensorFlow, Tesla V100

October 25, 2020 by hgpu

A Tensor Compiler for Unified Machine Learning Prediction Serving

Supun Nakandala Karla Saur, Gyeong-In Yu, Konstantinos Karanasos, Carlo Curino, Markus Weimer, Matteo Interlandi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, Package, Tesla K80, Tesla P100

October 18, 2020 by hgpu

Deep Learning for Digital Asset Limit Order Books

Rakshit Jha, Mattijs De Paepe, Samuel Holt, James West, Shaun Ng

View

Download (PDF)

Source codes

Tags: Deep learning, Finance, Package, Python

October 11, 2020 by hgpu

Bempp-cl: A fast Python based just-in-time compiling boundary element library

Timo Betcke, Matthew W. Scroggs

View

Download (PDF)

Source codes

Tags: Computer science, Differential equations, Integral equations, OpenCL, Package, Partial differential equations, PDEs, Python

October 11, 2020 by hgpu

Mastering Atari with Discrete World Models

Danijar Hafner, Timothy Lillicrap, Mohammad Norouzi, Jimmy Ba

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Machine learning, nVidia, Package, Python, TensorFlow, Tesla V100

October 11, 2020 by hgpu

Transparent Acceleration of Java-based Deep Learning Engines

Athanasios Stratikopoulos, Mihai-Cristian Olteanu, Ian Vaughan, Zoran Sevarac, Nikos Foutris, Juan Fumero, Christos Kotselidis

View

Download (PDF)

Source codes

Tags: AMD RX Vega 64, ATI, Computer science, Computer vision, Deep learning, Java, nVidia, nVidia GeForce GTX 1050 Ti, OpenCL, Package

October 4, 2020 by hgpu

LoopBench: An Evaluation of Loop Acceleration in Heterogeneous Systems

Saman Biookaghazadeh, Fengbo Ren, Ming Zhao

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, FPGA, Heterogeneous systems, OpenCL, Package

October 4, 2020 by hgpu

Flexible Performant GEMM Kernels on GPUs

Thomas Faingnaert, Tim Besard, Bjorn De Sutter

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Julia, Machine learning, Mathematical Software, Matrix multiplication, Mixed precision, nVidia, nVidia GeForce RTX 2080 Ti, Package, Performance

October 4, 2020 by hgpu

Accelerating Sparse Matrix-Matrix Multiplication with GPU Tensor Cores

Orestis Zachariadis, Nitin Satpute, Juan Gómez-Luna, Joaquín Olivares

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, Mixed precision, nVidia, nVidia GeForce RTX 2070, nVidia Titan RTX, Package, Performance, Sparse matrix

October 4, 2020 by hgpu

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

* * *

high performance computing on graphics processing units: hgpu.org

Towards Co-execution on Commodity Heterogeneous Systems: Optimizations for Time-Constrained Scenarios

Out-of-core Training for Extremely Large-Scale Neural Networks With Adaptive Window-Based Scheduling

Memory Optimization for Deep Networks

FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver

A Tensor Compiler for Unified Machine Learning Prediction Serving

Deep Learning for Digital Asset Limit Order Books

Bempp-cl: A fast Python based just-in-time compiling boundary element library

Mastering Atari with Discrete World Models

Transparent Acceleration of Java-based Deep Learning Engines

LoopBench: An Evaluation of Loop Acceleration in Heterogeneous Systems

Flexible Performant GEMM Kernels on GPUs

Accelerating Sparse Matrix-Matrix Multiplication with GPU Tensor Cores

Recent source codes

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)