high performance computing on graphics processing units: hgpu.org

hgpu.org » Machine learning

CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research

Chris Cummins, Bram Wasti, Jiadong Guo, Brandon Cui, Jason Ansel, Sahir Gomez, Somya Jain, Jia Liu, Olivier Teytaud, Benoit Steiner, Yuandong Tian, Hugh Leather

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Benchmarking, Compilers, Computer science, CUDA, Machine learning, nVidia, Package, Performance

September 26, 2021 by hgpu

WarpDrive: Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning on a GPU

Tian Lan, Sunil Srinivasa, Stephan Zheng

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, Package, Python, Tesal V100

September 5, 2021 by hgpu

A Survey of Big Data, High Performance Computing, and Machine Learning Benchmarks

Nina Ihde, Paula Marten, Ahmed Eleliemy, Gabrielle Poerwawinata, Pedro Silva, Ilin Tolovski, Florina M. Ciorba, Tilmann Rabl

View

Download (PDF)

Tags: Benchmarking, Computer science, HPC, Machine learning, survey

August 29, 2021 by hgpu

DNN is not all you need: Parallelizing Non-Neural ML Algorithms on Ultra-Low-Power IoT Processors

Enrico Tabanelli, Giuseppe Tagliavini, Luca Benini

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, Machine learning, Neural networks, nVidia, Package, SoC, Tesla A100

July 25, 2021 by hgpu

GPTPU: Accelerating Applications using Edge Tensor Processing Units

Kuan-Chieh Hsu, Hung-Wei Tseng

View

Download (PDF)

Tags: Algorithms, Artificial intelligence, Computer science, CUDA, Machine learning, Neural networks, nVidia, OpenCL, TPU

July 18, 2021 by hgpu

KAISA: An Adaptive Second-order Optimizer Framework for Deep Neural Networks

J. Gregory Pauloski, Qi Huang, Lei Huang, Shivaram Venkataraman, Kyle Chard, Ian Foster, Zhao Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia A100, nVidia DGX-A100, Package, Tesla V100

July 11, 2021 by hgpu

Opening the Black Box: Performance Estimation during Code Generation for GPUs

Dominik Ernst, Georg Hager, Markus Holzer, Matthias Knorr, Gerhard Wellein

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Lattice Boltzmann model, Machine learning, nVidia, Performance, Stencil computation, Tesla V100

July 11, 2021 by hgpu

Optimization of Heterogeneous Parallel Computing Systems using Machine Learning

Devi Abhiseshu Adurti, Mohit Battu

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, Matrix multiplication, nVidia, nVidia GeForce GTX 1050 Ti, Thesis

July 4, 2021 by hgpu

HALF: Holistic Auto Machine Learning for FPGAs

Jonas Ney, Dominik Loroch, Vladimir Rybalkin, Nico Weber, Jens Krüger, Norbert Wehn

View

Download (PDF)

Tags: Computer science, Design space exploration, FPGA, HLS, Machine learning, Neural networks

July 4, 2021 by hgpu

Lettuce: PyTorch-based Lattice Boltzmann Framework

Mario Christopher Bedrunka, Dominik Wilde, Martin Kliemank, Dirk Reith, Holger Foysi, Andreas Krämer

View

Download (PDF)

Source codes

Tags: Algorithms, Computational Physics, CUDA, Deep learning, Fluid dynamics, Lattice Boltzmann model, Machine learning, nVidia, nVidia GeForce RTX 2070, Package, Physics, Tesla V100

June 27, 2021 by hgpu

StreamBrain: An HPC Framework for Brain-like Neural Networks on CPUs, GPUs and FPGAs

Artur Podobas, Martin Svedin, Steven W. D. Chien, Ivy B. Peng, Naresh Balaji Ravichandran, Pawel Herman, Anders Lansner, Stefano Markidis

View

Download (PDF)

Source codes

Tags: Bayesian, Computer science, CUDA, Deep learning, FPGA, HPC, Machine learning, MPI, nVidia, OpenMPI, Package, Tesla A100, Tesla V100

June 20, 2021 by hgpu

Optimization of Heterogeneous Systems with AI Planning Heuristics and Machine Learning: A Performance and Energy Aware Approach

Suejb Memeti, Sabri Pllana

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Heterogeneous systems, Intel Xeon Phi, Machine learning

June 6, 2021 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research

WarpDrive: Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning on a GPU

A Survey of Big Data, High Performance Computing, and Machine Learning Benchmarks

DNN is not all you need: Parallelizing Non-Neural ML Algorithms on Ultra-Low-Power IoT Processors

GPTPU: Accelerating Applications using Edge Tensor Processing Units

KAISA: An Adaptive Second-order Optimizer Framework for Deep Neural Networks

Opening the Black Box: Performance Estimation during Code Generation for GPUs

Optimization of Heterogeneous Parallel Computing Systems using Machine Learning

HALF: Holistic Auto Machine Learning for FPGAs

Lettuce: PyTorch-based Lattice Boltzmann Framework

StreamBrain: An HPC Framework for Brain-like Neural Networks on CPUs, GPUs and FPGAs

Optimization of Heterogeneous Systems with AI Planning Heuristics and Machine Learning: A Performance and Energy Aware Approach

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

LLM.Q: Quantized LLM training in pure CUDA/C++

Most viewed papers (last 30 days)