high performance computing on graphics processing units: hgpu.org

hgpu.org » Machine learning

Generating GPU Compiler Heuristics using Reinforcement Learning

Ian Colbert, Jake Daly, Norm Rubin

View

Tags: AMD Radeon 6800 XT, AMD Radeon RX 5700 XT, ATI, Compilers, Computer science, Machine learning, Performance

November 28, 2021 by hgpu

Programming Heterogeneous Systems with General and Domain-Specific Frameworks

Lukas Sommer

View

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, Machine learning, nVidia, nVidia GeForce RTX 2070, OpenCL, OpenMP, Package, Python, Thesis

November 21, 2021 by hgpu

Performance Evaluation of Python ParallelProgramming Models: Charm4Py and mpi4py

Zane Fink, Simeng Liu, Jaemin Choi, Matthias Diener, Laxmikant V. Kale

View

Tags: Benchmarking, Computer science, CUDA, Distributed computing, HPC, Machine learning, MPI, nVidia, Package, Performance, Python, Tesla V100

November 14, 2021 by hgpu

Collage: Automated Integration of Deep Learning Backends

Byungsoo Jeon, Sunghyun Park, Peiyuan Liao, Sheng Xu, Tianqi Chen, Zhihao Jia

View

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 2070, Tesla V100

November 7, 2021 by hgpu

Optimizing a Hardware Network Stack to Realize an In-Network ML Inference Application

Marco Hartmann, Lukas Weber, Johannes Wirth, Lukas Sommer, Andreas Koch

View

Tags: Computer science, FPGA, Machine learning, Performance

November 7, 2021 by hgpu

Source-to-Source Automatic Differentiation of OpenMP Parallel Loops

Jan Hückelheim, Laurent Hascoët

View

Tags: Code generation, Computer science, Machine learning, OpenMP, Package, Performance

November 7, 2021 by hgpu

Mixed precision in Graphics Processing Unit

Quentin Gallouédec

View

Tags: Computer science, Machine learning, Mixed precision, Neural networks, nVidia, Tesla V100

October 31, 2021 by hgpu

TorchAudio: Building Blocks for Audio and Speech Processing

Yao-Yuan Yang, Moto Hira, Zhaoheng Ni, Anjali Chourdia, Artyom Astafurov, Caroline Chen, Ching-Feng Yeh, Christian Puhrsch, David Pollack, Dmitriy Genzel, Donny Greenberg, Edward Z. Yang, Jason Lian, Jay Mahadeokar, Jeff Hwang, Ji Chen, Peter Goldsborough, Prabhat Roy, Sean Narenthiran, Shinji Watanabe, Soumith Chintala, Vincent Quenneville-Bélair, Yangyang Shi

View

Tags: Computer science, Deep learning, Machine learning, nVidia, nVidia A100, Package, Python, PyTorch, Speech recognition

October 31, 2021 by hgpu

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

Nawras Alnaasan, Arpan Jain, Aamir Shafi, Hari Subramoni, Dhabaleswar K Panda

View

Tags: Benchmarking, Computer science, CUDA, Deep learning, HPC, Machine learning, MPI, nVidia, Python, Tesla V100

October 24, 2021 by hgpu

Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System

Tsung-Wei Huang, Dian-Lun Lin, Chun-Xun Lin, Yibo Lin

View

Tags: Computer science, CUDA, Heterogeneous systems, HPC, Machine learning, nVidia, nVidia GeForce GTX 2080, Package

September 26, 2021 by hgpu

An Experimental Study of SYCL Task Graph Parallelism for Large-Scale Machine Learning Workloads

Cheng-Hsiang Chiu, Dian-Lun Lin, Tsung-Wei Huang

View

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, nVidia, nVidia GeForce GTX 2080, SYCL

September 26, 2021 by hgpu

IgNet. A Super-precise Convolutional Neural Network

Igor Mackarov

View

Tags: Computer science, Machine learning, Neural networks, OpenCL

September 26, 2021 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

Analyzing the Impact of Kernel Fusion on GPU Tensor Operation Performance: A Systematic Performance Study

IntelliKit: Agent-first tooling for AMD hardware

Kerncap: Automated Kernel Extraction and Isolation for AMD GPUs

DITRON: Distributed Compiler based on Triton for Parallel Systems

DITRON: Distributed Multi-level Tiling Compiler for Parallel Tensor Programs

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

See all packages

* * *

* * *

HGPU group © 2010-2026 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: