high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

Importance of Data Loading Pipeline in Training Deep Neural Networks

Mahdi Zolnouri, Xinlin Li, Vahid Partovi Nia

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce GTX Titan, Package, Tesla V100

May 10, 2020 by hgpu

Synergistic CPU-FPGA Acceleration of Sparse Linear Algebra

Mohammadreza Soltaniyeh, Richard P. Martin, Santosh Nagarakatte

View

Download (PDF)

Tags: Computer science, Factorization, FPGA, HLS, Linear Algebra, Matrix multiplication, OpenCL, Sparse

May 10, 2020 by hgpu

Accurate Energy and Performance Prediction for Frequency-Scaled GPU Kernels

Kaijie Fan, Biagio Cosenza, Ben Juurlink

View

Download (PDF)

Tags: Computer science, Energy-efficient computing, Machine learning, nVidia, nVidia GeForce GTX Titan X, OpenCL, Performance, Tesla P100

May 10, 2020 by hgpu

Pushing the limit of molecular dynamics with ab initio accuracy to 100 million atoms with machine learning

Weile Jia, Han Wang, Mohan Chen, Denghui Lu, Jiduan Liu, Lin Lin, Roberto Car, Weinan E, Linfeng Zhang

View

Download (PDF)

Tags: Computational Physics, CUDA, HPC, Machine learning, Mixed precision, Molecular dynamics, Molecular simulation, MPI, nVidia, OpenMP, Physics, Tesla V100

May 10, 2020 by hgpu

An Overview on the Latest Nature-Inspired and Metaheuristics-Based Image Registration Algorithms

J. Santamaría, M. L. Rivero-Cejudo, M. A. Martos-Fernández, F. Roca

View

Download (PDF)

Tags: Computer science, Computer vision, Evolutionary Computations, Image registration, Metaheuristics, Neural and Evolutionary Computing, Overview

May 4, 2020 by hgpu

Tools for GPU Computing – Debugging and Performance Analysis of Heterogenous HPC Applications

Michael Knobloch, Bernd Mohr

View

Download (PDF)

Tags: Computer science, CUDA, HPC, nVidia, OpenACC, OpenCL, Performance

May 3, 2020 by hgpu

AutoParBench: A Unified Test Framework for OpenMP-based Parallelizers

Gleison Souza Diniz Mendonça, Chunhua Liao, Fernando Magno Quintão Pereira

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, OpenMP, Package

May 3, 2020 by hgpu

Leveraging Data-Flow Information for Efficient Scheduling of Task-Parallel Programs on Heterogeneous Systems

Osman Seckin Simsek

View

Download (PDF)

Tags: Computer science, FPGA, Heterogeneous systems, nVidia, nVidia GeForce GTX Titan V, OpenCL, performance portability, Tesla K20, Thesis

May 3, 2020 by hgpu

Tools for Reduced Precision Computation: A Survey

Stefano Cherubin, Giovanni Agosta

View

Download (PDF)

Tags: Approximate computing and storage, Computer science, CUDA, HPC, Mixed precision, nVidia, OpenCL, Precision, survey

May 3, 2020 by hgpu

86 PFLOPS Deep Potential Molecular Dynamics simulation of 100 million atoms with ab initio accuracy

Denghui Lu, Han Wang, Mohan Chen, Jiduan Liu, Lin Lin, Roberto Car, Weinan E, Weile Jia, Linfeng Zhang

View

Download (PDF)

Source codes

Tags: Computational Physics, CUDA, Heterogeneous systems, Molecular dynamics, Neural networks, nVidia, Package, Physics, Python, Tesla V100

May 3, 2020 by hgpu

cuda-kat: The CUDA Kernel Author’s Toolkit

Eyal Rozenberg

View

Download (PDF)

Tags: cpp, CUDA, library, nVidia, Package

May 2, 2020 by epk

Automatic Parallelization for Heterogeneous Embedded Systems

Rokiatou Diarra

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, nVidia, nVidia Quadro M 2000 M, nVidia Tegra TX1, OpenACC, OpenCL, Thesis

April 26, 2020 by hgpu

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Importance of Data Loading Pipeline in Training Deep Neural Networks

Synergistic CPU-FPGA Acceleration of Sparse Linear Algebra

Accurate Energy and Performance Prediction for Frequency-Scaled GPU Kernels

Pushing the limit of molecular dynamics with ab initio accuracy to 100 million atoms with machine learning

An Overview on the Latest Nature-Inspired and Metaheuristics-Based Image Registration Algorithms

Tools for GPU Computing – Debugging and Performance Analysis of Heterogenous HPC Applications

AutoParBench: A Unified Test Framework for OpenMP-based Parallelizers

Leveraging Data-Flow Information for Efficient Scheduling of Task-Parallel Programs on Heterogeneous Systems

Tools for Reduced Precision Computation: A Survey

86 PFLOPS Deep Potential Molecular Dynamics simulation of 100 million atoms with ab initio accuracy

cuda-kat: The CUDA Kernel Author’s Toolkit

Automatic Parallelization for Heterogeneous Embedded Systems

Recent source codes

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

Most viewed papers (last 30 days)