high performance computing on graphics processing units: hgpu.org

hgpu.org » CUDA

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour

Priya Goyal, Piotr Dollar, Ross Girshick, Pieter Noordhuis, Lukasz Wesolowski, Aapo Kyrola, Andrew Tulloch, Yangqing Jia, Kaiming He

View

Download (PDF)

Source codes

Tags: Computer science, Computer vision, CUDA, Deep learning, Neural networks, nVidia, Package, Tesla P100

June 10, 2017 by hgpu

CELES: CUDA-accelerated simulation of electromagnetic scattering by large ensembles of spheres

Amos Egel, Lorenzo Pattelli, Giacomo Mazzamuto, Diederik S. Wiersma, Uli Lemmer

View

Download (PDF)

Source codes

Tags: Computational Physics, CUDA, Matlab, nVidia, nVidia GeForce GTX 980 Ti, nVidia GeForce GTX Titan X, Optics, Package, Physics

June 10, 2017 by hgpu

MobiRNN: Efficient Recurrent Neural Network Execution on Mobile GPU

Qingqing Cao, Niranjan Balasubramanian, Aruna Balasubramanian

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Java, Neural networks, nVidia, Package, RNN, TensorFlow

June 10, 2017 by hgpu

A Diversified Multi-Start Algorithm for Unconstrained Binary Quadratic Problems Leveraging the Graphics Processor Unit

Mark W. Lewis

View

Download (PDF)

Tags: Algorithms, Artificial intelligence, Benchmarking, Computer science, CUDA, Metaheuristics, nVidia, nVidia GeForce GTS 780 Ti

June 5, 2017 by hgpu

Fast MPEG-CDVS Encoder with GPU-CPU Hybrid Computing

Lingyu Duan, Wei Sun, Xinfeng Zhang, Jie Chen, Jianxiong Yin, Simon See, Tiejun Huang, Alex C. Kot, Wen Gao

View

Download (PDF)

Tags: Benchmarking, CUDA, Hybrid computing, Image processing, Neural networks, nVidia, nVidia GeForce GTX 1060, nVidia GeForce GTX 1080, nVidia GeForce GTX 1080 Ti, nVidia Tegra TX1, Tesla M40

June 1, 2017 by hgpu

Optimizing Memory Efficiency for Convolution Kernels on Kepler GPUs

Xiaoming Chen, Jianxu Chen, Danny Z. Chen, Xiaobo Sharon Hu

View

Download (PDF)

Tags: CNN, Computer science, Computer vision, CUDA, Deep learning, Neural networks, nVidia, Tesla K40

June 1, 2017 by hgpu

A Unified Optimization Approach for Sparse Tensor Operations on GPUs

Bangtian Liu, Chengyao Wen, Anand D.Sarwate, Maryam Mehri Dehnavi

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Linear Algebra, Mathematical Software, nVidia, nVidia GeForce GTX Titan X, Sparse matrix

June 1, 2017 by hgpu

Implementing Efficient, Portable Computations for Machine Learning

Matthew Walter Moskewicz

View

Download (PDF)

Source codes

Tags: Algorithms, AMD R9 Nano, ATI, Computer science, Computer vision, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX Titan X, OpenCL, Package, Thesis

May 24, 2017 by hgpu

Parallel and in-process compilation of individuals for genetic programming on GPU

Hakan Ayral, Songul Albayrak

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Genetic programming, nVidia, nVidia GRID K520, Operating systems, Package

May 24, 2017 by hgpu

Espresso: Efficient Forward Propagation for BCNNs

Fabrizio Pedersoli, George Tzanetakis, Andrea Tagliasacchi

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce GTX 960

May 24, 2017 by hgpu

GPUMap: A Transparently GPU-Accelerated Map Function

Ivan Pachev

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Java, MapReduce, nVidia, nVidia GeForce GTX 980, Python, Thesis

May 22, 2017 by hgpu

MEDINA: MECCA Development in Accelerators – KPP Fortran to CUDA source-to-source Preprocessor

Michail Alvanos, Theodoros Christoudias

View

Download (PDF)

Source codes

Tags: Chemistry, Compilers, Computer science, CUDA, Fortran, nVidia, Package, Python

May 22, 2017 by hgpu

CUDAnalyst (CUDA + Analyst)

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

CodegenBench

CodegenBench: Can LLMs Write Efficient Code Across Architectures?

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour

CELES: CUDA-accelerated simulation of electromagnetic scattering by large ensembles of spheres

MobiRNN: Efficient Recurrent Neural Network Execution on Mobile GPU

A Diversified Multi-Start Algorithm for Unconstrained Binary Quadratic Problems Leveraging the Graphics Processor Unit

Fast MPEG-CDVS Encoder with GPU-CPU Hybrid Computing

Optimizing Memory Efficiency for Convolution Kernels on Kepler GPUs

A Unified Optimization Approach for Sparse Tensor Operations on GPUs

Implementing Efficient, Portable Computations for Machine Learning

Parallel and in-process compilation of individuals for genetic programming on GPU

Espresso: Efficient Forward Propagation for BCNNs

GPUMap: A Transparently GPU-Accelerated Map Function

MEDINA: MECCA Development in Accelerators – KPP Fortran to CUDA source-to-source Preprocessor

Recent source codes

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Device Virtual Machine (DVM)

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

Most viewed papers (last 30 days)