high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Query Processing on Tensor Computation Runtimes

Dong He, Supun Nakandala, Dalitso Banda, Rathijit Sen, Karla Saur, Kwanghyun Park, Carlo Curino, Jesús Camacho-Rodríguez, Konstantinos Karanasos, Matteo Interlandi

View

Download (PDF)

Source codes

Tags: Benchmarking, Cloud, Computer science, CUDA, Databases, Machine learning, nVidia, Package, Tesla P100

March 6, 2022 by hgpu

FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours

Shenggan Cheng, Ruidong Wu, Zhongming Yu, Binrui Li, Xiwen Zhang, Jian Peng, Yang You

View

Download (PDF)

Source codes

Tags: Biology, Computer science, CUDA, Machine learning, nVidia, nVidia A100, Package

March 6, 2022 by hgpu

Enabling On-Device Smartphone GPU based Training: Lessons Learned

Anish Das, Young D. Kwon, Jagmohan Chauhan, Cecilia Mascolo

View

Download (PDF)

Tags: Computer science, Deep learning, Neural networks, OpenCL

March 6, 2022 by hgpu

gLBM: A GPU enabled Lattice Boltzmann Method Library

Aaron Bray, Rachel B. Clipp, M. Umar Qureshi, Sorin Mitran, Andinet Enquobahrie

View

Download (PDF)

Source codes

Tags: cfd, CUDA, Fluid dynamics, Lattice Boltzmann model, nVidia, Package

February 20, 2022 by hgpu

A ML-based resource utilization OpenCL GPU-kernel fusion model

Usman Ahmed, Jerry Chun-Wei Lin, Gautam Srivastava

View

Download (PDF)

Tags: Computer science, Data parallelism, HPC, Machine learning, nVidia, nVidia GeForce GT 740 M, nVidia GeForce GTX 760, OpenCL

February 20, 2022 by hgpu

A Comprehensive Benchmark of Deep Learning Libraries on Mobile Devices

Qiyang Zhang, Xiang Li, Xiangying Che, Xiao Ma, Ao Zhou, Mengwei Xu, Shangguang Wang, Yun Ma, Xuanzhe Liu

View

Download (PDF)

Source codes

Tags: ARM, Benchmarking, Computer science, Deep learning, OpenCL, OpenGL, Vulkan

February 20, 2022 by hgpu

Lightning: Scaling the GPU Programming Model Beyond a Single GPU

Stijn Heldens, Pieter Hijma, Ben van Werkhoven, Jason Maassen, Rob V. van Nieuwpoort

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Distributed computing, nVidia, OpenCL, Package, Performance, Tesla P100

February 20, 2022 by hgpu

Electrical-Level Attacks on CPUs, FPGAs, and GPUs: Survey and Implications in the Heterogeneous Era

Dina G. Mahmoud, Vincent Lenders, Mirjana Stojilović

View

Download (PDF)

Tags: Computer science, FPGA, Heterogeneous systems, Security, survey

February 13, 2022 by hgpu

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

August Ernstsson

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, High-level Languages, nVidia, OpenCL, Tesla K20, Thesis

February 13, 2022 by hgpu

The Ecological Footprint of Neural Machine Translation Systems

Dimitar Sherionov, Eva Vanmassenhove

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Deep learning, LSTM, NLP, nVidia, nVidia GeForce GTX 1080 Ti, Package, Tesla P100

February 13, 2022 by hgpu

Improving Loop Parallelization by a Combination of Static and Dynamic Analyses in HLS

Florian Dewald, Johanna Rohde, Christian Hochberger, Heiko Mantel

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, HLS, Package

February 13, 2022 by hgpu

FC_ACCEL: Enabling Efficient, Low-Latency and Flexible Inference in DNN Fully Connected Layers, using Optimized Checkerboard Block matrix decomposition, fast scheduling, and a resource efficient 1D PE array with a custom HBM2 memory subsystem

Nick Iliev, Amit R Trivedi

View

Download (PDF)

Tags: CNN, Computer science, Deep learning, FPGA, Matrix decomposition, Neural networks, nVidia, nVidia Jetson AGX Xavier, Performance

February 13, 2022 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours

Enabling On-Device Smartphone GPU based Training: Lessons Learned

gLBM: A GPU enabled Lattice Boltzmann Method Library

A ML-based resource utilization OpenCL GPU-kernel fusion model

A Comprehensive Benchmark of Deep Learning Libraries on Mobile Devices

Lightning: Scaling the GPU Programming Model Beyond a Single GPU

Electrical-Level Attacks on CPUs, FPGAs, and GPUs: Survey and Implications in the Heterogeneous Era

Pattern-based Programming Abstractions for Heterogeneous Parallel Computing

The Ecological Footprint of Neural Machine Translation Systems

Improving Loop Parallelization by a Combination of Static and Dynamic Analyses in HLS

FC_ACCEL: Enabling Efficient, Low-Latency and Flexible Inference in DNN Fully Connected Layers, using Optimized Checkerboard Block matrix decomposition, fast scheduling, and a resource efficient 1D PE array with a custom HBM2 memory subsystem

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Agentic Code Optimization via Compiler-LLM Cooperation

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

Most viewed papers (last 30 days)