high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Saghar Irandoust, Thibaut Durand, Yunduz Rakhmangulova, Wenjie Zi, Hossein Hajimirsadeghi

View

Download (PDF)

Tags: Benchmarking, Computer science, Computer vision, Deep learning

November 20, 2022 by hgpu

Hardware Checkpointing and Productive Debugging Flows for FPGAs

Sameh Attia

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, Package, Thesis

November 20, 2022 by hgpu

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Maria Nektaria Xekalaki

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, FPGA, Heterogeneous systems, Java, nVidia, nVidia GeForce GTX 1060, nVidia Quadro GP100, OpenCL, Package, Performance, Tesla V100, Thesis

November 20, 2022 by hgpu

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

Richard Schoonhoven, Bram Veenboer, Ben van Werkhoven, Kees Joost Batenburg

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, nVidia, nVidia RTX A4000, OpenCL, Package, Tesla A100

November 20, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

Capturing the Memory Topology of GPUs

Dominik Größler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce 840 M, nVidia GeForce RTX 2080 Ti, nVidia Quadro P 6000, Package, Performance, PTX, Tesla K20, Tesla V100, Thesis

November 13, 2022 by hgpu

A Study on Neural-based Code Summarization in Low-resource Settings

Yang He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, PyTorch, Software Engineering, Tesla V100, Thesis

November 13, 2022 by hgpu

pyGSL: A Graph Structure Learning Toolkit

Max Wasserman, Gonzalo Mateos

View

Download (PDF)

Source codes

Tags: Computer science, Machine learning, Package, PyTorch, Signal processing

November 13, 2022 by hgpu

Multi-GPU thermal lattice Boltzmann simulations using OpenACC and MPI

Ao Xu, Bo-Tao Li

View

Download (PDF)

Tags: cfd, Fluid dynamics, Lattice Boltzmann model, MPI, OpenACC

November 13, 2022 by hgpu

iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

Fei Xu, Jianian Xu, Jiabin Chen, Li Chen, Ruitao Shang, Zhi Zhou, Fangming Liu

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Neural networks, nVidia, Package, Tesla V100

November 13, 2022 by hgpu

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

Guyue Huang, Yang Bai, Liu Liu, Yuke Wang, Bei Yu, Yufei Ding, Yuan Xie

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100

November 6, 2022 by hgpu

Using scheduling entropy amplification in CUDA/OpenMP code to exhibit non-reproducibility issues

David Defour

View

Download (PDF)

Tags: Computer science, CUDA, Floating point error, nVidia, nVidia GeForce RTX 2060, OpenMP

November 6, 2022 by hgpu

MATLAB Tensor Core models

Accurate Models of NVIDIA Tensor Cores

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

An MLIR pipeline for offloading Fortran to FPGAs via OpenMP

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Hardware Checkpointing and Productive Debugging Flows for FPGAs

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

TorchOpt: An Efficient Library for Differentiable Optimization

Capturing the Memory Topology of GPUs

A Study on Neural-based Code Summarization in Low-resource Settings

pyGSL: A Graph Structure Learning Toolkit

Multi-GPU thermal lattice Boltzmann simulations using OpenACC and MPI

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

Using scheduling entropy amplification in CUDA/OpenMP code to exhibit non-reproducibility issues

Recent source codes

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

hls4ml: Machine learning on FPGAs using HLS

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

Most viewed papers (last 30 days)