high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

Zhengda Bian, Hongxin Liu, Boxiang Wang, Haichen Huang, Yongbin Li, Chuanrui Wang, Fan Cui, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, Deep learning, nVidia, Package, Tesla P100

October 31, 2021 by hgpu

Bolt: Bridging the Gap between Auto-tuners and Hardware-native Performance

Jiarong Xing, Leyuan Wang, Shang Zhang, Jack Chen, Ang Chen, Yibo Zhu

View

Download (PDF)

Tags: Auto-Tuning, Computer science, CUDA, Deep learning, Neural networks, nVidia, Performance, Tesla T4

October 31, 2021 by hgpu

The CoRa Tensor Compiler: Compilation for Ragged Tensors with Minimal Padding

Pratik Fegade, Tianqi Chen, Phillip B. Gibbons, Todd C. Mowry

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, nVidia, Tesla V100

October 24, 2021 by hgpu

Monitoring Collective Communication Among GPUs

Muhammet Abdullah Soyturk, Palwisha Akhtar, Erhan Tezcan, Didem Unat

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, MPI, nVidia, Package, Performance, Tesla V100

October 24, 2021 by hgpu

Principal Kernel Analysis: A Tractable Methodology to Simulate Scaled GPU Workloads

Cesar A. Baddouh, Mahmoud Khairy, Roland Green, Mathias Payer, Timothy G. Rogers

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, Performance, Tesla V100

October 24, 2021 by hgpu

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

Nawras Alnaasan, Arpan Jain, Aamir Shafi, Hari Subramoni, Dhabaleswar K Panda

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, HPC, Machine learning, MPI, nVidia, Python, Tesla V100

October 24, 2021 by hgpu

Least Squares on GPUs in Multiple Double Precision

Jan Verschelde

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Mathematical Software, nVidia, Package, Tesla P100, Tesla V100

October 24, 2021 by hgpu

Homomorphic-Encrypted Volume Rendering

Sebastian Mazza

View

Download (PDF)

Source codes

Tags: Algorithms, AMD Radeon RX 580, ATI, Computer science, GLSL, nVidia, nVidia GeForce RTX 3090, Package, Rendering, Security, Thesis, Visualization, Vulkan

October 17, 2021 by hgpu

Accelerating LBM on a Tightly-Coupled Field Programmable Gate Array

Mateo Vázquez Maceiras

View

Download (PDF)

Tags: cfd, Fluid dynamics, FPGA, HLS, Lattice Boltzmann model, OpenCL, Thesis

October 17, 2021 by hgpu

Accelerating AutoDock VINA with GPUs

Shidi Tang, Ruiqi Chen, Mengru Lin, Qingde Lin, Yanxiang Zhu, Jiansheng Wu, Haifeng Hu, Ming Ling

View

Download (PDF)

Source codes

Tags: Chemistry, Databases, Heterogeneous systems, molecular docking, nVidia, nVidia GeForce GTX 1060, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3090, OpenCL, Package

October 17, 2021 by hgpu

Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure

Martin Uray, Eduard Hirsch, Gerold Katzinger, Michael Gadermayr

View

Download (PDF)

Tags: Artificial intelligence, Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A6000

October 17, 2021 by hgpu

Artificial Intelligence in Electric Machine Drives: Advances and Trends

Shen Zhang

View

Download (PDF)

Tags: Algorithms, Artificial intelligence, Computer science, Deep learning, FPGA, nVidia, nVidia Tegra K1, Review

October 17, 2021 by hgpu

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

CONCUR: Benchmarking LLMs for Concurrent Code Generation

HIPRT: Ray Tracing using HIP

Ray Tracing using HIP

MXFP4 Training Support Codebase

Practical FP4 Training for Large-Scale MoE Models on Hopper GPUs

CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation

CUDABench: Benchmarking LLMs for Text-to-CUDA Generation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training

Bolt: Bridging the Gap between Auto-tuners and Hardware-native Performance

The CoRa Tensor Compiler: Compilation for Ragged Tensors with Minimal Padding

Monitoring Collective Communication Among GPUs

Principal Kernel Analysis: A Tractable Methodology to Simulate Scaled GPU Workloads

OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems

Least Squares on GPUs in Multiple Double Precision

Homomorphic-Encrypted Volume Rendering

Accelerating LBM on a Tightly-Coupled Field Programmable Gate Array

Accelerating AutoDock VINA with GPUs

Beyond Desktop Computation: Challenges in Scaling a GPU Infrastructure

Artificial Intelligence in Electric Machine Drives: Advances and Trends

Recent source codes

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

CONCUR: a benchmark designed to evaluate multithreaded Java code generated by LLMs

HIPRT: Ray Tracing using HIP

MXFP4 Training Support Codebase

CUDA Agent: Large-Scale Agentic RL for High-Performance CUDA Kernel Generation

CUDABench: Benchmarking LLMs for Text-to-CUDA Generation

Most viewed papers (last 30 days)