high performance computing on graphics processing units: hgpu.org

hgpu.org » PyTorch

Home-made Diffusion Model from Scratch to Hatch

Shih-Ying Yeh

View

Download (PDF)

Source codes

Tags: Computer science, Computer vision, nVidia, nVidia GeForce RTX 5090, Package, Python, PyTorch

September 14, 2025 by hgpu

Managing Multi Instance GPUs for High Throughput and Energy Savings

Abhijeet Saraha, Yuanbo Li, Chris Porter, Santosh Pande

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, LLM, nVidia, nVidia A100, PyTorch, Security

September 7, 2025 by hgpu

Accelerating a Linear Programming Algorithm on AMD GPUs

Xiyan Hu, Titus Parker, Connor Phillips, Yifa Yu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, AMD Radeon Instinct MI325X, ATI, Computer science, HIP, nVidia, nVidia A100, Package, Performance, PyTorch, ROCm, Thesis

August 31, 2025 by hgpu

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Jiarong Xing, Yifan Qiao, Simon Mo, Xingqi Cui, Gur-Eyal Sela, Yang Zhou, Joseph Gonzalez, Ion Stoica

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Performance, PyTorch

August 24, 2025 by hgpu

LIFT: LLM-Based Pragma Insertion for HLS via GNN Supervised Fine-Tuning

Neha Prakriya, Zijian Ding, Yizhou Sun, Jason Cong

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, ATI, Computer science, FPGA, HLS, LLM, Machine learning, Neural networks, PyTorch

May 4, 2025 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

Weijie Lv, Xuan Xia, Sheng-Jun Huang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Python, PyTorch

April 27, 2025 by hgpu

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

Dimitar Mileski, Nikola Petrovski, Marjan Gusev

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, LLM, nVidia, nVidia A100, PTX, PyTorch

April 13, 2025 by hgpu

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch

Abhishek Ghosh, Ajay Nayak, Ashish Panwar, Arkaprava Basu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Machine learning, nVidia, nVidia RTX A6000, PyTorch

March 30, 2025 by hgpu

KernelBench: Can LLMs Write Efficient GPU Kernels?

Anne Ouyang, Simon Guo, Simran Arora, Alex L. Zhang, William Hu, Christopher Ré, Azalia Mirhoseini

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia L40s, Package, PyTorch

February 24, 2025 by hgpu

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Download (PDF)

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

Ruijun Feng, Hammond Pearce, Pietro Liguori, Yulei Sui

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Python, PyTorch, Security

January 13, 2025 by hgpu

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Jiaping Wang, Simiao Zhang, Qiao-Chu He, Yifan Chen

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia A100, nVidia RTX A6000, Package, Python, PyTorch

January 13, 2025 by hgpu

Towards Robust Agentic CUDA Kernel Benchmarking, Verification, and Optimization

HPC Benchmark Survey

An HPC Benchmark Survey and Taxonomy for Characterization

HDM: Home made Diffusion Models

Home-made Diffusion Model from Scratch to Hatch

General Matrix Multiplication (GEMM)

High Performance Matrix Multiplication

CrossTL: Universal Programming Language & Translator

CrossTL: A Universal Programming Language Translator with Unified Intermediate Representation

TBD-GPU

Harnessing Batched BLAS/LAPACK Kernels on GPUs for Parallel Solutions of Block Tridiagonal Systems

DG-SWEM - The Discontinuous Galerkin Shallow Water Equation Model

GPU-acceleration of the Discontinuous Galerkin Shallow Water Equations Solver (DG-SWEM) using CUDA and OpenACC

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Home-made Diffusion Model from Scratch to Hatch

Managing Multi Instance GPUs for High Throughput and Energy Savings

Accelerating a Linear Programming Algorithm on AMD GPUs

Towards Efficient and Practical GPU Multitasking in the Era of LLM

LIFT: LLM-Based Pragma Insertion for HLS via GNN Supervised Fine-Tuning

Data-efficient LLM Fine-tuning for Code Generation

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

PyGraph: Robust Compiler Support for CUDA Graphs in PyTorch

KernelBench: Can LLMs Write Efficient GPU Kernels?

Profiling Apple Silicon Performance for ML Training

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

LeetDecoding: A PyTorch Library for Exponentially Decaying Causal Linear Attention with CUDA Implementations

Recent source codes

TRUST: a thermalhydraulic software package for CFD simulations

Modular: The Modular Platform (includes MAX & Mojo)

Allo: Accelerator Design Language

Towards Robust Agentic CUDA Kernel Benchmarking, Verification, and Optimization

HPC Benchmark Survey

HDM: Home made Diffusion Models

General Matrix Multiplication (GEMM)

CrossTL: Universal Programming Language & Translator

TBD-GPU

DG-SWEM - The Discontinuous Galerkin Shallow Water Equation Model

Most viewed papers (last 30 days)