high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming » CUDA

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

Ruixin Wang, Minghai Lu, Cody Hao Yu, Yi-Hsiang Lai, Tianyi Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, DSL, nVidia, Package, Performance, PyTorch, Tesla T4

May 12, 2024 by hgpu

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

Eishi Arima, Minjoon Kang, Issa Saba, Josef Weidendorfer, Carsten Trinitis, Martin Schulz

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, Performance

May 12, 2024 by hgpu

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

Junjie Li, Yinzhi Wang, Xiao Liang, Hang Liu

View

Download (PDF)

Tags: BLAS, Chemistry, CUDA, nVidia, nVidia GH200, nVidia H100, Performance, Physics

May 5, 2024 by hgpu

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

Feng Liang, Zhen Zhang, Haifeng Lu, Victor C. M. Leung, Yanyi Guo, Xiping Hu

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, nVidia, nVidia A100, survey, Task scheduling

April 21, 2024 by hgpu

Python-Based Quantum Chemistry Calculations with GPU Acceleration

Xiaojie Wu, Qiming Sun, Zhichen Pu, Tianze Zheng, Wenzhi Ma, Wen Yan, Xia Yu, Zhengxiao Wu, Mian Huo, Xiang Li, Weiluo Ren, Sheng Gong, Yumin Zhang, Weihao Gao

View

Download (PDF)

Source codes

Tags: Chemical Physics, Chemistry, Computational Physics, CUDA, nVidia, nVidia A100, Package, Python, Quantum Physics

April 21, 2024 by hgpu

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

Erik D. Huckvale, Hunter N.B. Moseley

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, Package, Performance, Profiling, Python

April 7, 2024 by hgpu

Using Intel oneAPI for Multi-hybrid Acceleration Programming with GPU and FPGA Coupling

Wentao Liang, Norihisa Fujita, Ryohei Kobayashi, Taisuke Boku

View

Download (PDF)

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, nVidia, oneAPI, OpenCL, SYCL, Tesla V100

April 7, 2024 by hgpu

Retargeting and Respecializing GPU Workloads for Performance Portability

Ivan R. Ivanov, Oleksandr Zinenko, Jens Domke, Toshio Endo, William S. Moses

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, AMD Radeon RX 6800, ATI, Computer science, CUDA, HIP, HPC, nVidia, nVidia A100, nVidia RTX A4000, Package, performance portability

March 24, 2024 by hgpu

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

John Tramm, Paul Romano, Patrick Shriwise, Amanda Lund, Johannes Doerfert, Patrick Steinbrecher, Andrew Siegel, Gavin Ridley

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Intel, Intel Data Center GPU Max 1550, Intel Ponte Vecchio Max 1100, nVidia, nVidia A100, OpenMP, Package, performance portability

March 24, 2024 by hgpu

Parallel Gaussian process with kernel approximation in CUDA

Davide Carminati

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Linear Algebra, nVidia, nVidia GeForce GTX 1050, nVidia GeForce RTX 2080, Package

March 24, 2024 by hgpu

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality

Adrian Perez Dieguez, Min Choi, Mahmut Okyay, Mauro Del Ben, Bryan M. Wong, Khaled Z. Ibrahim

View

Download (PDF)

Tags: Computer science, CUDA, HPC, MPI, nVidia, nVidia A100, OpenMP, Performance

March 18, 2024 by hgpu

Fast Truncated SVD of Sparse and Dense Matrices on Graphics Processors

Andres E. Tomas, Enrique S. Quintana-Orti, Hartwig Anzt

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Linear Algebra, nVidia, nVidia A100

March 18, 2024 by hgpu

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Tilus: A Tile-Level GPGPU Programming Language for Low-Precision Computation

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

BoltzGen:Toward Universal Binder Design

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

MATLAB Tensor Core models

Accurate Models of NVIDIA Tensor Cores

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

Python-Based Quantum Chemistry Calculations with GPU Acceleration

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

Using Intel oneAPI for Multi-hybrid Acceleration Programming with GPU and FPGA Coupling

Retargeting and Respecializing GPU Workloads for Performance Portability

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

Parallel Gaussian process with kernel approximation in CUDA

Cost-Effective Methodology for Complex Tuning Searches in HPC: Navigating Interdependencies and Dimensionality

Fast Truncated SVD of Sparse and Dense Matrices on Graphics Processors

Recent source codes

SeedFold: Scaling Biomolecular Structure Prediction

Tilus: A Tile-Level GPU Kernel Programming Language

Memory-Efficient Acceleration of Block Low-Rank Foundation Models on Resource Constrained GPUs

CUDA-L2: Surpassing cuBLAS Performance for Matrix Multiplication through Reinforcement Learning

BoltzGen:Toward Universal Binder Design

cuPilot: A Strategy-Coordinated Multi-agent Framework for CUDA Kernel Evolution

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

Most viewed papers (last 30 days)