high performance computing on graphics processing units: hgpu.org

hgpu.org » Performance

Maximizing Parallelism and GPU Utilization For Direct GPU Compilation Through Ensemble Execution

Shilei Tian, Barbara Chapman, Johannes Doerfert

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, LLVM, nVidia, nVidia A100, OpenMP, Performance

July 24, 2023 by hgpu

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Mingyu Liang, Wenyin Fu, Louis Feng, Zhongyi Lin, Pavani Panakanti, Shengbao Zheng, Srinivas Sridharan, Christina Delimitrou

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Code generation, Computer science, CUDA, nVidia, Package, Performance, PyTorch, Tesla A100, Tesla V100

July 16, 2023 by hgpu

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Pablo Antonio Martínez Sánchez

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, performance portability, Thesis

July 16, 2023 by hgpu

Safe, Seamless, And Scalable Integration Of Asynchronous GPU Streams In PETSc

Jacob Faibussowitsch, Mark F. Adams, Richard Tran Mills, Stefano Zampini, Junchao Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, Package, Performance

July 9, 2023 by hgpu

Optimization Techniques for GPU Programming

Pieter Hijma, Stijn Heldens, Alessio Sclocco, Ben van Werkhoven, Henri E. Bal

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, OpenCL, Performance, survey

July 9, 2023 by hgpu

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

View

Download (PDF)

Tags: Computer science, Deep learning, nVidia, nVidia Titan RTX, Performance, PyTorch

July 9, 2023 by hgpu

Out-of-the-box library support for DBMS operations on GPUs

Harish Kumar Harihara Subramanian, Bala Gurumurthy, Gabriel Campero Durand, David Broneske, Gunter Saake

View

Download (PDF)

Source codes

Tags: Computer science, Databases, Hashing, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia V100, OpenCL, Package, Performance

July 2, 2023 by hgpu

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

James Gleeson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 480, nVidia GeForce RTX 2080 Ti, nVidia Grid K1, Optimization, Package, Performance, Tesla V100, Thesis, Virtualization

July 2, 2023 by hgpu

Reducing branch divergence to speed up parallel execution of unit testing on GPUs

Taghreed Bagies, Wei Le, Jeremy Sheafer, Ali Jannesari

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, nVidia, Package, Performance, Tesla V100

June 18, 2023 by hgpu

GPUHarbor: Testing GPU Memory Consistency at Large

Reese Levine, Mingun Cho, Devon McKee, Andrew Quinn, Tyler Sorensen

View

Download (PDF)

Tags: AMD Radeon Pro 5500M, ATI, Computer science, Memory model, nVidia, nVidia GeForce RTX 3080, nVidia Tegra TX1, OpenCL, Performance

June 11, 2023 by hgpu

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

Igor Sfiligoi, Emily A. Belli, Jeff Candy, Reuben D. Budiardja

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, Fortran, MPI, nVidia, nVidia A100, OpenACC, Performance

May 21, 2023 by hgpu

Towards Alignment of Parallelism in SYCL and ISO C++

Simon John Pennycook, Ben Ashbaugh, James Brodman, Michael Kinsner, Steffen Larsen, Greg Lueck, Roland Schulz, Michael Voss

View

Download (PDF)

Tags: Computer science, OpenCL, Performance, SYCL

May 14, 2023 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Maximizing Parallelism and GPU Utilization For Direct GPU Compilation Through Ensemble Execution

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Safe, Seamless, And Scalable Integration Of Asynchronous GPU Streams In PETSc

Optimization Techniques for GPU Programming

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Out-of-the-box library support for DBMS operations on GPUs

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

Reducing branch divergence to speed up parallel execution of unit testing on GPUs

GPUHarbor: Testing GPU Memory Consistency at Large

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

Towards Alignment of Parallelism in SYCL and ISO C++

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)