high performance computing on graphics processing units: hgpu.org

hgpu.org » CUDA

Maximizing Parallelism and GPU Utilization For Direct GPU Compilation Through Ensemble Execution

Shilei Tian, Barbara Chapman, Johannes Doerfert

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, LLVM, nVidia, nVidia A100, OpenMP, Performance

July 24, 2023 by hgpu

Towards Intelligent Runtime Framework for Distributed Heterogeneous Systems

Polykarpos Thomadakis

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, Nuclear physics, nVidia, OpenCL, Physics, Task scheduling, Tesla V100, Thesis

July 16, 2023 by hgpu

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Mingyu Liang, Wenyin Fu, Louis Feng, Zhongyi Lin, Pavani Panakanti, Shengbao Zheng, Srinivas Sridharan, Christina Delimitrou

View

Download (PDF)

Source codes

Tags: AI, Benchmarking, Code generation, Computer science, CUDA, nVidia, Package, Performance, PyTorch, Tesla A100, Tesla V100

July 16, 2023 by hgpu

Tile-based Lightweight Integer Compression in GPU

Anil Shanbhag, Bobbi W. Yogatama, Xiangyao Yu, Samuel Madden

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia V100, Package

July 16, 2023 by hgpu

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Zhihe Zhao, Neiwen Ling, Nan Guan, Guoliang Xing

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce RTX 2060, nVidia Jetson TX2

July 16, 2023 by hgpu

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Pablo Antonio Martínez Sánchez

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, performance portability, Thesis

July 16, 2023 by hgpu

Safe, Seamless, And Scalable Integration Of Asynchronous GPU Streams In PETSc

Jacob Faibussowitsch, Mark F. Adams, Richard Tran Mills, Stefano Zampini, Junchao Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, Package, Performance

July 9, 2023 by hgpu

Optimization Techniques for GPU Programming

Pieter Hijma, Stijn Heldens, Alessio Sclocco, Ben van Werkhoven, Henri E. Bal

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, OpenCL, Performance, survey

July 9, 2023 by hgpu

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

William F. Godoy, Pedro Valero-Lara, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Benchmarking, Code generation, Computer science, CUDA, Fortran, HPC, Julia, nVidia, OpenACC, OpenMP, Package, Python

July 2, 2023 by hgpu

cuSLINK: Single-linkage Agglomerative Clustering on the GPU

Corey J. Nolet, Divye Gala, Alex Fender, Mahesh Doijade, Joe Eaton, Edward Raff, John Zedlewski, Brad Rees, Tim Oates

View

Download (PDF)

Source codes

Tags: Algorithms, Cluster analysis, Clustering, Computer science, CUDA, Hierarchical clustering, Machine learning, Nearest neighbour, nVidia, nVidia A100, nVidia DGX-1, Package

July 2, 2023 by hgpu

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

James Gleeson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 480, nVidia GeForce RTX 2080 Ti, nVidia Grid K1, Optimization, Package, Performance, Tesla V100, Thesis, Virtualization

July 2, 2023 by hgpu

Compilation and Design Space Exploration of Dataflow Programs for Heterogeneous CPU-GPU Platforms

Aurélien François Gilbert Bloch

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Design space exploration, DSP, FPGA, Heterogeneous systems, nVidia, nVidia GeForce GTX 1660, nVidia GeForce RTX 3080 Ti, Package, Thesis

June 25, 2023 by hgpu

CuPBoP-AMD: Extending CUDA to AMD Platforms

CuPBoP: Making CUDA a Portable Language

Adopter: Automated Deep Learning Optimization via DSL-based Source Code Transformation

Automated Deep Learning Optimization via DSL-Based Source Code Transformation

ROCm's implementation of Gromacs

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

Experiences with implementing Kokkos’ SYCL backend

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

SimSYCL: A SYCL Implementation Targeting Development, Debugging, Simulation and Conformance

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

94% on CIFAR-10 in 3.29 Seconds on a Single GPU

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Maximizing Parallelism and GPU Utilization For Direct GPU Compilation Through Ensemble Execution

Towards Intelligent Runtime Framework for Distributed Heterogeneous Systems

Mystique: Enabling Accurate and Scalable Generation of Production AI Benchmarks

Tile-based Lightweight Integer Compression in GPU

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Safe, Seamless, And Scalable Integration Of Asynchronous GPU Streams In PETSc

Optimization Techniques for GPU Programming

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

cuSLINK: Single-linkage Agglomerative Clustering on the GPU

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

Compilation and Design Space Exploration of Dataflow Programs for Heterogeneous CPU-GPU Platforms

Recent source codes

CuPBoP-AMD: Extending CUDA to AMD Platforms

Adopter: Automated Deep Learning Optimization via DSL-based Source Code Transformation

ROCm's implementation of Gromacs

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

GPU plugin for PySCF

QArray

Celerity: High-level C++ for Accelerator Clusters

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

Most viewed papers (last 30 days)