high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Implementation Techniques for SPMD Kernels on CPUs

Joachim Meyer, Aksel Alpay, Sebastian Hack, Holger Fröning, Vincent Heuveline

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL, Package, performance portability

June 4, 2023 by hgpu

Genomics-GPU: A Benchmark Suite for GPU-accelerated Genome Analysis

Zhuren Liu, Shouzhe Zhang, Justin Garrigus, Hui Zhao

View

Download (PDF)

Source codes

Tags: Benchmarking, Bioinformatics, Biology, Computer science, CUDA, Genomics, nVidia, nVidia GeForce RTX 3070, Package

May 28, 2023 by hgpu

Experiences Migrating CUDA to SYCL: A Molecular Docking Case Study

Leonardo Solis-Vasquez, Edward Mascarenhas, Andreas Koch

View

Download (PDF)

Source codes

Tags: Chemistry, Computer science, CUDA, molecular docking, nVidia, nVidia A100, oneAPI, Package, SYCL

May 28, 2023 by hgpu

Communication-minimizing Asynchronous Tensor Parallelism

Siddharth Singh, Zack Sating, Abhinav Bhatele

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Neural networks, nVidia, nVidia A100

May 28, 2023 by hgpu

ACRoBat: Optimizing Auto-batching of Dynamic Deep Learning at Compile Time

Pratik Fegade, Tianqi Chen, Phillip B. Gibbons, Todd C. Mowry

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Deep learning, nVidia, nVidia GeForce RTX 3070

May 28, 2023 by hgpu

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Philip Salzmann, Fabian Knorr, Peter Thoman, Philipp Gschwandtner, Biagio Cosenza, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, GPU cluster, MPI, nVidia, nVidia V100, Package, SYCL

May 21, 2023 by hgpu

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Zhiyi Zhang, Pengfei Zhang, Qi Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Java, nVidia, nVidia GeForce RTX 3060 Ti, Package

May 21, 2023 by hgpu

Improving Energy Efficiency of Basic Linear Algebra Routines on Heterogeneous Systems with Multiple GPUs

Hadi Zamani Sabzi

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Energy-efficient computing, Factorization, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce GTX 1660, nVidia GeForce GTX 980, Thesis

May 21, 2023 by hgpu

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

Igor Sfiligoi, Emily A. Belli, Jeff Candy, Reuben D. Budiardja

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, Fortran, MPI, nVidia, nVidia A100, OpenACC, Performance

May 21, 2023 by hgpu

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Yueming Hao, Xu Zhao, Bin Bao, David Berard, Will Constable, Adnan Aziz, Xu Liu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Benchmarking, Computer science, Deep learning, nVidia, nVidia A100, Package, PyTorch

May 14, 2023 by hgpu

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Akash Dutta, Jordi Alcaraz, Ali TehraniJamsaz, Eduardo Cesar, Anna Sikora, Ali Jannesari

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Benchmarking, Computer science, Deep learning, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 970, OpenCL, OpenMP

May 14, 2023 by hgpu

Descend: A Safe GPU Systems Programming Language

Bastian Köpcke, Sergei Gorlatch, Michel Steuwer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, OpenCL, Package, Programming Languages, Tesla P100

May 14, 2023 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Implementation Techniques for SPMD Kernels on CPUs

Genomics-GPU: A Benchmark Suite for GPU-accelerated Genome Analysis

Experiences Migrating CUDA to SYCL: A Molecular Docking Case Study

Communication-minimizing Asynchronous Tensor Parallelism

ACRoBat: Optimizing Auto-batching of Dynamic Deep Learning at Compile Time

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Improving Energy Efficiency of Basic Linear Algebra Routines on Heterogeneous Systems with Multiple GPUs

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Descend: A Safe GPU Systems Programming Language

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)