high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications » Computer science

Communication-minimizing Asynchronous Tensor Parallelism

Siddharth Singh, Zack Sating, Abhinav Bhatele

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Neural networks, nVidia, nVidia A100

May 28, 2023 by hgpu

ACRoBat: Optimizing Auto-batching of Dynamic Deep Learning at Compile Time

Pratik Fegade, Tianqi Chen, Phillip B. Gibbons, Todd C. Mowry

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Deep learning, nVidia, nVidia GeForce RTX 3070

May 28, 2023 by hgpu

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Philip Salzmann, Fabian Knorr, Peter Thoman, Philipp Gschwandtner, Biagio Cosenza, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, GPU cluster, MPI, nVidia, nVidia V100, Package, SYCL

May 21, 2023 by hgpu

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Zhiyi Zhang, Pengfei Zhang, Qi Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Java, nVidia, nVidia GeForce RTX 3060 Ti, Package

May 21, 2023 by hgpu

Improving Energy Efficiency of Basic Linear Algebra Routines on Heterogeneous Systems with Multiple GPUs

Hadi Zamani Sabzi

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Energy-efficient computing, Factorization, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce GTX 1660, nVidia GeForce GTX 980, Thesis

May 21, 2023 by hgpu

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

Igor Sfiligoi, Emily A. Belli, Jeff Candy, Reuben D. Budiardja

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, Fortran, MPI, nVidia, nVidia A100, OpenACC, Performance

May 21, 2023 by hgpu

Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

Juan Fumero, György Rethy, Athanasios Stratikopoulos, Nikos Foutris, Christos Kotselidis

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Heterogeneous systems, Java, OpenCL, Package

May 21, 2023 by hgpu

Towards Alignment of Parallelism in SYCL and ISO C++

Simon John Pennycook, Ben Ashbaugh, James Brodman, Michael Kinsner, Steffen Larsen, Greg Lueck, Roland Schulz, Michael Voss

View

Download (PDF)

Tags: Computer science, OpenCL, Performance, SYCL

May 14, 2023 by hgpu

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Yueming Hao, Xu Zhao, Bin Bao, David Berard, Will Constable, Adnan Aziz, Xu Liu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Benchmarking, Computer science, Deep learning, nVidia, nVidia A100, Package, PyTorch

May 14, 2023 by hgpu

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Akash Dutta, Jordi Alcaraz, Ali TehraniJamsaz, Eduardo Cesar, Anna Sikora, Ali Jannesari

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Benchmarking, Computer science, Deep learning, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 970, OpenCL, OpenMP

May 14, 2023 by hgpu

Descend: A Safe GPU Systems Programming Language

Bastian Köpcke, Sergei Gorlatch, Michel Steuwer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, OpenCL, Package, Programming Languages, Tesla P100

May 14, 2023 by hgpu

Prediction of Performance and Power Consumption of GPGPU Applications

Gargi Alavani, Santonu Sarkar

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, Java, Machine learning, nVidia, Package, Performance, PTX, Tesla K20, Thesis

May 14, 2023 by hgpu

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Communication-minimizing Asynchronous Tensor Parallelism

ACRoBat: Optimizing Auto-batching of Dynamic Deep Learning at Compile Time

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Improving Energy Efficiency of Basic Linear Algebra Routines on Heterogeneous Systems with Multiple GPUs

Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

Towards Alignment of Parallelism in SYCL and ISO C++

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Descend: A Safe GPU Systems Programming Language

Prediction of Performance and Power Consumption of GPGPU Applications

Recent source codes

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

Most viewed papers (last 30 days)