high performance computing on graphics processing units: hgpu.org

hgpu.org » Package

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

Jan Solanti, Michal Babej, Julius Ikkala, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, Distributed computing, Fluid dynamics, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A6000, OpenCL, Package, Rendering

September 6, 2023 by hgpu

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Zane Fink, Konstantinos Parasyris, Giorgis Georgakoudis, Harshitha Menon

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Code generation, Computer science, HPC, LLVM, nVidia, nVidia V100, OpenMP, Package

September 6, 2023 by hgpu

Performant low-order matrix-free finite element kernels on GPU architectures

Randolph R. Settgast, Yohann Dudouit, Nicola Castelletto, William R. Tobin, Benjamin C. Corbett, Sergey Klevtsov

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, FEM, Finite element method, Mathematics, Numerical Analysis, nVidia, nVidia A100, nVidia V100, Package, Sparse

August 28, 2023 by hgpu

Sieve: Stratified GPU-Compute Workload Sampling

Mahmood Naderan-Tahan, Hossein SeyyedAghaei, Lieven Eeckhout

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3080, Package, Performance

August 28, 2023 by hgpu

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Raúl Nozal, Jose Luis Bosque

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 5700 XT, ATI, Computer science, Heterogeneous systems, HPC, Molecular dynamics, OpenCL, OpenMP, Package, performance portability

August 28, 2023 by hgpu

Novel insights on atomic synchronization for sort-based group-by on GPUs

Bala Gurumurthy, David Broneske, Martin Schäler, Thilo Pionteck

View

Download (PDF)

Source codes

Tags: Computer science, Databases, Hashing, Heterogeneous systems, nVidia, nVidia A100, nVidia GeForce GTX 1050 Ti, nVidia GeForce RTX 2080 Ti, nVidia V100, OpenCL, Package, Sorting

August 28, 2023 by hgpu

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Phuong Nguyen, Pratik Nayak, Hartwig Anzt

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Intel, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, Package, performance portability, Physics, SYCL

August 20, 2023 by hgpu

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Hyun Park, Parth Patel, Roland Haas, E. A. Huerta

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Biology, Biomolecules, Biophysics, nVidia, nVidia A100, nVidia A40, Package

August 20, 2023 by hgpu

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Tal Kadosh, Niranjan Hasabnis, Timothy Mattson, Yuval Pinter, Gal Oren

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Fortran, HPC, MPI, nVidia, OpenACC, OpenCL, OpenMP, Package, SYCL

August 20, 2023 by hgpu

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Xinchi Han, Weihao Jiang, Peirui Cao, Qinwei Yang, Yunzhuo Liu, Shuyao Qi, Shengkai Lin, Shizhen Zhao

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Machine learning, Neural networks, nVidia, nVidia V100, Package

August 13, 2023 by hgpu

Monadic Deep Learning

Bo Yang, Zhihao Zhang Kirisame Marisa, Kai Shi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Java, Neural networks, OpenCL, Package, Scala

July 30, 2023 by hgpu

MSCCL++: A GPU-driven communication stack for scalable AI applications

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Benchmark compute shader of Unity against InteropUnityCUDA

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

* * *

high performance computing on graphics processing units: hgpu.org

Scope is all you need: Transforming LLMs for HPC Code

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Performant low-order matrix-free finite element kernels on GPU architectures

Sieve: Stratified GPU-Compute Workload Sampling

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Novel insights on atomic synchronization for sort-based group-by on GPUs

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Monadic Deep Learning

Recent source codes

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Most viewed papers (last 30 days)