high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications » Computer science

Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs

Bowen Tan, Yun Zhu, Lijuan Liu, Hongyi Wang, Yonghao Zhuang, Jindong Chen, Eric Xing, Zhiting Hu

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Distributed computing, nVidia, nVidia A100, Package, TPU

November 5, 2023 by hgpu

OpenRAND: A Performance Portable, Reproducible Random Number Generation Library for Parallel Computations

Shihab Shahriar Khan, Bryce Palmer, Christopher Edelmaierd, Hasan Metin Aktulga

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, HPC, nVidia, nVidia A100, Package, Pseudo-random number generators, Tesla V100

November 5, 2023 by hgpu

Performance portability evaluation of blocked stencil computations on GPUs

Oscar Antepara, Hans Johansen, Samuel Williams, Tuowen Zhao, Samantha Hirsch, Priya Goyal, Mary Hall

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Code generation, Computer science, CUDA, HIP, nVidia, nVidia A100, Package, performance portability, Stencil computation, SYCL

October 29, 2023 by hgpu

SYCL in the Edge: Performance Evaluation for Heterogeneous Acceleration

Youssef Faqir-Rhazoui, Carlos García

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, nVidia, nVidia Jetson Nano, Optical flow, Package, SYCL

October 22, 2023 by hgpu

Strega: An HTTP Server for FPGAs

Fabio Maschi, Gustavo Alonso

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, OpenCL, Package

October 15, 2023 by hgpu

Comparison of different n-body algorithms on various hardware platforms using SYCL

Tim Thüring

View

Download (PDF)

Source codes

Tags: AMD Radeon Pro VII, Astrophysics, ATI, Computer science, N-body simulation, nVidia, nVidia A100, nVidia GeForce RTX 3090, nVidia Quadro GP100, Package, Physics, SYCL, Thesis

October 15, 2023 by hgpu

Open SYCL on heterogeneous GPU systems: A case of study

Rocío Carratalá-Sáez, Francisco J. andújar, Yuri Torres, Arturo Gonzalez-Escribano, Diego R. Llanos

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, HIP, nVidia, Package, performance portability, SYCL

October 15, 2023 by hgpu

Fortran performance optimisation and auto-parallelisation by leveraging MLIR-based domain specific abstractions in Flang

Nick Brown, Maurice Jamieson, Anton Lydike, Emilien Bauer, Tobias Grosser

View

Download (PDF)

Source codes

Tags: Computer science, Fortran, HPC, LLVM, MPI, nVidia, Package, Performance, Tesla V100

October 8, 2023 by hgpu

Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

Xinzhe Wu, Edoardo Di Napoli

View

Download (PDF)

Source codes

Tags: Algorithm optimization, Computer science, CUDA, MPI, nVidia, nVidia A100, OpenMP, OpenMPI, Package

October 8, 2023 by hgpu

Automated Buffer Sizing of Dataflow Applications in a High-Level Synthesis Workflow

Alexandre Honorat, Mickaël Dardaillon, Hugo Miomandre, Jean-François Nezan

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, FPGA, HLS, OpenCL, Package, Performance

October 8, 2023 by hgpu

Beehive SPIR-V Toolkit: A Composable and Functional API for Runtime SPIR-V Code Generation

Juan Fumero Alfonso, György Rethy, Athanasios Stratikopoulos, Nikolaos Foutris, Christos-Efthymios Kotselidis

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Heterogeneous systems, Java, OpenCL, Package

October 1, 2023 by hgpu

Julia as a unifying end-to-end workflow language on the Frontier exascale system

William F. Godoy, Pedro Valero-Lara, Caira Anderson, Katrina W. Lee, Ana Gainaru, Rafael Ferreira da Silva, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Computer science, HIP, HPC, Julia, MPI, Package

September 24, 2023 by hgpu

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Genten: Software for Generalized Tensor Decompositions by Sandia National Laboratories

A Performance Portable Matrix Free Dense MTTKRP in GenTen

Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR

Pinocchio: PINpointing Orbit Crossing Collapsed Hierarchical Objects

Accelerating cosmological simulations on GPUs: a portable approach using OpenMP

KernelCoder: trained on a curated dataset of reasoning traces and CUDA kernel pairs

ConCuR: Conciseness Makes State-of-the-Art Kernel Generation

VibeCodeHPC - Multi Agentic Vibe Coding for HPC

VibeCodeHPC: An Agent-Based Iterative Prompting Auto-Tuner for HPC Code Generation Using LLMs

Compile-Time Resource Safety for GPU APIs: A Low-Overhead Typestate Framework

exa-AMD: Exascale Accelerated Materials Discovery

exa-AMD: An Exascale-Ready Framework for Accelerating the Discovery and Design of Functional Materials

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs

OpenRAND: A Performance Portable, Reproducible Random Number Generation Library for Parallel Computations

Performance portability evaluation of blocked stencil computations on GPUs

SYCL in the Edge: Performance Evaluation for Heterogeneous Acceleration

Strega: An HTTP Server for FPGAs

Comparison of different n-body algorithms on various hardware platforms using SYCL

Open SYCL on heterogeneous GPU systems: A case of study

Fortran performance optimisation and auto-parallelisation by leveraging MLIR-based domain specific abstractions in Flang

Advancing the distributed Multi-GPU ChASE library through algorithm optimization and NCCL library

Automated Buffer Sizing of Dataflow Applications in a High-Level Synthesis Workflow

Beehive SPIR-V Toolkit: A Composable and Functional API for Runtime SPIR-V Code Generation

Julia as a unifying end-to-end workflow language on the Frontier exascale system

Recent source codes

Kernel Library for LLM Serving

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Genten: Software for Generalized Tensor Decompositions by Sandia National Laboratories

Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR

Pinocchio: PINpointing Orbit Crossing Collapsed Hierarchical Objects

KernelCoder: trained on a curated dataset of reasoning traces and CUDA kernel pairs

VibeCodeHPC - Multi Agentic Vibe Coding for HPC

Compile-Time Resource Safety for GPU APIs: A Low-Overhead Typestate Framework

exa-AMD: Exascale Accelerated Materials Discovery

Most viewed papers (last 30 days)