high performance computing on graphics processing units: hgpu.org

Fabrizio Ferrandi, Serena Curzel, Leandro Fiorin, Daniele Ielmini, Cristina Silvano, Francesco Conti, Alessio Burrello, Francesco Barchi, Luca Benini, Luciano Lavagno, Teodoro Urso, Enrico Calore, Sebastiano Fabio Schifano, Cristian Zambelli, Maurizio Palesi, Giuseppe Ascia, Enrico Russo, Nicola Petra, Davide De Caro, Gennaro Di Meo, Valeria Cardellini, Salvatore Filippone, Francesco Lo Presti, Francesco Silvestri, Paolo Palazzari, Stefania Perri

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, Design space exploration, Hardware Architecture, Heterogeneous systems, Machine learning, Neural networks, nVidia, nVidia H100, OpenCL, survey

December 3, 2023 by hgpu

FIKIT: Priority-Based Real-time GPU Multi-tasking Scheduling with Kernel Identification

Wenqing Wu

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 3090, nVidia GeForce RTX 4080 Ti, nVidia H100, Task scheduling

November 27, 2023 by hgpu

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Phuong Nguyen, Pratik Nayak, Hartwig Anzt

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Intel, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, Package, performance portability, Physics, SYCL

August 20, 2023 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Data-driven Forecasting of Deep Learning Performance on GPUs

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

How much can we gain from Tensor Kernel Fusion on GPUs?

Porting HPC Applications to AMD Instinct MI300A Using Unified Memory and OpenMP

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

A Survey on Design Methodologies for Accelerating Deep Learning on Heterogeneous Architectures

FIKIT: Priority-Based Real-time GPU Multi-tasking Scheduling with Kernel Identification

Scope is all you need: Transforming LLMs for HPC Code

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)