high performance computing on graphics processing units: hgpu.org

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

Guangsen Zeng, Yi Zou

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A40, Sparse matrix

September 6, 2023 by hgpu

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

Jan Solanti, Michal Babej, Julius Ikkala, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, Distributed computing, Fluid dynamics, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A6000, OpenCL, Package, Rendering

September 6, 2023 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Memory Efficient Mixed-Precision Optimizers

OpenMP Kernel Language Extensions for Performance Portable GPU Codes

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

Evaluating the performance portability of SYCL across CPUs and GPUs on bandwidth-bound applications

Comparing Performance and Portability between CUDA and SYCL for Protein Database Search on NVIDIA, AMD, and Intel GPUs

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Many Cores, Many Models: GPU Programming Model vs. Vendor Compatibility Overview

host device — Generic programming in Cuda

Unified Shared Memory: Friend or Foe?

Scope is all you need: Transforming LLMs for HPC Code

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)