high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

Ali Doosthosseini, Jonathan Decker, Hendrik Nolte, Julian M. Kunkel

View

Download (PDF)

Source codes

Tags: AI, Cloud, Computer science, HPC, LLM, nVidia, nVidia H100, Package, PC cluster

July 7, 2024 by hgpu

Towards Unified Analysis of GPU Consistency

Haining Tong, Natalia Gavrilenko, Hernán Ponce de León, Keijo Heljanko

View

Download (PDF)

Source codes

Tags: Computer science, Memory, nVidia, OpenCL, Package, PTX, Vulkan

July 7, 2024 by hgpu

Automatic Code Rewriting for Performance Portability

Alister Johnson

View

Download (PDF)

Tags: Compilers, Computer science, HIP, OpenCL, OpenMP, performance portability, SYCL, Thesis

July 7, 2024 by hgpu

PSCToolkit: solving sparse linear systems with a large number of GPUs

Pasqua D'Ambra, Fabio Durastante, Salvatore Filippone

View

Download (PDF)

Source codes

Tags: CUDA, Linear Algebra, Mathematical Software, Mathematics, Numerical Analysis, nVidia, nVidia A100, Package, Sparse

July 7, 2024 by hgpu

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, nVidia DGX-A100, Python

June 30, 2024 by hgpu

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

Jacob O. Tørring, Carl Hvarfner, Luigi Nardi, Magnus Själander

View

Download (PDF)

Source codes

Tags: Benchmarking, Compilers, Computer science, Machine learning, nVidia, nVidia GeForce GTX Titan V, nVidia Titan RTX, OpenCL, Package

June 30, 2024 by hgpu

Adapting database components to heterogeneous environments

Dimitrios Koutsoukos

View

Download (PDF)

Tags: Computer science, CUDA, Databases, Heterogeneous systems, nVidia, nVidia P100, Thesis

June 30, 2024 by hgpu

A Survey of General-purpose Polyhedral Compilers

Arun Thangamani, Vincent Loechner, Stéphane Genaud

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Package, survey

June 30, 2024 by hgpu

GPU Parallelization of Astronomical Image Subtraction

Gustav Arneving, Hugo Wilhelmsson

View

Download (PDF)

Tags: Astrophysics, nVidia, nVidia GeForce GTX 1050, OpenCL, OpenMP, Physics, Thesis

June 23, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

An End-to-End Programming Model for AI Engine Architectures

Maksim Levental

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Deep learning, nVidia, nVidia GeForce RTX 3080 Ti, Thesis, Vulkan

June 23, 2024 by hgpu

MATLAB Tensor Core models

Accurate Models of NVIDIA Tensor Cores

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

TritonForge: Profiling-Guided Framework for Automated Triton Kernel Optimization

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

An MLIR pipeline for offloading Fortran to FPGAs via OpenMP

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Towards Unified Analysis of GPU Consistency

Automatic Code Rewriting for Performance Portability

PSCToolkit: solving sparse linear systems with a large number of GPUs

Composing Distributed Computations Through Task and Kernel Fusion

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

Adapting database components to heterogeneous environments

A Survey of General-purpose Polyhedral Compilers

GPU Parallelization of Astronomical Image Subtraction

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

An End-to-End Programming Model for AI Engine Architectures

Recent source codes

MATLAB Tensor Core models

TritonForge: Transform PyTorch Operations into Optimized GPU Kernels with LLMs

RLTune: Hybrid Learning and Optimization-Based Dynamic Scheduling for DL Workloads on Heterogeneous GPU Clusters

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

hls4ml: Machine learning on FPGAs using HLS

NVIDIA Nemotron Parse 1.1

ThunderKittens: Tile primitives for speedy kernels

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

Most viewed papers (last 30 days)