high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A100

PSCToolkit: solving sparse linear systems with a large number of GPUs

Pasqua D'Ambra, Fabio Durastante, Salvatore Filippone

View

Download (PDF)

Source codes

Tags: CUDA, Linear Algebra, Mathematical Software, Mathematics, Numerical Analysis, nVidia, nVidia A100, Package, Sparse

July 7, 2024 by hgpu

A Survey of General-purpose Polyhedral Compilers

Arun Thangamani, Vincent Loechner, Stéphane Genaud

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Package, survey

June 30, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

Optimal Kernel Orchestration for Tensor Programs with Korch

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

June 23, 2024 by hgpu

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Johannes Pekkilä, Oskar Lappi, Fredrik Robertsén, Maarit J. Korpi-Lagg

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Energy-efficient computing, HIP, nVidia, nVidia A100, nVidia V100, Package, Performance, PyTorch, Stencil computation

June 16, 2024 by hgpu

How much can we gain from Tensor Kernel Fusion on GPUs?

Wei Sun, Ang Li, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, nVidia H100

June 16, 2024 by hgpu

Gaining Cross-Platform Parallelism for HAL’s Molecular Dynamics Package using SYCL

Viktor Skoblin, Felix Höfling, Steffen Christgau

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Computer science, CUDA, Molecular dynamics, nVidia, nVidia A100, nVidia A40, Package, Physics, SYCL

June 9, 2024 by hgpu

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

View

Download (PDF)

Tags: Computer science, GPU cluster, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Tesla T4

June 9, 2024 by hgpu

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

L.A. Torres, Carlos J. Barrios H, Yves Denneulin

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia A100, Package, Performance, SYCL

June 2, 2024 by hgpu

An implementation of tensor product patch smoothers on GPU

Cu Cui, Paul Grosse-Bley, Guido Kanschat, Robert Strzodka

View

Download (PDF)

Tags: CUDA, FEM, Finite element method, Mathematics, Numerical Analysis, nVidia, nVidia A100

June 2, 2024 by hgpu

Enabling full-speed random access to the entire memory on the A100 GPU

Alden Walker

View

Download (PDF)

Tags: Computer science, nVidia, nVidia A100, Performance, PTX

May 26, 2024 by hgpu

ArchesWeather: An efficient AI weather forecasting model at 1.5° resolution

Guillaume Couairon, Christian Lessig, Anastase Charantonis, Claire Monteleoni

View

Download (PDF)

Tags: Deep learning, Earth and Space Sciences, nVidia, nVidia A100, Weather prediction

May 26, 2024 by hgpu

GPUODEBenchmarks: Comparsion of Julia's GPU Kernel based ODE solvers with other open-source GPU ODE solvers

Automating Heterogeneous Parallelism in Numerical Differential Equations

Dat3M: Memory Model Aware Verification

Towards Unified Analysis of GPU Consistency

NVIDIA Federated Learning Application Runtime Environment

Supercharging Federated Learning with Flower and NVIDIA FLARE

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

PSCToolkit: solving sparse linear systems with a large number of GPUs

CATBench: Benchmarking Framework

CATBench: A Compiler Autotuning Benchmarking Suite for Black-box Optimization

General-purpose Polyhedral Compilers

A Survey of General-purpose Polyhedral Compilers

Optimal Kernel Orchestration for Tensor Programs with Korch

Astaroth: A Scalable Multi-GPU Library for Stencil Computations

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

PSCToolkit: solving sparse linear systems with a large number of GPUs

A Survey of General-purpose Polyhedral Compilers

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Optimal Kernel Orchestration for Tensor Programs with Korch

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

How much can we gain from Tensor Kernel Fusion on GPUs?

Gaining Cross-Platform Parallelism for HAL’s Molecular Dynamics Package using SYCL

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

An implementation of tensor product patch smoothers on GPU

Enabling full-speed random access to the entire memory on the A100 GPU

ArchesWeather: An efficient AI weather forecasting model at 1.5° resolution

Recent source codes

GPUODEBenchmarks: Comparsion of Julia's GPU Kernel based ODE solvers with other open-source GPU ODE solvers

Dat3M: Memory Model Aware Verification

NVIDIA Federated Learning Application Runtime Environment

Chat AI: A Seamless Slurm-Native Solution for HPC-Based Services

PSCToolkit: solving sparse linear systems with a large number of GPUs

CATBench: Benchmarking Framework

General-purpose Polyhedral Compilers

Optimal Kernel Orchestration for Tensor Programs with Korch

Astaroth: A Scalable Multi-GPU Library for Stencil Computations

Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking

Most viewed papers (last 30 days)