high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming » CUDA

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Jianhua Gao, Weixing Ji, Yizhuo Wang

View

Download (PDF)

Tags: Computer science, CUDA, Linear Algebra, nVidia, Optimization, Sparse matrix, Tesla V100

July 14, 2024 by hgpu

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer, Jacob Wahlgren, Jie Ren, Jennifer Faj, Ivy Peng

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia H100, Performance, Quantum computing

July 14, 2024 by hgpu

Automating Heterogeneous Parallelism in Numerical Differential Equations

Utkarsh

View

Download (PDF)

Source codes

Tags: AMD RX Vega 64, ATI, Computer science, CUDA, Differential equations, Factorization, Heterogeneous systems, Intel, Intel Arc A770, Julia, Numerical Analysis, nVidia, nVidia Quadro RTX 5000, Package, Tesla V100, Thesis

July 14, 2024 by hgpu

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

Hani Khader

View

Download (PDF)

Tags: AMD Radeon RX 6800, ATI, Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, OpenCL, Security, Thesis

July 14, 2024 by hgpu

PSCToolkit: solving sparse linear systems with a large number of GPUs

Pasqua D'Ambra, Fabio Durastante, Salvatore Filippone

View

Download (PDF)

Source codes

Tags: CUDA, Linear Algebra, Mathematical Software, Mathematics, Numerical Analysis, nVidia, nVidia A100, Package, Sparse

July 7, 2024 by hgpu

Composing Distributed Computations Through Task and Kernel Fusion

Rohan Yadav, Shiv Sundram, Wonchan Lee, Michael Garland, Michael Bauer, Alex Aiken, Fredrik Kjolstad

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, MPI, nVidia, nVidia DGX-A100, Python

June 30, 2024 by hgpu

Adapting database components to heterogeneous environments

Dimitrios Koutsoukos

View

Download (PDF)

Tags: Computer science, CUDA, Databases, Heterogeneous systems, nVidia, nVidia P100, Thesis

June 30, 2024 by hgpu

A Survey of General-purpose Polyhedral Compilers

Arun Thangamani, Vincent Loechner, Stéphane Genaud

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, nVidia, nVidia A100, OpenCL, Package, survey

June 30, 2024 by hgpu

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae

View

Download (PDF)

Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance

June 23, 2024 by hgpu

Optimal Kernel Orchestration for Tensor Programs with Korch

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

June 23, 2024 by hgpu

COOK Access Control on an embedded Volta GPU

Benjamin Lesage, Frédéric Boniol, Claire Pagetti

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia Jetson AGX Xavier

June 23, 2024 by hgpu

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Johannes Pekkilä, Oskar Lappi, Fredrik Robertsén, Maarit J. Korpi-Lagg

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Energy-efficient computing, HIP, nVidia, nVidia A100, nVidia V100, Package, Performance, PyTorch, Stencil computation

June 16, 2024 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Automating Heterogeneous Parallelism in Numerical Differential Equations

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

PSCToolkit: solving sparse linear systems with a large number of GPUs

Composing Distributed Computations Through Task and Kernel Fusion

Adapting database components to heterogeneous environments

A Survey of General-purpose Polyhedral Compilers

Breaking the Memory Wall: A Study of I/O Patterns and GPU Memory Utilization for Hybrid CPU-GPU Offloaded Optimizers

Optimal Kernel Orchestration for Tensor Programs with Korch

COOK Access Control on an embedded Volta GPU

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)