high performance computing on graphics processing units: hgpu.org

hgpu.org » Computer science

Lectures on Parallel Computing

Jesper Larsson Träff

View

Download (PDF)

Tags: Computer science, Education, parallel computing

August 4, 2024 by hgpu

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Junqing Lin, Jingwei Sun, Xiaolong Shi, Honghe Zhang, Xianzhi Yu, Xinzhi Wang, Jun Yao, Guangzhong Sun

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080 Ti, Performance, Sparse matrix, Tesla V100

August 4, 2024 by hgpu

Data-driven Forecasting of Deep Learning Performance on GPUs

Seonho Lee, Amar Phanishayee, Divya Mahajan

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia H100, nVidia P100, nVidia V100, Performance, PyTorch, Tesla T4

August 4, 2024 by hgpu

Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing

Yizhou Luo, Qiang Wang, Shaohuai Shi, Jiaxin Lai, Shuhan Qi, Jiajia Zhang, Xuan Wang

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, GPU cluster, nVidia, nVidia GeForce RTX 2080 Ti, OpenMPI, PyTorch, Task scheduling

August 4, 2024 by hgpu

Data-driven Performance Optimization for Data-intensive Applications

Jie Liu

View

Download (PDF)

Tags: Computer science, Databases, Deep learning, Neural networks, nVidia, nVidia V100, TensorFlow, Thesis

July 28, 2024 by hgpu

A Comparison of OpenCL, CUDA, and HIP as Compilation Targets for a Functional Array Language

Troels Henriksen

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, ATI, Code generation, Computer science, CUDA, HIP, nVidia, nVidia A100, OpenCL, Package, Programming Languages

July 28, 2024 by hgpu

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Milo Lurati, Stijn Heldens, Alessio Sclocco, Ben van Werkhoven

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, AMD Radeon Pro W6600, ATI, Computer science, CUDA, HIP, nVidia, nVidia A100, nVidia RTX A4000, Package, Performance, Python

July 28, 2024 by hgpu

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, NLP, nVidia, nVidia A800

July 28, 2024 by hgpu

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Jianhua Gao, Weixing Ji, Yizhuo Wang

View

Download (PDF)

Tags: Computer science, CUDA, Linear Algebra, nVidia, Optimization, Sparse matrix, Tesla V100

July 14, 2024 by hgpu

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Gabin Schieffer, Jacob Wahlgren, Jie Ren, Jennifer Faj, Ivy Peng

View

Download (PDF)

Tags: Computer science, CUDA, HPC, Memory, nVidia, nVidia H100, Performance, Quantum computing

July 14, 2024 by hgpu

Automating Heterogeneous Parallelism in Numerical Differential Equations

Utkarsh

View

Download (PDF)

Source codes

Tags: AMD RX Vega 64, ATI, Computer science, CUDA, Differential equations, Factorization, Heterogeneous systems, Intel, Intel Arc A770, Julia, Numerical Analysis, nVidia, nVidia Quadro RTX 5000, Package, Tesla V100, Thesis

July 14, 2024 by hgpu

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

Hani Khader

View

Download (PDF)

Tags: AMD Radeon RX 6800, ATI, Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, OpenCL, Security, Thesis

July 14, 2024 by hgpu

UVaFTLE: Lagrangian finite time Lyapunov exponent extraction for fluid dynamic applications

Challenging Portability Paradigms: FPGA Acceleration Using SYCL and OpenCL

HPCToolkit

Refining HPCToolkit for application performance analysis at exascale

Open Catalog of Best Practices for Modernization and Optimization

Optimizing the Weather Research and Forecasting Model with OpenMP Offload and Codee

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

Exploring Scalability in C++ Parallel STL Implementations

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Lectures on Parallel Computing

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Data-driven Forecasting of Deep Learning Performance on GPUs

Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing

Data-driven Performance Optimization for Data-intensive Applications

A Comparison of OpenCL, CUDA, and HIP as Compilation Targets for a Functional Array Language

Bringing Auto-tuning to HIP: Analysis of Tuning Impact and Difficulty on AMD and Nvidia GPUs

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Optimization of Large-Scale Sparse Matrix-Vector Multiplication on Multi-GPU Systems

Harnessing Integrated CPU-GPU System Memory for HPC: a first look into Grace Hopper

Automating Heterogeneous Parallelism in Numerical Differential Equations

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

Recent source codes

Intel® SHMEM: Device initiated shared memory based communication library

AFOCL

miniLB: Lattice Botlzmann miniapp w/SYCL

2domination

MFC: Exascale simulation of multiphase/physics fluid dynamics

UVaFTLE: Lagrangian finite time Lyapunov exponent extraction for fluid dynamic applications

HPCToolkit

Open Catalog of Best Practices for Modernization and Optimization

Owl: Differential-based Side-Channel Leakage Detection for CUDA Applications

pSTL-Bench: Micro-benchmark suite designed to evaluate the scalability and efficiency of parallel C++ STL implementations

Most viewed papers (last 30 days)