high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Safe, Seamless, And Scalable Integration Of Asynchronous GPU Streams In PETSc

Jacob Faibussowitsch, Mark F. Adams, Richard Tran Mills, Stefano Zampini, Junchao Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, Package, Performance

July 9, 2023 by hgpu

Modeling Parallel Programs using Large Language Models

Daniel Nichols, Aniruddha Marathe, Harshitha Menon, Todd Gamblin, Abhinav Bhatele

View

Download (PDF)

Tags: Code generation, Computer science, HPC, MPI, nVidia, nVidia A100, OpenMP

July 9, 2023 by hgpu

Optimization Techniques for GPU Programming

Pieter Hijma, Stijn Heldens, Alessio Sclocco, Ben van Werkhoven, Henri E. Bal

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, OpenCL, Performance, survey

July 9, 2023 by hgpu

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

View

Download (PDF)

Tags: Computer science, Deep learning, nVidia, nVidia Titan RTX, Performance, PyTorch

July 9, 2023 by hgpu

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

William F. Godoy, Pedro Valero-Lara, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Benchmarking, Code generation, Computer science, CUDA, Fortran, HPC, Julia, nVidia, OpenACC, OpenMP, Package, Python

July 2, 2023 by hgpu

cuSLINK: Single-linkage Agglomerative Clustering on the GPU

Corey J. Nolet, Divye Gala, Alex Fender, Mahesh Doijade, Joe Eaton, Edward Raff, John Zedlewski, Brad Rees, Tim Oates

View

Download (PDF)

Source codes

Tags: Algorithms, Cluster analysis, Clustering, Computer science, CUDA, Hierarchical clustering, Machine learning, Nearest neighbour, nVidia, nVidia A100, nVidia DGX-1, Package

July 2, 2023 by hgpu

Out-of-the-box library support for DBMS operations on GPUs

Harish Kumar Harihara Subramanian, Bala Gurumurthy, Gabriel Campero Durand, David Broneske, Gunter Saake

View

Download (PDF)

Source codes

Tags: Computer science, Databases, Hashing, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia V100, OpenCL, Package, Performance

July 2, 2023 by hgpu

SYCL compute kernels for ExaHyPE

Chung Ming Loi, Tobias Weinzierl

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Data parallelism, nVidia, nVidia A100, Package, Programming techniques, SYCL

July 2, 2023 by hgpu

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

James Gleeson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 480, nVidia GeForce RTX 2080 Ti, nVidia Grid K1, Optimization, Package, Performance, Tesla V100, Thesis, Virtualization

July 2, 2023 by hgpu

Deep Language Models for Software Testing and Optimisation

Foivos Tsimpourlas

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, nVidia GeForce Titan X, OpenCL, Package, Software Engineering, Thesis

June 25, 2023 by hgpu

Compilation and Design Space Exploration of Dataflow Programs for Heterogeneous CPU-GPU Platforms

Aurélien François Gilbert Bloch

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Design space exploration, DSP, FPGA, Heterogeneous systems, nVidia, nVidia GeForce GTX 1660, nVidia GeForce RTX 3080 Ti, Package, Thesis

June 25, 2023 by hgpu

DGEMM on Integer Matrix Multiplication Unit

Hiroyuki Ootomo, Katsuhisa Ozaki, Rio Yokota

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, nVidia Jetson AGX Orin, nVidia RTX 6000 Ada, nVidia Titan RTX, Package

June 25, 2023 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Safe, Seamless, And Scalable Integration Of Asynchronous GPU Streams In PETSc

Modeling Parallel Programs using Large Language Models

Optimization Techniques for GPU Programming

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generation

cuSLINK: Single-linkage Agglomerative Clustering on the GPU

Out-of-the-box library support for DBMS operations on GPUs

SYCL compute kernels for ExaHyPE

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

Deep Language Models for Software Testing and Optimisation

Compilation and Design Space Exploration of Dataflow Programs for Heterogeneous CPU-GPU Platforms

DGEMM on Integer Matrix Multiplication Unit

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)