high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia DGX-1

cuSLINK: Single-linkage Agglomerative Clustering on the GPU

Corey J. Nolet, Divye Gala, Alex Fender, Mahesh Doijade, Joe Eaton, Edward Raff, John Zedlewski, Brad Rees, Tim Oates

View

Download (PDF)

Source codes

Tags: Algorithms, Cluster analysis, Clustering, Computer science, CUDA, Hierarchical clustering, Machine learning, Nearest neighbour, nVidia, nVidia A100, nVidia DGX-1, Package

July 2, 2023 by hgpu

MSREP: A Fast yet Light Sparse Matrix Framework for Multi-GPU Systems

Jieyang Chen, Chenhao Xie, Jesun S Firoz, Jiajia Li, Shuaiwen Leon Song, Kevin Barker, Mark Raugas, Ang Li

View

Download (PDF)

Tags: Computer science, CUDA, Linear Algebra, nVidia, nVidia DGX-1, OpenMP, Sparse matrix, Tesla V100

October 2, 2022 by hgpu

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

Christopher Noel Hesse

View

Download (PDF)

Tags: Benchmarking, Computer science, Deep learning, FPGA, Neural networks, nVidia, nVidia DGX-1, nVidia GeForce RTX 2070, nVidia Jetson Nano, Performance, Tesla V100

December 5, 2021 by hgpu

Principles towards Real-Time Simulation of Material Point Method on Modern GPUs

Yun Fei, Yuhan Huang, Ming Gao

View

Download (PDF)

Tags: Computer science, CUDA, Graphics, nVidia, nVidia DGX-1, Physics-based simulation, Tesla V100

November 7, 2021 by hgpu

Neural Network Libraries: A Deep Learning Framework Designed from Engineers’ Perspectives

Akio Hayakawa, Masato Ishii, Yoshiyuki Kobayashi, Akira Nakamura, Takuya Narihira, Yukio Obuchi, Andrew Shin, Takuya Yashima, Kazuki Yoshiyama

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Neural networks, nVidia, nVidia DGX-1, Package, Tesla V100

March 7, 2021 by hgpu

Design, Implementation and Test of Efficient GPU to GPU Communication Methods

Stepan Vanecek

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Computer science, Heterogeneous systems, HIP, MPI, nVidia DGX-1, Thesis

January 3, 2021 by hgpu

A Study of Single and Multi-device Synchronization Methods in Nvidia GPUs

Lingqi Zhang, Mohamed Wahib, Haoyu Zhang, Satoshi Matsuoka

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia DGX-1, Package, Performance, Tesla P100, Tesla V100

April 19, 2020 by hgpu

A Parallel Sparse Tensor Benchmark Suite on CPUs and GPUs

Jiajia Li, Mahesh Lakshminarasimhan, Xiaolong Wu, Ang Li, Catherine Olschanowsky, Kevin Barker

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Linear Algebra, Machine learning, nVidia, nVidia DGX-1, Package, Performance, Tesla P100, Tesla V100

January 12, 2020 by hgpu

A Unified Iteration Space Transformation Framework for Sparse and Dense Tensor Algebra

Ryan Senanayake, Fredrik Kjolstad, Changwan Hong, Shoaib Kamil, Saman Amarasinghe

View

Download (PDF)

Source codes

Tags: Code generation, Compilers, Computer science, CUDA, Linear Algebra, nVidia, nVidia DGX-1, Package, Sparse matrix, Tesla V100

January 5, 2020 by hgpu

Blink: Fast and Generic Collectives for Distributed ML

Guanhua Wang, Shivaram Venkataraman, Amar Phanishayee, Jorgen Thelin, Nikhil Devanur, Ion Stoica

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Heterogeneous systems, Machine learning, nVidia, nVidia DGX-1, Tesla V100

October 20, 2019 by hgpu

A Deep Learning Approach for Automatic Code Optimization in the Tiramisu Compiler

Mohammed Henni, Ilhem Isra Mekki

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia DGX-1

August 11, 2019 by hgpu

Improving Resource Efficiency in Virtualized Datacenters

Marcelo Amaral

View

Download (PDF)

Tags: Cloud, Computer science, CUDA, nVidia, nVidia DGX-1, Thesis, Virtualization

May 12, 2019 by hgpu

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

cuSLINK: Single-linkage Agglomerative Clustering on the GPU

MSREP: A Fast yet Light Sparse Matrix Framework for Multi-GPU Systems

Analysis and Comparison of Performance and Power Consumption of Neural Networks on CPU, GPU, TPU and FPGA

Principles towards Real-Time Simulation of Material Point Method on Modern GPUs

Neural Network Libraries: A Deep Learning Framework Designed from Engineers’ Perspectives

Design, Implementation and Test of Efficient GPU to GPU Communication Methods

A Study of Single and Multi-device Synchronization Methods in Nvidia GPUs

A Parallel Sparse Tensor Benchmark Suite on CPUs and GPUs

A Unified Iteration Space Transformation Framework for Sparse and Dense Tensor Algebra

Blink: Fast and Generic Collectives for Distributed ML

A Deep Learning Approach for Automatic Code Optimization in the Tiramisu Compiler

Recent source codes

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

Most viewed papers (last 30 days)