high performance computing on graphics processing units: hgpu.org

hgpu.org » Tesla V100

The Memory Controller Wall: Benchmarking the Intel FPGA SDK for OpenCL Memory Interface

Hamid Reza Zohouri, Satoshi Matsuoka

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, FPGA, HLS, Memory, nVidia, OpenCL, Package, Tesla K20, Tesla V100

October 20, 2019 by hgpu

Characterizing Deep Learning Training Workloads on Alibaba-PAI

Mengdi Wang, Chen Meng, Guoping Long, Chuan Wu, Jun Yang, Wei Lin, Yangqing Jia

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Computer vision, Deep learning, GPU cluster, nVidia, Tesla V100

October 20, 2019 by hgpu

Performance Impact of Memory Channels on Sparse and Irregular Algorithms

Oded Green, James Fox, Jeffrey Young, Jun Shirako, David Bader

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia GeForce GTX Titan X, nVidia GeForce GTX Titan XP, Performance, Sparse, Tesla P100, Tesla V100

October 13, 2019 by hgpu

Taichi: A Language for High-Performance Computation on Spatially Sparse Data Structures

Yuanming Hu, Tzu-Mao Li, Luke Anderson, Jonathan Ragan-Kelley, Frédo Durand

View

Download (PDF)

Source codes

Tags: 3D Graphics and Realism, CUDA, High-level Languages, nVidia, nVidia GeForce GTX 1080 Ti, Package, Rendering, Tesla V100

October 6, 2019 by hgpu

Exascale Deep Learning for Scientific Inverse Problems

Nouamane Laanait, Joshua Romero, Junqi Yin, M. Todd Young, Sean Treichler, Vitalii Starchenko, Albina Borisevich, Alex Sergeev, Michael Matheson

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Neural networks, nVidia, Package, Tesla V100

September 29, 2019 by hgpu

Elastic deep learning in multi-tenant GPU cluster

Yidi Wu, Kaihao Ma, Xiao Yan, Zhi Liu, James Cheng

View

Download (PDF)

Tags: Computer science, Deep learning, Distributed computing, GPU cluster, nVidia, nVidia GeForce GTX 1080 Ti, Tesla V100

September 29, 2019 by hgpu

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu

View

Download (PDF)

Tags: AI, AMD Radeon R7, ATI, Computer science, Deep learning, Neural networks, nVidia, PyTorch, TensorFlow, Tesla P100, Tesla V100, TPU

September 22, 2019 by hgpu

Model-Based Warp-Level Tiling for Image Processing Programs on GPUs

Abhinav Jangda, Arjun Guha

View

Download (PDF)

Tags: CUDA, Image procesing, nVidia, nVidia GeForce GTX 1080 Ti, Python, Tesla V100

September 22, 2019 by hgpu

Efficient Interleaved Batch Matrix Solvers for CUDA

Andrew Gloster, Enda Carroll, Miguel Bustamante, Lennon O'Naraigh

View

Download (PDF)

Source codes

Tags: Algorithms, Computational Physics, Computer science, CUDA, Matrix inversion, nVidia, Package, Tesla V100

September 15, 2019 by hgpu

Demystifying the MLPerf Benchmark Suite

Snehil Verma, Qinzhe Wu, Bagus Hanindhito, Gunjan Jha, Eugene B. John, Ramesh Radhakrishnan, Lizy K. John

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Deep learning, Machine learning, nVidia, Package, Tesla P100, Tesla V100

September 1, 2019 by hgpu

SODECL: An Open Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel

Eleftherios Avramidis, Marta Lalik, Ozgur E. Akman

View

Download (PDF)

Source codes

Tags: AMD FirePro W8100, ATI, Computer science, Differential equations, Mathematical Software, nVidia, OpenCL, Package, Tesla V100

August 18, 2019 by hgpu

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

Experiences with implementing Kokkos’ SYCL backend

ROCm's implementation of Gromacs

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

SimSYCL: A SYCL Implementation Targeting Development, Debugging, Simulation and Conformance

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

gpu_tracker: Python package for tracking and profiling GPU utilization in both desktop and high-performance computing environments

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

94% on CIFAR-10 in 3.29 Seconds on a Single GPU

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers

OpenMC Monte Carlo Code

Performance Portable Monte Carlo Particle Transport on Intel, NVIDIA, and AMD GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

The Memory Controller Wall: Benchmarking the Intel FPGA SDK for OpenCL Memory Interface

Characterizing Deep Learning Training Workloads on Alibaba-PAI

Performance Impact of Memory Channels on Sparse and Irregular Algorithms

Taichi: A Language for High-Performance Computation on Spatially Sparse Data Structures

Exascale Deep Learning for Scientific Inverse Problems

Elastic deep learning in multi-tenant GPU cluster

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Performance and Power Evaluation of AI Accelerators for Training Deep Learning Models

Model-Based Warp-Level Tiling for Image Processing Programs on GPUs

Efficient Interleaved Batch Matrix Solvers for CUDA

Demystifying the MLPerf Benchmark Suite

SODECL: An Open Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel

Recent source codes

Code examples for paper on SYCL backend of Kokkos - IWOCL 2024

ROCm's implementation of Gromacs

SimSYCL: Synchronous, single-threaded, library-only SYCL implementation for debugging and verification

GPU plugin for PySCF

QArray

Celerity: High-level C++ for Accelerator Clusters

gpu_tracker: Context manager and CLI that tracks the computational-resource-usage of a code block or shell command, particularly the GPU usage

CIFAR-10 Airbench: 94% on CIFAR-10 in 3.29 second

LOOPer: a polyhedral compiler for expressing fast and portable data parallel algorithms

OpenMC Monte Carlo Code

Most viewed papers (last 30 days)