high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia V100

Data-driven Performance Optimization for Data-intensive Applications

Jie Liu

View

Download (PDF)

Tags: Computer science, Databases, Deep learning, Neural networks, nVidia, nVidia V100, TensorFlow, Thesis

July 28, 2024 by hgpu

Optimal Kernel Orchestration for Tensor Programs with Korch

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

June 23, 2024 by hgpu

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Johannes Pekkilä, Oskar Lappi, Fredrik Robertsén, Maarit J. Korpi-Lagg

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, CUDA, Energy-efficient computing, HIP, nVidia, nVidia A100, nVidia V100, Package, Performance, PyTorch, Stencil computation

June 16, 2024 by hgpu

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

View

Download (PDF)

Tags: Computer science, GPU cluster, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Tesla T4

June 9, 2024 by hgpu

Kernel-Centric Optimizations for Deep Neural Networks on GPGPU

Zhaodong Chen

View

Download (PDF)

Tags: Computer science, Computer vision, CUDA, Deep learning, Neural networks, nVidia, nVidia A100, nVidia V100, Thesis

May 26, 2024 by hgpu

Direct Numerical Simulation of Turbulence on Heterogenous Computer Systems: Architectures, Algorithms, and Applications

Martin Karp

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, ATI, cfd, Fluid dynamics, FPGA, Heterogeneous systems, Numerical simulation, nVidia, nVidia A100, nVidia P100, nVidia V100, OpenCL, Spectral elements, Thesis

May 12, 2024 by hgpu

Balancing Tracking Granularity and Parallelism in Many-Task Systems: The Horizons Approach

Peter Thoman, Philip Salzmann

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, GPU cluster, HPC, nVidia, nVidia V100, Package, SYCL

April 14, 2024 by hgpu

Speed, power and cost implications for GPU acceleration of Computational Fluid Dynamics on HPC systems

Zachary Cooper-Baldock, Brenda Vara Almirall, Kiao Inthavong

View

Download (PDF)

Tags: cfd, Fluid dynamics, HPC, MPI, nVidia, nVidia A100, nVidia V100, Performance

April 7, 2024 by hgpu

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Xinyi Li, Ang Li, Bo Fang, Katarzyna Swirydowicz, Ignacio Laguna, Ganesh Gopalakrishnan

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, AMD Radeon Instinct MI250X, ATI, Computer science, Hardware Architecture, HPC, Matrix multiplication, nVidia, nVidia A100, nVidia H100, nVidia V100, PTX

March 10, 2024 by hgpu

Assessing opportunities of SYCL for biological sequence alignment on GPU-based systems

Manuel Costanzo, Enzo Rucci, Carlos García-Sanchez, Marcelo Naiouf, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 6700 XT, AMD Radeon RX Vega 6, ATI, Bioinformatics, Biology, Computational biology, CUDA, Heterogeneous systems, Intel Arc A770, Intel UHD 630, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 980, nVidia GeForce RTX 2070, nVidia GeForce RTX 3090, nVidia V100, oneAPI, Package, Sequence alignment, SYCL

February 25, 2024 by hgpu

TransAxx: Efficient Transformers with Approximate Computing

Dimitrios Danopoulos, Georgios Zervakis, Dimitrios Soudris, Jörg Henkel

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia V100, Package, PyTorch

February 18, 2024 by hgpu

An Evaluative Comparison of Performance Portability across GPU Programming Models

Joshua H. Davis, Pranav Sivaraman, Isaac Minn, Konstantinos Parasyris, Harshitha Menon, Giorgis Georgakoudis, Abhinav Bhatele

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, AMD Radeon Instinct Mi50, ATI, Computer science, CUDA, Heterogeneous systems, HIP, MPI, nVidia, nVidia V100, OpenACC, OpenMP, Performance, performance portability, SYCL

February 18, 2024 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

No More Shading Languages: Compiling C++ to Vulkan Shaders

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

Engineering Supercomputing Platforms for Biomolecular Applications

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

chemtrain-deploy: A parallel and scalable framework for machine learning potentials in million-atom MD simulations

microSYCL: SYCL micro-benchmarks repository

Exploring SYCL as a Portability Layer for High-Performance Computing on CPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Data-driven Performance Optimization for Data-intensive Applications

Optimal Kernel Orchestration for Tensor Programs with Korch

Stencil Computations on AMD and Nvidia Graphics Processors: Performance and Tuning Strategies

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Kernel-Centric Optimizations for Deep Neural Networks on GPGPU

Direct Numerical Simulation of Turbulence on Heterogenous Computer Systems: Architectures, Algorithms, and Applications

Balancing Tracking Granularity and Parallelism in Many-Task Systems: The Horizons Approach

Speed, power and cost implications for GPU acceleration of Computational Fluid Dynamics on HPC systems

FTTN: Feature-Targeted Testing for Numerical Properties of NVIDIA & AMD Matrix Accelerators

Assessing opportunities of SYCL for biological sequence alignment on GPU-based systems

TransAxx: Efficient Transformers with Approximate Computing

An Evaluative Comparison of Performance Portability across GPU Programming Models

Recent source codes

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

exa-AMD: Exascale Accelerated Materials Discovery

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

microSYCL: SYCL micro-benchmarks repository

Most viewed papers (last 30 days)