high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Qiang Wang, Xiaowen Chu

View

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

February 25, 2024 by hgpu

Assessing opportunities of SYCL for biological sequence alignment on GPU-based systems

Manuel Costanzo, Enzo Rucci, Carlos García-Sanchez, Marcelo Naiouf, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 6700 XT, AMD Radeon RX Vega 6, ATI, Bioinformatics, Biology, Computational biology, CUDA, Heterogeneous systems, Intel Arc A770, Intel UHD 630, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 980, nVidia GeForce RTX 2070, nVidia GeForce RTX 3090, nVidia V100, oneAPI, Package, Sequence alignment, SYCL

February 25, 2024 by hgpu

TransAxx: Efficient Transformers with Approximate Computing

Dimitrios Danopoulos, Georgios Zervakis, Dimitrios Soudris, Jörg Henkel

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia V100, Package, PyTorch

February 18, 2024 by hgpu

Graphtoy: Fast Software Simulation of Applications for AMD’s AI Engines

Jonathan Strobl, Leonardo Solis-Vasquez, Yannick Lavan, Andreas Koch

View

Download (PDF)

Source codes

Tags: ATI, Computer science, FPGA, molecular docking, Package

February 18, 2024 by hgpu

An Evaluative Comparison of Performance Portability across GPU Programming Models

Joshua H. Davis, Pranav Sivaraman, Isaac Minn, Konstantinos Parasyris, Harshitha Menon, Giorgis Georgakoudis, Abhinav Bhatele

View

Download (PDF)

Tags: AMD Radeon Instinct MI250X, AMD Radeon Instinct Mi50, ATI, Computer science, CUDA, Heterogeneous systems, HIP, MPI, nVidia, nVidia V100, OpenACC, OpenMP, Performance, performance portability, SYCL

February 18, 2024 by hgpu

pSTL-Bench: A Micro-Benchmark Suite for Assessing Scalability of C++ Parallel STL Implementations

Ruben Laso, Diego Krupitza, Sascha Hunold

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia Ampere A2, OpenMP, performance portability, Tesla P4

February 18, 2024 by hgpu

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Taesu Kim, Jongho Lee, Daehyun Ahn, Sarang Kim, Jiwoong Choi, Minkyu Kim, Hyungjun Kim

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, Mixed precision, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia RTX A6000, Package

February 18, 2024 by hgpu

Multi-line AI-assisted Code Authoring

Omer Dunay, Daniel Cheng, Adam Tait, Parth Thakkar, Peter C Rigby, Andy Chiu, Imad Ahmad, Arun Ganesan, Chandra Maddila, Vijayaraghavan Murali, Ali Tayyebi, Nachiappan Nagappan

View

Download (PDF)

Tags: AI, Artificial intelligence, Computer science, Software Engineering

February 12, 2024 by hgpu

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Y. Wu, Y.K. Li, Fuli Luo, Yingfei Xiong, Wenfeng Liang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, nVidia, nVidia A100, Package

February 12, 2024 by hgpu

Training DNN Models over Heterogeneous Clusters with Optimal Performance

Chengyi Nie, Jessica Maghakian, Zhenhua Liu

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, load balancing, Neural networks, nVidia, nVidia RTX 6000 Ada

February 12, 2024 by hgpu

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Gianmarco Accordi, Davide Gadioli, Emanele Vitali, Luigi Crisci, Biagio Cosenza, Andrea Beccari, Gianluca Palermo

View

Download (PDF)

Tags: Computer science, CUDA, HPC, molecular docking, nVidia, nVidia A100, oneAPI, Performance, SYCL

February 12, 2024 by hgpu

Evaluating the Wide Area Classroom After 24,000 HPC Students

John Urbanic, Thomas Maiden, Valerie Rossi

View

Download (PDF)

Tags: Education, HPC, Machine learning, MPI, OpenACC, OpenMP, Physics

February 12, 2024 by hgpu

high performance computing on graphics processing units: hgpu.org

Applications

Benchmarking and Dissecting the Nvidia Hopper GPU Architecture

Assessing opportunities of SYCL for biological sequence alignment on GPU-based systems

TransAxx: Efficient Transformers with Approximate Computing

Graphtoy: Fast Software Simulation of Applications for AMD’s AI Engines

An Evaluative Comparison of Performance Portability across GPU Programming Models

pSTL-Bench: A Micro-Benchmark Suite for Assessing Scalability of C++ Parallel STL Implementations

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference

Multi-line AI-assisted Code Authoring

DeepSeek-Coder: When the Large Language Model Meets Programming – The Rise of Code Intelligence

Training DNN Models over Heterogeneous Clusters with Optimal Performance

Out of kernel tuning and optimizations for portable large-scale docking experiments on GPUs

Evaluating the Wide Area Classroom After 24,000 HPC Students

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)