high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications

A Domain-Extensible Compiler with Controllable Automation of Optimisations

Thomas Kœhler

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, DSL, Heterogeneous systems, Image processing, Machine learning, OpenCL, Package, Thesis

January 8, 2023 by hgpu

Cramming: Training a Language Model on a Single GPU in One Day

Jonas Geiping, Tom Goldstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A4000, nVidia RTX A6000, Package

January 8, 2023 by hgpu

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

Jianhui Li, Zhennan Qin, Yijie Mei, Jingze Cui, Yunfei Song, Ciyong Chen, Yifei Zhang, Longsheng Du, Xianhang Cheng, Baihui Jin, Jason Ye, Eric Lin, Dan Lavery

View

Download (PDF)

Source codes

Tags: Code generation, Compilers, Computer science, Deep learning, OpenCL, Package

January 8, 2023 by hgpu

BaCO: A Fast and Portable Bayesian Compiler Optimization Framework

Erik Hellsten, Artur Souza, Johannes Lenfers, Rubens Lacouture, Olivia Hsu, Adel Ejjeh, Fredrik Kjolstad, Michel Steuwer, Kunle Olukotun, Luigi Nardi

View

Download (PDF)

Source codes

Tags: Bayesian, Compilers, Computer science, FPGA, nVidia, OpenCL, Package, Performance, Programming Languages, Tesla K80

January 8, 2023 by hgpu

Arax: a runtime framework for decoupling applications from heterogeneous accelerators

Manos Pavlidakis, Stelios Mavridis, Antony Chazapis, Giorgos Vasiliadis, Angelos Bilas

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, FPGA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce RTX 2080, OpenCL, Package

January 8, 2023 by hgpu

Understanding the Impact of Input Entropy on FPU, CPU, and GPU Power

Sridutt Bhalachandra, Brian Austin, Samuel Williams, Nicholas J. Wright

View

Download (PDF)

Source codes

Tags: Computer science, Hardware Architecture, nVidia, nVidia A100, Package, Performance

December 25, 2022 by hgpu

Extending MAGMA Portability with OneAPI

Anna Fortenberry, Stanimire Tomov

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce RTX 3060, oneAPI, Package, performance portability

December 25, 2022 by hgpu

mu-grind: A Framework for Dynamically Instrumenting HLS-Generated RTL

Parmida Vahdatniya, Amirali Sharifian, Reza Hojabr, Arrvindh Shriraman

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, Heterogeneous systems, HLS, Package, Scala

December 25, 2022 by hgpu

GPU Load Balancing

Muhammad Osama

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, load balancing, Matrix multiplication, nVidia, nVidia A100, Package, Sparse, Thesis

December 25, 2022 by hgpu

Kernel-as-a-Service: A Serverless Interface to GPUs

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, Joseph Gonzalez

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, nVidia, Package, Tesla V100

December 25, 2022 by hgpu

Portable C++ Code that can Look and Feel Like Fortran Code with Yet Another Kernel Launcher (YAKL)

Matthew Norman, Isaac Lyngaas, Abhishek Bagusetty, Mark Berrill

View

Download (PDF)

Source codes

Tags: Computer science, Fortran, nVidia, Package, SYCL, Tesla V100

December 19, 2022 by hgpu

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

August Ernstsson, Dalvan Griebler, Christoph Kessler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL, OpenMP, Package, performance portability, Tesla K20

December 11, 2022 by hgpu

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

No More Shading Languages: Compiling C++ to Vulkan Shaders

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

Engineering Supercomputing Platforms for Biomolecular Applications

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

chemtrain-deploy: A parallel and scalable framework for machine learning potentials in million-atom MD simulations

microSYCL: SYCL micro-benchmarks repository

Exploring SYCL as a Portability Layer for High-Performance Computing on CPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

A Domain-Extensible Compiler with Controllable Automation of Optimisations

Cramming: Training a Language Model on a Single GPU in One Day

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

BaCO: A Fast and Portable Bayesian Compiler Optimization Framework

Arax: a runtime framework for decoupling applications from heterogeneous accelerators

Understanding the Impact of Input Entropy on FPU, CPU, and GPU Power

Extending MAGMA Portability with OneAPI

mu-grind: A Framework for Dynamically Instrumenting HLS-Generated RTL

GPU Load Balancing

Portable C++ Code that can Look and Feel Like Fortran Code with Yet Another Kernel Launcher (YAKL)

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

Recent source codes

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

exa-AMD: Exascale Accelerated Materials Discovery

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

hpcbench: A set of benchmarking utilities for biomolecular simulation tools

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

microSYCL: SYCL micro-benchmarks repository

Most viewed papers (last 30 days)