high performance computing on graphics processing units: hgpu.org

Packages

hgpu.org » Applications

Kernel-as-a-Service: A Serverless Interface to GPUs

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, Joseph Gonzalez

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, nVidia, Package, Tesla V100

December 25, 2022 by hgpu

Portable C++ Code that can Look and Feel Like Fortran Code with Yet Another Kernel Launcher (YAKL)

Matthew Norman, Isaac Lyngaas, Abhishek Bagusetty, Mark Berrill

View

Download (PDF)

Source codes

Tags: Computer science, Fortran, nVidia, Package, SYCL, Tesla V100

December 19, 2022 by hgpu

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

August Ernstsson, Dalvan Griebler, Christoph Kessler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL, OpenMP, Package, performance portability, Tesla K20

December 11, 2022 by hgpu

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

René Caspart, Sebastian Ziegler, Arvid Weyrauch, Holger Obermaier, Simon Raffeiner, Leon Pascal Schuhmacher, Jan Scholtyssek, Darya Trofimova, Marco Nolden, Ines Reinartz, Fabian Isensee, Markus Götz, Charlotte Debus

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Energy-efficient computing, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Package

December 11, 2022 by hgpu

Three Contributions to the Theory and Practice of Optimizing Compilers

Linxiao Wang

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, LLVM, nVidia, nVidia GeForce GTX 1080 Ti, nVidia GeForce GTX 760 M, Package, Thesis

December 4, 2022 by hgpu

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

User-Driven Online Kernel Fusion for SYCL

Victor Perez, Lukas Sommer, Victor Lomüller, Kumudha Narasimhan, Mehdi Goli

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, OpenCL, Package, SYCL

November 27, 2022 by hgpu

Hardware Checkpointing and Productive Debugging Flows for FPGAs

Sameh Attia

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, Package, Thesis

November 20, 2022 by hgpu

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Maria Nektaria Xekalaki

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, FPGA, Heterogeneous systems, Java, nVidia, nVidia GeForce GTX 1060, nVidia Quadro GP100, OpenCL, Package, Performance, Tesla V100, Thesis

November 20, 2022 by hgpu

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

Richard Schoonhoven, Bram Veenboer, Ben van Werkhoven, Kees Joost Batenburg

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, nVidia, nVidia RTX A4000, OpenCL, Package, Tesla A100

November 20, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

Capturing the Memory Topology of GPUs

Dominik Größler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce 840 M, nVidia GeForce RTX 2080 Ti, nVidia Quadro P 6000, Package, Performance, PTX, Tesla K20, Tesla V100, Thesis

November 13, 2022 by hgpu

AutoDock-GPU: AutoDock for GPUs and other accelerators

Architecting Tensor Core-Based Reductions for Irregular Molecular Docking Kernels

NCCLX: collective communication framework

Collective Communication for 100k+ GPUs

Tutoring LLM into a Better CUDA Optimizer

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Genten: Software for Generalized Tensor Decompositions by Sandia National Laboratories

A Performance Portable Matrix Free Dense MTTKRP in GenTen

Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR

Pinocchio: PINpointing Orbit Crossing Collapsed Hierarchical Objects

Accelerating cosmological simulations on GPUs: a portable approach using OpenMP

KernelCoder: trained on a curated dataset of reasoning traces and CUDA kernel pairs

ConCuR: Conciseness Makes State-of-the-Art Kernel Generation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

Portable C++ Code that can Look and Feel Like Fortran Code with Yet Another Kernel Launcher (YAKL)

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads

Three Contributions to the Theory and Practice of Optimizing Compilers

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

User-Driven Online Kernel Fusion for SYCL

Hardware Checkpointing and Productive Debugging Flows for FPGAs

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

TorchOpt: An Efficient Library for Differentiable Optimization

Capturing the Memory Topology of GPUs

Recent source codes

AutoDock-GPU: AutoDock for GPUs and other accelerators

NCCLX: collective communication framework

Tutoring LLM into a Better CUDA Optimizer

Kernel Library for LLM Serving

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Genten: Software for Generalized Tensor Decompositions by Sandia National Laboratories

Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR

Pinocchio: PINpointing Orbit Crossing Collapsed Hierarchical Objects

KernelCoder: trained on a curated dataset of reasoning traces and CUDA kernel pairs

Most viewed papers (last 30 days)