high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications » Computer science

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

Thomas Bartz-Beielstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Package, Python, PyTorch, Tutorial

May 28, 2023 by hgpu

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Philip Salzmann, Fabian Knorr, Peter Thoman, Philipp Gschwandtner, Biagio Cosenza, Thomas Fahringer

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, GPU cluster, MPI, nVidia, nVidia V100, Package, SYCL

May 21, 2023 by hgpu

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Zhiyi Zhang, Pengfei Zhang, Qi Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Java, nVidia, nVidia GeForce RTX 3060 Ti, Package

May 21, 2023 by hgpu

Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

Juan Fumero, György Rethy, Athanasios Stratikopoulos, Nikos Foutris, Christos Kotselidis

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Heterogeneous systems, Java, OpenCL, Package

May 21, 2023 by hgpu

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Yueming Hao, Xu Zhao, Bin Bao, David Berard, Will Constable, Adnan Aziz, Xu Liu

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI210, ATI, Benchmarking, Computer science, Deep learning, nVidia, nVidia A100, Package, PyTorch

May 14, 2023 by hgpu

Descend: A Safe GPU Systems Programming Language

Bastian Köpcke, Sergei Gorlatch, Michel Steuwer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, OpenCL, Package, Programming Languages, Tesla P100

May 14, 2023 by hgpu

Prediction of Performance and Power Consumption of GPGPU Applications

Gargi Alavani, Santonu Sarkar

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, Java, Machine learning, nVidia, Package, Performance, PTX, Tesla K20, Thesis

May 14, 2023 by hgpu

Dynamically Finding Optimal Kernel Launch Parameters for CUDA Programs

Taabish Jeshani

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia GeForce RTX 2070, Package, Performance, Thesis

May 7, 2023 by hgpu

Redwood: Flexible and Portable Heterogeneous Tree Traversal Workloads

Yanwen Xu, Ang Li, Tyler Sorensen

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, FPGA, Heterogeneous systems, HLS, Intel UHD 630, nVidia, nVidia Jetson AGX Xavier, nVidia Jetson Nano, Package, Performance, SYCL

May 7, 2023 by hgpu

Optimizing Deep Learning Models For Raspberry Pi

Salem Ameen, Kangaranmulle Siriwardana, Theo Theodoridis

View

Download (PDF)

Source codes

Tags: ARM, Computer science, Deep learning, Package, Performance

May 7, 2023 by hgpu

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

Shixun Wu, Yujia Zhai, Jinyang Liu, Jiajun Huang, Zizhe Jian, Bryan M. Wong, Zizhong Chen

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, GEMM, Linear Algebra, Matrix multiplication, nVidia, nVidia A100, Package, Performance, Reliability, Tesla T4

May 7, 2023 by hgpu

FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs

Boyuan Zhang, Jiannan Tian, Sheng Di, Xiaodong Yu, Yunhe Feng, Xin Liang, Dingwen Tao, Franck Cappello

View

Download (PDF)

Source codes

Tags: Algorithms, Compression, Computer science, CUDA, nVidia, nVidia A100, nVidia RTX A4000, Package, Signal processing

May 7, 2023 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

PyTorch Hyperparameter Tuning – A Tutorial for spotPython

An Asynchronous Dataflow-Driven Execution Model For Distributed Accelerator Computing

Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

Experiences in Building a Composable and Functional API for Runtime SPIR-V Code Generation

TorchBench: Benchmarking PyTorch with High API Surface Coverage

Descend: A Safe GPU Systems Programming Language

Prediction of Performance and Power Consumption of GPGPU Applications

Dynamically Finding Optimal Kernel Launch Parameters for CUDA Programs

Redwood: Flexible and Portable Heterogeneous Tree Traversal Workloads

Optimizing Deep Learning Models For Raspberry Pi

Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs

FZ-GPU: A Fast and High-Ratio Lossy Compressor for Scientific Computing Applications on GPUs

Recent source codes

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Most viewed papers (last 30 days)