high performance computing on graphics processing units: hgpu.org

hgpu.org » Auto-Tuning

Scheduling Languages: A Past, Present, and Future Taxonomy

Mary Hall, Cosmin Oancea, Anne C. Elster, Ari Rasch, Sameeran Joshi, Amir Mohammad Tavakkoli, Richard Schulze

View

Download (PDF)

Tags: Auto-Tuning, Compilers, Computer science, Performance, Programming Languages, Task scheduling

November 3, 2024 by hgpu

Data-Driven Dynamic Autotuning: Optimizing Autotuning Overhead with Prior Tuning Data

Jaroslav Oľha

View

Download (PDF)

Tags: AMD Radeon RX Vega 56, ATI, Auto-Tuning, Computer science, Heterogeneous systems, nVidia, nVidia GeForce GTX 1070, nVidia GeForce GTX 680, nVidia GeForce GTX 750, nVidia GeForce RTX 2080 Ti, OpenCL, Performance, Tesla K20, Thesis

November 3, 2024 by hgpu

Abstractions for C++ code optimizations in parallel high-performance applications

Jiří Klepl, Adam Šmelko, Lukáš Rozsypal, Martin Kruliš

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Computer science, CUDA, Data Structures and Algorithms, HPC, nVidia, Package, Tesla V100

August 25, 2024 by hgpu

STuning-DL: Model-Driven Autotuning of Sparse GPU Kernels for Deep Learning

Roberto L. Castro, Diego Andrade, Basilio B. Fraguela

View

Download (PDF)

Tags: Auto-Tuning, Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia A100, Tesla T4

May 26, 2024 by hgpu

Scalable Tuning of (OpenMP) GPU Applications via Kernel Record and Replay

Konstantinos Parasyris, Giorgis Georgakoudis, Esteban Rangel, Ignacio Laguna, Johannes Doerfert

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Auto-Tuning, Computer science, Heterogeneous systems, nVidia, nVidia V100, OpenMP, Package

December 18, 2023 by hgpu

Dynamic autotuning of SpMV kernel in CUSP library

Miroslav Demek

View

Download (PDF)

Tags: Auto-Tuning, Computer science, nVidia, nVidia GeForce GTX 1070, nVidia GeForce RTX 2080, Performance, Sparse matrix, Thesis

October 29, 2023 by hgpu

Towards a Benchmarking Suite for Kernel Tuners

Jacob O. Tørring, Ben van Werkhoven, Filip Petrovic, Floris-Jan Willemsen, Jirí Filipovic, Anne C. Elster

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Benchmarking, Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3060, nVidia GeForce RTX 3090, nVidia Titan RTX, Package, performance portability

March 19, 2023 by hgpu

Benchmarking optimization algorithms for auto-tuning GPU kernels

Richard Schoonhoven, Ben van Werkhoven, Kees Joost Batenburg

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Auto-Tuning, Benchmarking, Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce GTX 1080 Ti, nVidia GeForce GTX Titan X, nVidia Titan RTX, OpenCL, Performance, pyCUDA, PyOpenCL, Tesla K20, Tesla P100, Tesla V100

October 9, 2022 by hgpu

Autotuning CUDA: Applying NLP Techniques to LS-CAT

Lars Bjertnes, Jacob O. Tørring, Anne C. Elster

View

Download (PDF)

Tags: Auto-Tuning, Computer science, CUDA, Machine learning, NLP, nVidia

December 5, 2021 by hgpu

BAT: A Benchmark suite for AutoTuners

Ingunn Sund, Knut A. Kirkhorn, Jacob O. Tørring, Anne C. Elster

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Benchmarking, Computer science, CUDA, Heterogeneous systems, nVidia, nVidia GeForce GTX 980, Package, Performance, Tesla T4, Tesla V100

November 21, 2021 by hgpu

Bolt: Bridging the Gap between Auto-tuners and Hardware-native Performance

Jiarong Xing, Leyuan Wang, Shang Zhang, Jack Chen, Ang Chen, Yibo Zhu

View

Download (PDF)

Tags: Auto-Tuning, Computer science, CUDA, Deep learning, Neural networks, nVidia, Performance, Tesla T4

October 31, 2021 by hgpu

Using hardware performance counters to speed up autotuning convergence on GPUs

Jiří Filipovič, Jana Hozzová, Amin Nezarat, Jaroslav Oľha, Filip Petrovič

View

Download (PDF)

Source codes

Tags: Auto-Tuning, Computer science, CUDA, HPC, Machine learning, nVidia, nVidia GeForce GTX 1070, nVidia GeForce RTX 2080, OpenCL, Package, Performance, Vulkan

February 23, 2021 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Scheduling Languages: A Past, Present, and Future Taxonomy

Data-Driven Dynamic Autotuning: Optimizing Autotuning Overhead with Prior Tuning Data

Abstractions for C++ code optimizations in parallel high-performance applications

STuning-DL: Model-Driven Autotuning of Sparse GPU Kernels for Deep Learning

Scalable Tuning of (OpenMP) GPU Applications via Kernel Record and Replay

Dynamic autotuning of SpMV kernel in CUSP library

Towards a Benchmarking Suite for Kernel Tuners

Benchmarking optimization algorithms for auto-tuning GPU kernels

Autotuning CUDA: Applying NLP Techniques to LS-CAT

BAT: A Benchmark suite for AutoTuners

Bolt: Bridging the Gap between Auto-tuners and Hardware-native Performance

Using hardware performance counters to speed up autotuning convergence on GPUs

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)