high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Data-Driven Dynamic Autotuning: Optimizing Autotuning Overhead with Prior Tuning Data

Jaroslav Oľha

View

Tags: AMD Radeon RX Vega 56, ATI, Auto-Tuning, Computer science, Heterogeneous systems, nVidia, nVidia GeForce GTX 1070, nVidia GeForce GTX 680, nVidia GeForce GTX 750, nVidia GeForce RTX 2080 Ti, OpenCL, Performance, Tesla K20, Thesis

November 3, 2024 by hgpu

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Ferdi Kossmann, Bruce Fontaine, Daya Khudia, Michael Cafarella, Samuel Madden

View

Download (PDF)

Tags: Computer science, LLM, NLP, nVidia, nVidia A100, nVidia H100, Task scheduling

November 3, 2024 by hgpu

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Xiaoman Liu

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Performance, TensorFlow

November 3, 2024 by hgpu

Fastrack: Fast IO for Secure ML using GPU TEEs

Yongqin Wang, Rachit Rajat, Jonghyun Lee, Tingting Tang, Murali Annavaram

View

Download (PDF)

Tags: Cloud, Computer science, CUDA, Machine learning, nVidia, nVidia H100, Security

October 27, 2024 by hgpu

General-Purpose Computing on Tensor Processors

Kuan-Chieh Hsu

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, Heterogeneous systems, Machine learning, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, nVidia Jetson Nano, Package, Sparse matrix, Thesis, TPU

October 27, 2024 by hgpu

Using modern C++ to improve CUDA programs

Mythreya Kuricheti

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia Quadro RTX 5000, Performance, PTX, Thesis

October 27, 2024 by hgpu

Jailbreaking LLM-Controlled Robots

Alexander Robey, Zachary Ravichandran, Vijay Kumar, Hamed Hassani, George J. Pappas

View

Download (PDF)

Tags: Artificial intelligence, Computer science, LLM, Robotics, Security

October 27, 2024 by hgpu

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

Matteo Croci, Garth N. Wells

View

Download (PDF)

Source codes

Tags: AVX, Computer science, Finite element method, Floating point error, Intel, Matrix multiplication, Mixed precision, Package

October 27, 2024 by hgpu

Accelerating Drug Discovery in AutoDock-GPU with Tensor Cores

Gabin Schieffer, Ivy Peng

View

Download (PDF)

Tags: Chemistry, Computer science, CUDA, Macromolecule, molecular docking, nVidia, nVidia A100, nVidia V100, Physics, Tesla T4

October 20, 2024 by hgpu

Testing GPU Numerics: Finding Numerical Differences Between NVIDIA and AMD GPUs

Anwar Hossain Zahid, Ignacio Laguna, Wei Le

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, ATI, Computer science, CUDA, HIP, Numerical Analysis, nVidia, nVidia V100, Programming Languages

October 20, 2024 by hgpu

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

Xiongxiao Xu, Solomon Abera Bekele, Brice Videau, Kai Shu

View

Download (PDF)

Source codes

Tags: Computer science, Energy-efficient computing, HPC, Intel, Intel Data Center GPU Max 1550, Package

October 20, 2024 by hgpu

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Reza Abbasi, Sernam Lim

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, LLM, Machine learning, Memory, nVidia, nVidia GeForce RTX 3090, nVidia Quadro RTX 8000, Package

October 20, 2024 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Data-Driven Dynamic Autotuning: Optimizing Autotuning Overhead with Prior Tuning Data

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

General-Purpose Computing on Tensor Processors

Using modern C++ to improve CUDA programs

Jailbreaking LLM-Controlled Robots

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

Accelerating Drug Discovery in AutoDock-GPU with Tensor Cores

Testing GPU Numerics: Finding Numerical Differences Between NVIDIA and AMD GPUs

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)