high performance computing on graphics processing units: hgpu.org

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

Increased reliability on Intel GPUs via software diverse redundancy

Nikolaos Andriotis

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, MPI, nVidia, OpenCL, Thesis

August 20, 2023 by hgpu

Monadic Deep Learning

Bo Yang, Zhihao Zhang Kirisame Marisa, Kai Shi

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Java, Neural networks, OpenCL, Package, Scala

July 30, 2023 by hgpu

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Zhihe Zhao, Neiwen Ling, Nan Guan, Guoliang Xing

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce RTX 2060, nVidia Jetson TX2

July 16, 2023 by hgpu

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

View

Download (PDF)

Tags: Computer science, Deep learning, nVidia, nVidia Titan RTX, Performance, PyTorch

July 9, 2023 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Frameworks in Medical Image Analysis with Deep Neural Networks

Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPU

Redco: A Lightweight Tool to Automate Distributed Training of LLMs on Any GPU/TPUs

GEVO-ML: Optimizing Machine Learning Code with Evolutionary Computation

Predicting the Execution Time of a kernel on a specific GPU using PTX code

Novel Parallelization Strategies for High-Performance DNN Training on HPC Systems

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

Increased reliability on Intel GPUs via software diverse redundancy

Monadic Deep Learning

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Improving Automatic Parallel Training via Balanced Memory Workload Optimization

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)