high performance computing on graphics processing units: hgpu.org

hgpu.org » Neural networks

VitBit: Enhancing Embedded GPU Performance for AI Workloads through Register Operand Packing

Jaebeom Jeon, Minseong Gil, Junsu Kim, Jaeyong Park, Gunjae Koo, Myung Kuk Yoon, Yunho Oh

View

Tags: AI, Artificial intelligence, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia Jetson AGX Orin, Performance

September 1, 2024 by hgpu

Evaluating Operators in Deep Neural Networks for Improving Performance Portability of SYCL

Zheming Jin

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, HIP, Machine learning, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, nVidia H100, oneAPI, Performance, performance portability, SYCL, Tesla A100, Tesla V100

August 14, 2024 by hgpu

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Junqing Lin, Jingwei Sun, Xiaolong Shi, Honghe Zhang, Xianzhi Yu, Xinzhi Wang, Jun Yao, Guangzhong Sun

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080 Ti, Performance, Sparse matrix, Tesla V100

August 4, 2024 by hgpu

Data-driven Performance Optimization for Data-intensive Applications

Jie Liu

View

Download (PDF)

Tags: Computer science, Databases, Deep learning, Neural networks, nVidia, nVidia V100, TensorFlow, Thesis

July 28, 2024 by hgpu

COOK Access Control on an embedded Volta GPU

Benjamin Lesage, Frédéric Boniol, Claire Pagetti

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, nVidia Jetson AGX Xavier

June 23, 2024 by hgpu

Optimal Kernel Orchestration for Tensor Programs with Korch

Muyan Hu, Ashwin Venkatram, Shreyashri Biswas, Balamurugan Marimuthu, Bohan Hou, Gabriele Oliaro, Haojie Wang, Liyan Zheng, Xupeng Miao, Jidong Zhai

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, Neural networks, nVidia, nVidia A100, nVidia V100, Package, PyTorch

June 23, 2024 by hgpu

How much can we gain from Tensor Kernel Fusion on GPUs?

Wei Sun, Ang Li, Sander Stuijk, Henk Corporaal

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Matrix multiplication, Neural networks, nVidia, nVidia A100, nVidia H100

June 16, 2024 by hgpu

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

L.A. Torres, Carlos J. Barrios H, Yves Denneulin

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia A100, Package, Performance, SYCL

June 2, 2024 by hgpu

Kernel-Centric Optimizations for Deep Neural Networks on GPGPU

Zhaodong Chen

View

Download (PDF)

Tags: Computer science, Computer vision, CUDA, Deep learning, Neural networks, nVidia, nVidia A100, nVidia V100, Thesis

May 26, 2024 by hgpu

From GPUs to AI and quantum: three waves of acceleration in bioinformatics

Bertil Schmidt, Andreas Hildebrandt

View

Download (PDF)

Tags: Artificial intelligence, Bioinformatics, Biology, Chemistry, Neural networks, Quantum computing

May 20, 2024 by hgpu

High Performance Privacy Preserving AI

Jayavanth Shenoy, Patrick Grinaway, Shriphani Palakodety

View

Download (PDF)

Tags: AI, Artificial intelligence, Book, Computer science, Neural networks, Security

April 14, 2024 by hgpu

Using AI libraries for Incompressible Computational Fluid Dynamics

Boyang Chen, Claire E. Heaney, Christopher C. Pain

View

Download (PDF)

Tags: AI, Artificial intelligence, cfd, CUDA, Fluid dynamics, Neural networks, nVidia, Partial differential equations, PDEs, Tesla T4

March 3, 2024 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

VitBit: Enhancing Embedded GPU Performance for AI Workloads through Register Operand Packing

Evaluating Operators in Deep Neural Networks for Improving Performance Portability of SYCL

LO-SpMM: Low-cost Search for High-performance SpMM Kernels on GPUs

Data-driven Performance Optimization for Data-intensive Applications

COOK Access Control on an embedded Volta GPU

Optimal Kernel Orchestration for Tensor Programs with Korch

How much can we gain from Tensor Kernel Fusion on GPUs?

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

Kernel-Centric Optimizations for Deep Neural Networks on GPGPU

From GPUs to AI and quantum: three waves of acceleration in bioinformatics

High Performance Privacy Preserving AI

Using AI libraries for Incompressible Computational Fluid Dynamics

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)