high performance computing on graphics processing units: hgpu.org

hgpu.org » Neural networks

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Zhihe Zhao, Neiwen Ling, Nan Guan, Guoliang Xing

View

Tags: Benchmarking, Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia GeForce RTX 2060, nVidia Jetson TX2

July 16, 2023 by hgpu

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Pablo Antonio Martínez Sánchez

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 2080 Ti, Performance, performance portability, Thesis

July 16, 2023 by hgpu

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

James Gleeson

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 480, nVidia GeForce RTX 2080 Ti, nVidia Grid K1, Optimization, Package, Performance, Tesla V100, Thesis, Virtualization

July 2, 2023 by hgpu

Improving Performance of Iterative Applications through Interleaved Execution of Approximated CUDA Kernels

Gabriel Freytag

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, Mixed precision, Neural networks, nVidia, nVidia A100, nVidia P100, Thesis

June 18, 2023 by hgpu

A High-Performance Computing Cluster for Distributed Deep Learning: A Practical Case of Weed Classification Using Convolutional Neural Network Models

Manuel López-Martínez, Germán Díaz-Flórez, Santiago Villagrana-Barraza, Luis O. Solís-Sánchez, Héctor A. Guerrero-Osuna, Genaro M. Soto-Zarazúa, Carlos A. Olvera-Olvera

View

Download (PDF)

Tags: CUDA, Deep learning, Distributed computing, HPC, Image processing, Neural networks, nVidia, nVidia GeForce GTX 1050 Ti

June 4, 2023 by hgpu

Communication-minimizing Asynchronous Tensor Parallelism

Siddharth Singh, Zack Sating, Abhinav Bhatele

View

Download (PDF)

Tags: Computer science, CUDA, GPU cluster, Neural networks, nVidia, nVidia A100

May 28, 2023 by hgpu

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Akash Dutta, Jordi Alcaraz, Ali TehraniJamsaz, Eduardo Cesar, Anna Sikora, Ali Jannesari

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Benchmarking, Computer science, Deep learning, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 970, OpenCL, OpenMP

May 14, 2023 by hgpu

ParaGraph: Weighted Graph Representation for Performance Optimization of HPC Kernels

Ali TehraniJamsaz, Alok Mishra, Akash Dutta, Abid M. Malik, Barbara Chapman, Ali Jannesari

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Computer science, HPC, Machine learning, Neural networks, nVidia, nVidia V100, OpenMP, Performance

April 16, 2023 by hgpu

Energy-Efficient GPU Clusters Scheduling for Deep Learning

Diandian Gu, Xintong Xie, Gang Huang, Xin Jin, Xuanzhe Liu

View

Download (PDF)

Tags: Computer science, Deep learning, Energy-efficient computing, GPU cluster, Neural networks, nVidia, Tesla V100

April 16, 2023 by hgpu

Task parallelism-based architectures on FPGA to optimize the energy efficiency of AI at the edge

Rafael Gadea-Gironés, Jorge Fe, Jose M. Monzo

View

Download (PDF)

Tags: Artificial intelligence, Computer science, Energy-efficient computing, FPGA, Neural networks, OpenCL

April 2, 2023 by hgpu

DeepAxe: A Framework for Exploration of Approximation and Reliability Trade-offs in DNN Accelerators

Mahdi Taheri, Mohamad Riazati, Mohammad Hasan Ahmadilivani, Maksim Jenihhin, Masoud Daneshtalab, Jaan Raik, Mikael Sjodin, Bjorn Lisper

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Design space exploration, FPGA, HLS, Neural networks, Package

March 5, 2023 by hgpu

PIGEON: Optimizing CUDA Code Generator for End-to-End Training and Inference of Relational Graph Neural Networks

Kun Wu, Mert Hidayetoğlu, Xiang Song, Sitao Huang, Da Zheng, Israt Nisa, Wen-mei Hwu

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce RTX 3090

January 22, 2023 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU

Improving the Performance, Portability, and Productivity of Hardware Accelerators

Managing, Profiling, and Optimizing Heterogeneous GPU Workloads

Improving Performance of Iterative Applications through Interleaved Execution of Approximated CUDA Kernels

A High-Performance Computing Cluster for Distributed Deep Learning: A Practical Case of Weed Classification Using Convolutional Neural Network Models

Communication-minimizing Asynchronous Tensor Parallelism

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

ParaGraph: Weighted Graph Representation for Performance Optimization of HPC Kernels

Energy-Efficient GPU Clusters Scheduling for Deep Learning

Task parallelism-based architectures on FPGA to optimize the energy efficiency of AI at the edge

DeepAxe: A Framework for Exploration of Approximation and Reliability Trade-offs in DNN Accelerators

PIGEON: Optimizing CUDA Code Generator for End-to-End Training and Inference of Relational Graph Neural Networks

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)