high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Akash Dutta, Jordi Alcaraz, Ali TehraniJamsaz, Eduardo Cesar, Anna Sikora, Ali Jannesari

View

Tags: AMD Radeon HD 7970, ATI, Benchmarking, Computer science, Deep learning, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce GTX 970, OpenCL, OpenMP

May 14, 2023 by hgpu

Optimizing Deep Learning Models For Raspberry Pi

Salem Ameen, Kangaranmulle Siriwardana, Theo Theodoridis

View

Download (PDF)

Source codes

Tags: ARM, Computer science, Deep learning, Package, Performance

May 7, 2023 by hgpu

Energy-Efficient GPU Clusters Scheduling for Deep Learning

Diandian Gu, Xintong Xie, Gang Huang, Xin Jin, Xuanzhe Liu

View

Download (PDF)

Tags: Computer science, Deep learning, Energy-efficient computing, GPU cluster, Neural networks, nVidia, Tesla V100

April 16, 2023 by hgpu

PopSparse: Accelerated block sparse matrix multiplication on IPU

Zhiyi Li, Douglas Orr, Valeriu Ohan, Godfrey Da costa, Tom Murray, Adam Sanders, Deniz Beker, Dominic Masters

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Linear Algebra, Machine learning, Matrix multiplication, nVidia, nVidia A100, Package, Sparse matrix

April 2, 2023 by hgpu

Pgx: Hardware-accelerated parallel game simulation for reinforcement learning

Sotetsu Koyamada, Shinri Okano, Soichiro Nishimori, Yu Murata, Keigo Habara, Haruka Kita, Shin Ishii

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, nVidia, nVidia A100, Package

April 2, 2023 by hgpu

ARK: GPU-driven Code Execution for Distributed Deep Learning

Changho Hwang, KyoungSoo Park, Ran Shu, Xinyuan Qu, Peng Cheng, Yongqiang Xiong

View

Download (PDF)

Tags: Computer science, Deep learning, Distributed computing, nVidia, nVidia V100

March 12, 2023 by hgpu

A Deep Learning Model for Loop Interchange

Lina Mezdour, Khadidja Kadem, Massinissa Merouani, Amina Selma Haichour, Saman Amarasinghe, Riyadh Baghdadi

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, nVidia, nVidia DGX-A100, Package

March 12, 2023 by hgpu

DeepAxe: A Framework for Exploration of Approximation and Reliability Trade-offs in DNN Accelerators

Mahdi Taheri, Mohamad Riazati, Mohammad Hasan Ahmadilivani, Maksim Jenihhin, Masoud Daneshtalab, Jaan Raik, Mikael Sjodin, Bjorn Lisper

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Design space exploration, FPGA, HLS, Neural networks, Package

March 5, 2023 by hgpu

TLP: A Deep Learning-based Cost Model for Tensor Program Tuning

Yi Zhai, Yu Zhang, Shuo Liu, Xiaomeng Chu, Jie Peng, Jianmin Ji, Yanyong Zhang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, Optimization, Package, Tesla K80, Tesla T4

February 12, 2023 by hgpu

CMLCompiler: A Unified Compiler for Classical Machine Learning

Xu Wen, Wanling Gao, Anzheng Li, Lei Wang, Zihan Jiang, Jianfeng Zhan

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia Titan RTX

February 5, 2023 by hgpu

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Jinfan Chen, Shigang Li, Ran Gun, Jinhui Yuan, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia A100, Package, Tesla P100

January 22, 2023 by hgpu

Cramming: Training a Language Model on a Single GPU in One Day

Jonas Geiping, Tom Goldstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A4000, nVidia RTX A6000, Package

January 8, 2023 by hgpu

Specx: Speculative task-based runtime system

Specx: a C++ task-based runtime system for heterogeneous distributed architectures

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

KISim: Kubernetes Intelligent Scheduling Simulator

KIS-S: A GPU-Aware Kubernetes Inference Simulator with RL-Based Auto-Scaling

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication

exa-AMD: Exascale Accelerated Materials Discovery

Accelerated discovery and design of Fe-Co-Zr magnets with tunable magnetic anisotropy through machine learning and parallel computing

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

No More Shading Languages: Compiling C++ to Vulkan Shaders

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Performance Optimization using Multimodal Modeling and Heterogeneous GNN

Optimizing Deep Learning Models For Raspberry Pi

Energy-Efficient GPU Clusters Scheduling for Deep Learning

PopSparse: Accelerated block sparse matrix multiplication on IPU

Pgx: Hardware-accelerated parallel game simulation for reinforcement learning

ARK: GPU-driven Code Execution for Distributed Deep Learning

A Deep Learning Model for Loop Interchange

DeepAxe: A Framework for Exploration of Approximation and Reliability Trade-offs in DNN Accelerators

TLP: A Deep Learning-based Cost Model for Tensor Program Tuning

CMLCompiler: A Unified Compiler for Classical Machine Learning

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Cramming: Training a Language Model on a Single GPU in One Day

Recent source codes

Specx: Speculative task-based runtime system

Mutual-Supervised Learning for Sequential-to-Parallel Code Translation

KISim: Kubernetes Intelligent Scheduling Simulator

Hardware Compute Partitioning on NVIDIA GPUs for Composable Systems

Efficient GPU Implementation of Multi-Precision Integer Division

ParEval: A Parallel Code Evaluation Benchmark

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores

exa-AMD: Exascale Accelerated Materials Discovery

WiLLM: An Open Wireless LLM Communication System

Vcc: the Vulkan Clang Compiler

Most viewed papers (last 30 days)