high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

SciAI4Industry – Solving PDEs for industry-scale problems with deep learning

Philipp A. Witte, Russell J. Hewett, Kumar Saurabh, AmirHossein Sojoodi, Ranveer Chandra

View

Tags: AI, Cloud, Computational Physics, Computer science, Deep learning, Differential equations, Neural networks, nVidia, nVidia A100, nVidia DGX-A100, Partial differential equations, PDEs

November 27, 2022 by hgpu

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Saghar Irandoust, Thibaut Durand, Yunduz Rakhmangulova, Wenjie Zi, Hossein Hajimirsadeghi

View

Download (PDF)

Tags: Benchmarking, Computer science, Computer vision, Deep learning

November 20, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

A Study on Neural-based Code Summarization in Low-resource Settings

Yang He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, PyTorch, Software Engineering, Tesla V100, Thesis

November 13, 2022 by hgpu

iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

Fei Xu, Jianian Xu, Jiabin Chen, Li Chen, Ruitao Shang, Zhi Zhou, Fangming Liu

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Neural networks, nVidia, Package, Tesla V100

November 13, 2022 by hgpu

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

Guyue Huang, Yang Bai, Liu Liu, Yuke Wang, Bei Yu, Yufei Ding, Yuan Xie

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100

November 6, 2022 by hgpu

The Open MatSci ML Toolkit: A Flexible Framework for Machine Learning in Materials Science

Santiago Miret, Kin Long Kelvin Lee, Carmelo Gonzales, Marcel Nassar, Matthew Spellings

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Machine learning, Materials Science, Neural networks, Package, Python

November 6, 2022 by hgpu

Benchmarking GPU and TPU Performance with Graph Neural Networks

Xiangyang Ju, Yunsong Wang, Daniel Murnane, Nicholas Choma, Steven Farrell, Paolo Calafiura

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia A100, Pattern recognition, Tesla V100, TPU

October 30, 2022 by hgpu

torchode: A Parallel ODE Solver for PyTorch

Marten Lienen, Stephan Günnemann

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Numerical Analysis, nVidia, nVidia GeForce GTX 1080 Ti, ODEs, Ordinary differential equations, Package, PyTorch

October 30, 2022 by hgpu

Dataloader Parameter Tuner: An Automated Dataloader Parameter Tuner for Deep Learning Models

JooYoung Park, DoangJoo Synn, XinYu Piao, Jong-Kook Kim

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 3080 Ti, Performance, Prefetch

October 16, 2022 by hgpu

Bottleneck Analysis of Dynamic Graph Neural Network Inference on CPU and GPU

Hanqiu Chen, Yahya Alhinai, Yihan Jiang, Eunjee Na, Cong Hao

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Neural networks, nVidia, nVidia RTX A6000, Package

October 16, 2022 by hgpu

Decompiling x86 Deep Neural Network Executables

Zhibo Liu, Yuanyuan Yuan, Shuai Wang, Xiaofei Xie, Lei Ma

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce RTX 2080, OpenCL, Package, Security

October 9, 2022 by hgpu

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Accelerating a Linear Programming Algorithm on AMD GPUs

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Towards Efficient and Practical GPU Multitasking in the Era of LLM

Bandicoot: C++ library for GPU accelerated linear algebra

Bandicoot: A Templated C++ Library for GPU Linear Algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

The Fused Kernel Library: A C++ API to Develop Highly-Efficient GPU Libraries

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

SIGMo: High-Throughput Batched Subgraph Isomorphism on GPUs for Molecular Matching

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

DGEMM without FP64 Arithmetic – using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

TorchOpt: An Efficient Library for Differentiable Optimization

A Study on Neural-based Code Summarization in Low-resource Settings

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

The Open MatSci ML Toolkit: A Flexible Framework for Machine Learning in Materials Science

Benchmarking GPU and TPU Performance with Graph Neural Networks

torchode: A Parallel ODE Solver for PyTorch

Dataloader Parameter Tuner: An Automated Dataloader Parameter Tuner for Deep Learning Models

Bottleneck Analysis of Dynamic Graph Neural Network Inference on CPU and GPU

Decompiling x86 Deep Neural Network Executables

Recent source codes

torchPDLP: Primal-Dual Linear Programming in PyTorch. In collaboration with AMD and IPAM

Benchmarks for Dissecting CPU-GPU Unified Physical Memory on AMD MI300A APUs

kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference

Bandicoot: C++ library for GPU accelerated linear algebra

Luthier: Bridging Auto-Tuning and Vendor Libraries for Efficient Deep Learning Inference

Fused Kernel Library (FKL)

GPUHammer: Rowhammer Attacks on GPU Memories are Practical

Block: Balance Loader of LLM Serving with Context, Knowledge and Predictive Scheduling

SIGMo: Scalable Isomorphism Graph Matching on GPUs

DGEMM without FP64 Arithmetic - using FP64 Emulation and FP8 Tensor Cores with Ozaki Scheme

Most viewed papers (last 30 days)