high performance computing on graphics processing units: hgpu.org

hgpu.org » Deep learning

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

Efficient Incremental Text-to-Speech on GPUs

Muyang Du, Chuan Liu, Jiaxing Qi, Junjie Lai

View

Download (PDF)

Tags: Computer science, Deep learning, Machine learning, nVidia, nVidia A10, Tesla V100

December 4, 2022 by hgpu

User-Driven Online Kernel Fusion for SYCL

Victor Perez, Lukas Sommer, Victor Lomüller, Kumudha Narasimhan, Mehdi Goli

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, OpenCL, Package, SYCL

November 27, 2022 by hgpu

SciAI4Industry – Solving PDEs for industry-scale problems with deep learning

Philipp A. Witte, Russell J. Hewett, Kumar Saurabh, AmirHossein Sojoodi, Ranveer Chandra

View

Download (PDF)

Tags: AI, Cloud, Computational Physics, Computer science, Deep learning, Differential equations, Neural networks, nVidia, nVidia A100, nVidia DGX-A100, Partial differential equations, PDEs

November 27, 2022 by hgpu

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Saghar Irandoust, Thibaut Durand, Yunduz Rakhmangulova, Wenjie Zi, Hossein Hajimirsadeghi

View

Download (PDF)

Tags: Benchmarking, Computer science, Computer vision, Deep learning

November 20, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

A Study on Neural-based Code Summarization in Low-resource Settings

Yang He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, PyTorch, Software Engineering, Tesla V100, Thesis

November 13, 2022 by hgpu

iGniter: Interference-Aware GPU Resource Provisioning for Predictable DNN Inference in the Cloud

Fei Xu, Jianian Xu, Jiabin Chen, Li Chen, Ruitao Shang, Zhi Zhou, Fangming Liu

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Neural networks, nVidia, Package, Tesla V100

November 13, 2022 by hgpu

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

Guyue Huang, Yang Bai, Liu Liu, Yuke Wang, Bei Yu, Yufei Ding, Yuan Xie

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia A100

November 6, 2022 by hgpu

The Open MatSci ML Toolkit: A Flexible Framework for Machine Learning in Materials Science

Santiago Miret, Kin Long Kelvin Lee, Carmelo Gonzales, Marcel Nassar, Matthew Spellings

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, Deep learning, Machine learning, Materials Science, Neural networks, Package, Python

November 6, 2022 by hgpu

Benchmarking GPU and TPU Performance with Graph Neural Networks

Xiangyang Ju, Yunsong Wang, Daniel Murnane, Nicholas Choma, Steven Farrell, Paolo Calafiura

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia A100, Pattern recognition, Tesla V100, TPU

October 30, 2022 by hgpu

torchode: A Parallel ODE Solver for PyTorch

Marten Lienen, Stephan Günnemann

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Numerical Analysis, nVidia, nVidia GeForce GTX 1080 Ti, ODEs, Ordinary differential equations, Package, PyTorch

October 30, 2022 by hgpu

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Efficient Incremental Text-to-Speech on GPUs

User-Driven Online Kernel Fusion for SYCL

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

TorchOpt: An Efficient Library for Differentiable Optimization

A Study on Neural-based Code Summarization in Low-resource Settings

Enabling Data Movement and Computation Pipelining in Deep Learning Compiler

The Open MatSci ML Toolkit: A Flexible Framework for Machine Learning in Materials Science

Benchmarking GPU and TPU Performance with Graph Neural Networks

torchode: A Parallel ODE Solver for PyTorch

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)