high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications » Computer science

PIGEON: Optimizing CUDA Code Generator for End-to-End Training and Inference of Relational Graph Neural Networks

Kun Wu, Mert Hidayetoğlu, Xiang Song, Sitao Huang, Da Zheng, Israt Nisa, Wen-mei Hwu

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, Heterogeneous systems, Neural networks, nVidia, nVidia GeForce RTX 3090

January 22, 2023 by hgpu

Analyzing Resource Utilization in an HPC System: A Case Study of NERSC’s Perlmutter

Jie Li, George Michelogiannakis, Brandon Cook, Dulanya Cooray, Yong Chen

View

Download (PDF)

Tags: Computer science, HPC, nVidia, nVidia A100, Performance

January 22, 2023 by hgpu

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

Jinfan Chen, Shigang Li, Ran Gun, Jinhui Yuan, Torsten Hoefler

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Distributed computing, nVidia, nVidia A100, Package, Tesla P100

January 22, 2023 by hgpu

A Programming Model for GPU Load Balancing

Muhammad Osama, Serban D. Porumbescu, John D. Owens

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, load balancing, nVidia, Package, Tesla V100

January 15, 2023 by hgpu

Improving the scalability of modern applications by parallel multi-core and many-core programming

Alessandro Borione

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Graph theory, nVidia, nVidia GeForce RTX 3070, OpenCL, Thesis

January 15, 2023 by hgpu

Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

Nina Herrmann, Herbert Kuchen

View

Download (PDF)

Tags: Computer science, CUDA, Distributed computing, Heterogeneous systems, nVidia, nVidia GeForce GTX 750 Ti, nVidia GeFroce RTX 2080 Ti, nVidia Quadro K620

January 15, 2023 by hgpu

OpenMP Advisor

Alok Mishra, Abid M. Malik, Meifeng Lin, Barbara Chapman

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Benchmarking, Computer science, Heterogeneous systems, Machine learning, nVidia, nVidia GeForce RTX 2080, OpenMP, Tesla A100, Tesla K80, Tesla V100

January 15, 2023 by hgpu

Myths and Legends in High-Performance Computing

Satoshi Matsuoka, Jens Domke, Mohamed Wahib, Aleksandr Drozd, Torsten Hoefler

View

Download (PDF)

Tags: Algorithms, Computer science, HPC

January 15, 2023 by hgpu

A Domain-Extensible Compiler with Controllable Automation of Optimisations

Thomas Kœhler

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, DSL, Heterogeneous systems, Image processing, Machine learning, OpenCL, Package, Thesis

January 8, 2023 by hgpu

Cramming: Training a Language Model on a Single GPU in One Day

Jonas Geiping, Tom Goldstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A4000, nVidia RTX A6000, Package

January 8, 2023 by hgpu

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

Jianhui Li, Zhennan Qin, Yijie Mei, Jingze Cui, Yunfei Song, Ciyong Chen, Yifei Zhang, Longsheng Du, Xianhang Cheng, Baihui Jin, Jason Ye, Eric Lin, Dan Lavery

View

Download (PDF)

Source codes

Tags: Code generation, Compilers, Computer science, Deep learning, OpenCL, Package

January 8, 2023 by hgpu

BaCO: A Fast and Portable Bayesian Compiler Optimization Framework

Erik Hellsten, Artur Souza, Johannes Lenfers, Rubens Lacouture, Olivia Hsu, Adel Ejjeh, Fredrik Kjolstad, Michel Steuwer, Kunle Olukotun, Luigi Nardi

View

Download (PDF)

Source codes

Tags: Bayesian, Compilers, Computer science, FPGA, nVidia, OpenCL, Package, Performance, Programming Languages, Tesla K80

January 8, 2023 by hgpu

CFAL-bench

Comparing Parallel Functional Array Languages: Programming and Performance

Efficient Graph Embedding at Scale: Optimizing CPU-GPU-SSD Integration

Can Large Language Models Predict Parallel Code Performance?

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

PIGEON: Optimizing CUDA Code Generator for End-to-End Training and Inference of Relational Graph Neural Networks

Analyzing Resource Utilization in an HPC System: A Case Study of NERSC’s Perlmutter

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication

A Programming Model for GPU Load Balancing

Improving the scalability of modern applications by parallel multi-core and many-core programming

Distributed Calculations with Algorithmic Skeletons for Heterogeneous Computing Environments

OpenMP Advisor

Myths and Legends in High-Performance Computing

A Domain-Extensible Compiler with Controllable Automation of Optimisations

Cramming: Training a Language Model on a Single GPU in One Day

oneDNN Graph Compiler: A Hybrid Approach for High-Performance Deep Learning Compilation

BaCO: A Fast and Portable Bayesian Compiler Optimization Framework

Recent source codes

CFAL-bench

Efficient Graph Embedding at Scale: Optimizing CPU-GPU-SSD Integration

Can Large Language Models Predict Parallel Code Performance?

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

Most viewed papers (last 30 days)