high performance computing on graphics processing units: hgpu.org

Xiaojie Wu, Qiming Sun, Zhichen Pu, Tianze Zheng, Wenzhi Ma, Wen Yan, Xia Yu, Zhengxiao Wu, Mian Huo, Xiang Li, Weiluo Ren, Sheng Gong, Yumin Zhang, Weihao Gao

View

Download (PDF)

Source codes

Tags: Chemical Physics, Chemistry, Computational Physics, CUDA, nVidia, nVidia A100, Package, Python, Quantum Physics

April 21, 2024 by hgpu

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

Feng Liang, Zhen Zhang, Haifeng Lu, Victor C. M. Leung, Yanyi Guo, Xiping Hu

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, nVidia, nVidia A100, survey, Task scheduling

April 21, 2024 by hgpu

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Deep Learning Inference on Heterogeneous Mobile Processors: Potentials and Pitfalls

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps

A Survey of Deep Learning Library Testing Methods

Automatic BLAS Offloading on Unified Memory Architecture: A Study on NVIDIA Grace-Hopper

GROMACS on AMD GPU-Based HPC Platforms: Using SYCL for Performance and Portability

Porting HPC Applications to AMD Instinct MI300A Using Unified Memory and OpenMP

Experiences with implementing Kokkos’ SYCL backend

Efficient Approaches for GEMM Acceleration on Leading AI-Optimized FPGAs

Software Optimization and Orchestration for Heterogeneous and Distributed Architectures

SimSYCL: A SYCL Implementation Targeting Development, Debugging, Simulation and Conformance

Python-Based Quantum Chemistry Calculations with GPU Acceleration

Communication-Efficient Large-Scale Distributed Deep Learning: A Comprehensive Survey

Recent source codes

OpScanner

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

INT v.s. FP: A framework to compare low-bit integer and float-point formats

AutoDock-GPU: AutoDock for GPUs and other accelerators

NCCLX: collective communication framework

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Most viewed papers (last 30 days)