high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia DGX-2

RDMA-Based Algorithms for Sparse Matrix Multiplication on GPUs

Benjamin Brock, Aydın Buluç, Katherine Yelick

View

Tags: Algorithms, Computer science, CUDA, Matrix multiplication, MPI, nVidia, nVidia DGX-2, Sparse matrix, Tesla V100

December 3, 2023 by hgpu

CoCoNet: Co-Optimizing Computation and Communication for Distributed Machine Learning

Abhinav Jangda, Jun Huang, Guodong Liu, Amir Hossein Nodehi Sabet, Saeed Maleki, Youshan Miao, Madanlal Musuvathi, Todd Mytkowicz, Olli Sarikivi

View

Tags: Code generation, Computer science, CUBLAS, CUDA, Deep learning, Machine learning, nVidia, nVidia DGX-2

May 23, 2021 by hgpu

tcFFT: Accelerating Half-Precision FFT through Tensor Cores

Binrui Li, Shenggan Cheng, James Lin

View

Tags: Computer science, FFT, Mixed precision, nVidia, nVidia DGX-2, nVidia DGX-A100, Tesla V100

May 2, 2021 by hgpu

GPU-Accelerated Drug Discovery with Docking on the Summit Supercomputer: Porting, Optimization, and Application to COVID-19 Research

Scott LeGrand, Aaron Scheinberg, Andreas F. Tillack, Mathialakan Thavappiragasam, Josh V. Vermaas, Rupesh Agarwal, Jeff Larkin, Duncan Poole, Diogo Santos-Martins, Leonardo Solis-Vasquez, Andreas Koch, Stefano Forli, Oscar Hernandez, Jeremy C. Smith, Ada Sedova

View

Tags: Biology, Biomolecules, Computational biology, CUDA, molecular docking, nVidia, nVidia DGX-2, nVidia GeForce RTX 2080 Ti, OpenCL, supercomputer, Tesla V100

July 12, 2020 by hgpu

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Performance Analysis of Deep Learning Workloads on Leading-edge Systems

Yihui Ren, Shinjae Yoo, Adolfy Hoisie

View

Tags: Cloud, Computer science, Computer vision, CUDA, Deep learning, Machine learning, NLP, nVidia, nVidia DGX-2, nVidia GeForce RTX 2080 Ti, Performance, Tesla V100

May 23, 2019 by hgpu

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

Kokkidio: Fast, expressive, portable code, based on Kokkos and Eigen

LLaMA-Inference-Bench

LLM-Inference-Bench: Inference Benchmarking of Large Language Models on AI Accelerators

MATAR

On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures

Over-synchronization in GPU Programs

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

* * *

HGPU group © 2010-2024 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: