high performance computing on graphics processing units: hgpu.org

Oliver Hennigh, Susheela Narasimhan, Mohammad Amin Nabian, Akshay Subramaniam, Kaustubh Tangsali, Max Rietmann, Jose del Aguila Ferrandis, Wonmin Byeon, Zhiwei Fang, Sanjay Choudhry

View

Download (PDF)

Tags: cfd, CUDA, Fluid dynamics, Linear Algebra, Machine learning, Neural networks, nVidia, nVidia A100, Partial differential equations, PDEs, Physics, Tesla V100, Video

December 20, 2020 by hgpu

NaturalCC: A Toolkit to Naturalize the Source Code Corpus

Yao Wan, Yang He, Jian-Guo Zhang, Yulei Sui, Hai Jin, Guandong Xu, Caiming Xiong, Philip S. Yu

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, NLP, nVidia, Package, Programming Languages, Python, Video

December 13, 2020 by hgpu

MSCCL++: A GPU-driven communication stack for scalable AI applications

MSCCL++: Rethinking GPU Communication Abstractions for Cutting-edge AI Applications

Benchmark compute shader of Unity against InteropUnityCUDA

InteropUnityCUDA: A Tool for Interoperability Between Unity and CUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

* * *

high performance computing on graphics processing units: hgpu.org

Hardware Acceleration of HPC Computational Flow Dynamics using HBM-enabled FPGAs

Interactive Parallelization of C Programs in SAPFOR

I/O Lower Bounds for Auto-tuning of Convolutions in CNNs

Fast CUDA-Aware MPI Datatypes without Platform Support

When Machine Learning Meets Quantum Computers: A Case Study

Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead

Exploiting BSP Abstractions for Compiler Based Optimizations of GPU Applications on multi-GPU Systems

Directive-Based Data Partitioning and Pipelining and Auto-Tuning for High-Performance GPU Computing

Highly Efficient Lattice-Boltzmann Multiphase Simulations of Immiscible Fluids at High-Density Ratios on CPUs and GPUs through Code Generation

Solving large permutation flow-shop scheduling problems on GPU-accelerated supercomputers

NVIDIA SimNet: an AI-accelerated multi-physics simulation framework

NaturalCC: A Toolkit to Naturalize the Source Code Corpus

Recent source codes

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Most viewed papers (last 30 days)