high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications » Computer science

Futhark Vulkan Backend

Steffen Holst Larsen

View

Download (PDF)

Source codes

Tags: Computer science, nVidia, nVidia GeForce GTX 780 Ti, OpenCL, Package, Vulkan

September 29, 2019 by hgpu

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, Bryan Catanzaro

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia DGX-2, Package, Tesla V100

September 22, 2019 by hgpu

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

Yiming Wang, Tongfei Chen, Hainan Xu, Shuoyang Ding, Hang Lv, Yiwen Shao, Nanyun Peng, Lei Xie, Shinji Watanabe, Sanjeev Khudanpur

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1080 Ti, Package, Speech recognition

September 22, 2019 by hgpu

Parallelizing Multiple Flow Accumulation Algorithm using CUDA and OpenACC

Natalija Stojanovic, Dragan Stojanovic

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, nVidia, OpenACC, Package, Tesla K80

September 15, 2019 by hgpu

Characterizing and Predicting Scientific Workloads for Heterogeneous Computing Systems

Beau Johnston

View

Download (PDF)

Source codes

Tags: Algorithms, AMD Radeon RX 480, ATI Radeon HD 7970, Benchmarking, Computer science, FPGA, Heterogeneous systems, Intel Xeon Phi, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, Tesla K20, Tesla K40, Thesis

September 15, 2019 by hgpu

Efficient Interleaved Batch Matrix Solvers for CUDA

Andrew Gloster, Enda Carroll, Miguel Bustamante, Lennon O'Naraigh

View

Download (PDF)

Source codes

Tags: Algorithms, Computational Physics, Computer science, CUDA, Matrix inversion, nVidia, Package, Tesla V100

September 15, 2019 by hgpu

ArborX: A Performance Portable Search Library

D. Lebrun-Grandie, A. Prokopenko, B. Turcksin, S. R. Slattery

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Mathematical Software, MPI, OpenMP, Package, performance portability

September 8, 2019 by hgpu

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow

Xuezhe Ma, Chunting Zhou, Xian Li, Graham Neubig, Eduard Hovy

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce GTX Titan X, Package

September 8, 2019 by hgpu

Compositional Deep Learning in Futhark

Duc Minh Tran, Troels Henriksen, Martin Elsman

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 2080 Ti, Package, TensorFlow

September 1, 2019 by hgpu

Demystifying the MLPerf Benchmark Suite

Snehil Verma, Qinzhe Wu, Bagus Hanindhito, Gunjan Jha, Eugene B. John, Ramesh Radhakrishnan, Lizy K. John

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Deep learning, Machine learning, nVidia, Package, Tesla P100, Tesla V100

September 1, 2019 by hgpu

stdgpu: Efficient STL-like Data Structures on the GPU

Patrick Stotko

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data Structures and Algorithms, nVidia, Package

August 25, 2019 by hgpu

Memory-Efficient Object-Oriented Programming on GPUs

Matthias Springer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce GTX 940 M, nVidia GeForce GTX 980, nVidia GeForce GTX Titan XP, Package, Programming Languages, Thesis

August 25, 2019 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Packages

Futhark Vulkan Backend

Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Espresso: A Fast End-to-end Neural Speech Recognition Toolkit

Parallelizing Multiple Flow Accumulation Algorithm using CUDA and OpenACC

Characterizing and Predicting Scientific Workloads for Heterogeneous Computing Systems

Efficient Interleaved Batch Matrix Solvers for CUDA

ArborX: A Performance Portable Search Library

FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow

Compositional Deep Learning in Futhark

Demystifying the MLPerf Benchmark Suite

stdgpu: Efficient STL-like Data Structures on the GPU

Memory-Efficient Object-Oriented Programming on GPUs

Recent source codes

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Most viewed papers (last 30 days)