high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, NLP, nVidia, nVidia A100, Package

September 11, 2022 by hgpu

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Re'em Harel, Matan Rusanovsky, Ron Wagner, Harel Levin, Gal Oren

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Fortran, HPC, MPI, Package, Performance

September 11, 2022 by hgpu

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

Tsung-Wei Huang

View

Download (PDF)

Tags: AMD Radeon RX 6900 XT, ATI, Computer science, Deep learning, nVidia, nVidia GeForce RTX 3090, OpenCL, performance portability, PyTorch, SYCL

September 11, 2022 by hgpu

GGArray: A Dynamically Growable GPU Array

Enzo meneses, Cristóbal A. Navarro, Héctor Ferrada

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, Memory, nVidia, nVidia A100, nVidia Titan RTX

September 4, 2022 by hgpu

Lina: a fast design optimisation tool for software-based FPGA programming

Andre Bannwart Perina

View

Download (PDF)

Source codes

Tags: Computer science, Design space exploration, FPGA, nVidia, nVidia Quadro K620, OpenCL, Package, Thesis

September 4, 2022 by hgpu

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Petros Vavaroutsos, Ioannis Oroutzoglou, Dimosthenis Masouros, Dimitrios Soudris

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX 970, OpenCL

September 4, 2022 by hgpu

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Jhe-Yu Liou, Muaaz Awan, Steven Hofmeyr, Stephanie Forrest, Carole-Jean Wu

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, nVidia GeForce GTX 1080 Ti, Package, performance portability, Sequence alignment, Tesla P100, Tesla V100

September 4, 2022 by hgpu

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Mohammad K. Dashti

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Memory model, nVidia, nVidia GeForce RTX 2070, nVidia Jetson TK1, OpenCL, Package, Thesis

August 28, 2022 by hgpu

Fully Concurrent GPU Data Structures

Muhammad Abdelghaffar Awad

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data Structures and Algorithms, nVidia, nVidia GeForce GTX Titan V, Package, Tesla V100

August 28, 2022 by hgpu

Long Code for Code Search

Fan Hu, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Xirong Li

View

Download (PDF)

Tags: Computer science, Deep learning, NLP, nVidia, Software Engineering, Tesla V100

August 28, 2022 by hgpu

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Hamdy Abdelkhalik, Yehia Arafa, Nandakishore Santhi, Abdel-Hameed Badawy

View

Download (PDF)

Tags: Benchmarking, Computer science, Hardware Architecture, Latency, nVidia, nVidia A100, Performance, PTX

August 28, 2022 by hgpu

Exploring Thread Coarsening on FPGA

Mostafa Eghbali Zarch, Reece Neff, Michela Becchi

View

Download (PDF)

Tags: Compilers, Computer science, FPGA, OpenCL, Performance, performance portability

August 28, 2022 by hgpu

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Compiler and Runtime Systems for Generative AI Models

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

SCALSALE: Scalable SALE Benchmark Framework for Supercomputers

Enhancing the Performance Portability of Heterogeneous Circuit Analysis Programs

GGArray: A Dynamically Growable GPU Array

Lina: a fast design optimisation tool for software-based FPGA programming

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Fully Concurrent GPU Data Structures

Long Code for Code Search

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Exploring Thread Coarsening on FPGA

Recent source codes

OpScanner

Atlas CLI: Machine Learning (ML) Lifecycle & Transparency Manager

transformers_tvm: Implementation of Encoder Decoder transformer on TVM

INT v.s. FP: A framework to compare low-bit integer and float-point formats

AutoDock-GPU: AutoDock for GPUs and other accelerators

NCCLX: collective communication framework

Tutoring LLM into a Better CUDA Optimizer

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Kernel Library for LLM Serving

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Most viewed papers (last 30 days)