high performance computing on graphics processing units: hgpu.org

hgpu.org » Applications

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Jhe-Yu Liou, Muaaz Awan, Steven Hofmeyr, Stephanie Forrest, Carole-Jean Wu

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computer science, CUDA, Evolutionary Computations, Neural and Evolutionary Computing, nVidia, nVidia GeForce GTX 1080 Ti, Package, performance portability, Sequence alignment, Tesla P100, Tesla V100

September 4, 2022 by hgpu

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Mohammad K. Dashti

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, Memory model, nVidia, nVidia GeForce RTX 2070, nVidia Jetson TK1, OpenCL, Package, Thesis

August 28, 2022 by hgpu

Fully Concurrent GPU Data Structures

Muhammad Abdelghaffar Awad

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data Structures and Algorithms, nVidia, nVidia GeForce GTX Titan V, Package, Tesla V100

August 28, 2022 by hgpu

Long Code for Code Search

Fan Hu, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Xirong Li

View

Download (PDF)

Tags: Computer science, Deep learning, NLP, nVidia, Software Engineering, Tesla V100

August 28, 2022 by hgpu

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Hamdy Abdelkhalik, Yehia Arafa, Nandakishore Santhi, Abdel-Hameed Badawy

View

Download (PDF)

Tags: Benchmarking, Computer science, Hardware Architecture, Latency, nVidia, nVidia A100, Performance, PTX

August 28, 2022 by hgpu

Exploring Thread Coarsening on FPGA

Mostafa Eghbali Zarch, Reece Neff, Michela Becchi

View

Download (PDF)

Tags: Compilers, Computer science, FPGA, OpenCL, Performance, performance portability

August 28, 2022 by hgpu

BenchPress: A Deep Active Benchmark Generator

Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu, Chris Cummins, Kim Hazelwood, Ajitha Rajan, Hugh Leather

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, PyTorch

August 21, 2022 by hgpu

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Igor Baratta, Chris Richardson, Garth Wells

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Latency, nVidia, nVidia A100, OpenCL, Package, Performance, SYCL

August 21, 2022 by hgpu

Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training

Jie You, Jae-Won Chung, Mosharaf Chowdhury

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, Energy-efficient computing, Neural networks, nVidia, Package, Tesla V100

August 21, 2022 by hgpu

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, nVidia A40, Package, PyTorch

August 21, 2022 by hgpu

Optimization of GPU workloads using natural language processing based on deep learning techniques

Petros Vavaroutsos

View

Download (PDF)

Tags: ATI, ATI Radeon HD 7970, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 970, OpenCL, Thesis

August 21, 2022 by hgpu

Deep Learning Approaches to Source Code Analysis for Optimization of Heterogeneous Systems: Recent Results, Challenges and Opportunities

Francesco Barchi, Emanuele Parisi, Andrea Bartolini, Andrea Acquaviva

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Heterogeneous systems, nVidia, nVidia GeForce GTX 970, OpenCL, Optimization, Overview, Security

August 7, 2022 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

GigaAPI for GPU Parallelization

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Understanding the Power of Evolutionary Computation for GPU Code Optimization

Towards Understanding and Mitigating Memory-Access Challenges in Computing Systems

Fully Concurrent GPU Data Structures

Long Code for Code Search

Demystifying the Nvidia Ampere Architecture through Microbenchmarking and Instruction-level Analysis

Exploring Thread Coarsening on FPGA

BenchPress: A Deep Active Benchmark Generator

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Zeus: Understanding and Optimizing GPU Energy Consumption of DNN Training

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Optimization of GPU workloads using natural language processing based on deep learning techniques

Deep Learning Approaches to Source Code Analysis for Optimization of Heterogeneous Systems: Recent Results, Challenges and Opportunities

Recent source codes

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

GigaAPI: a user-space API that simplifies multi-GPU programming, bridging the gap between the capabilities of parallel GPU systems and the ability of developers to harness their full potential

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Most viewed papers (last 30 days)