high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Exploring Thread Coarsening on FPGA

Mostafa Eghbali Zarch, Reece Neff, Michela Becchi

View

Download (PDF)

Tags: Compilers, Computer science, FPGA, OpenCL, Performance, performance portability

August 28, 2022 by hgpu

BenchPress: A Deep Active Benchmark Generator

Foivos Tsimpourlas, Pavlos Petoumenos, Min Xu, Chris Cummins, Kim Hazelwood, Ajitha Rajan, Hugh Leather

View

Download (PDF)

Source codes

Tags: Benchmarking, Code generation, Computer science, Deep learning, nVidia, nVidia GeForce GTX 1080, OpenCL, Package, PyTorch

August 21, 2022 by hgpu

Performance analysis of matrix-free conjugate gradient kernels using SYCL

Igor Baratta, Chris Richardson, Garth Wells

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Latency, nVidia, nVidia A100, OpenCL, Package, Performance, SYCL

August 21, 2022 by hgpu

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, nVidia A40, Package, PyTorch

August 21, 2022 by hgpu

Optimization of GPU workloads using natural language processing based on deep learning techniques

Petros Vavaroutsos

View

Download (PDF)

Tags: ATI, ATI Radeon HD 7970, Computer science, CUDA, Deep learning, Machine learning, Neural networks, nVidia, nVidia GeForce GTX 970, OpenCL, Thesis

August 21, 2022 by hgpu

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

Jose González-Abad, Álvaro López García, Valentin Y. Kozlov

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, HPC, nVidia, nVidia GeForce GTX 980 Ti, Package, Tesla V100

August 7, 2022 by hgpu

Deep Learning Approaches to Source Code Analysis for Optimization of Heterogeneous Systems: Recent Results, Challenges and Opportunities

Francesco Barchi, Emanuele Parisi, Andrea Bartolini, Andrea Acquaviva

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Heterogeneous systems, nVidia, nVidia GeForce GTX 970, OpenCL, Optimization, Overview, Security

August 7, 2022 by hgpu

COX: Exposing CUDA Warp-Level Functions to CPUs

Ruobing Han, Jaewon Lee, Jaewoong Sim, Hyesoon Kim

View

Download (PDF)

Tags: Benchmarking, Compilers, Computer science, CUDA, HIP, nVidia

August 7, 2022 by hgpu

Design and Implementation of ShenWei Universal C/C++

Huanqi Cao, Jiajie Chen

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL

August 7, 2022 by hgpu

Real-Time High-Performance Computing for Embedded Control Systems

Alejandro Josué Calderón Torres

View

Download (PDF)

Tags: Code generation, Computer science, Embedded high-performance computing, nVidia, nVidia Jetson AGX Xavier, nVidia Jetson Nano, nVidia Jetson TX2, OpenCL, Tesla T4, Tesla V100, Thesis

August 7, 2022 by hgpu

Demystifying Dependency Bugs in Deep Learning Stack

Kaifeng Huang, Bihuan Chen, Susheng Wu, Junmin Cao, Lei Ma, Xin Peng

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, nVidia

July 24, 2022 by hgpu

CPU-GPU Layer-Switched Low Latency CNN Inference

Ehsan Aghapour, Dolly Sapra, Andy Pimentel, and Anuj Pathania

View

Download (PDF)

Source codes

Tags: ARM, Computer science, Heterogeneous systems, Machine learning, Neural networks, OpenCL, Package, SoC

July 24, 2022 by hgpu

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

tritonBLAS: Triton-based Analytical Approach for GEMM Kernel Parameter Selection

hls4ml: Machine learning on FPGAs using HLS

hls4ml: A Flexible, Open-Source Platform for Deep Learning Acceleration on Reconfigurable Hardware

ThunderKittens: Tile primitives for speedy kernels

ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels

NVIDIA Nemotron Parse 1.1

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

Iris: First-Class Multi-GPU Programming Experience in Triton

HipKittens: Fast and Furious AMD Kernels

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Exploring Thread Coarsening on FPGA

BenchPress: A Deep Active Benchmark Generator

Performance analysis of matrix-free conjugate gradient kernels using SYCL

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Optimization of GPU workloads using natural language processing based on deep learning techniques

A Container-Based Workflow for Distributed Training of Deep Learning Algorithms in HPC Clusters

Deep Learning Approaches to Source Code Analysis for Optimization of Heterogeneous Systems: Recent Results, Challenges and Opportunities

COX: Exposing CUDA Warp-Level Functions to CPUs

Design and Implementation of ShenWei Universal C/C++

Real-Time High-Performance Computing for Embedded Control Systems

Demystifying Dependency Bugs in Deep Learning Stack

CPU-GPU Layer-Switched Low Latency CNN Inference

Recent source codes

tritonBLAS: A Lightweight Triton-based General Matrix Multiplication (GEMM) Library

hls4ml: Machine learning on FPGAs using HLS

ThunderKittens: Tile primitives for speedy kernels

NVIDIA Nemotron Parse 1.1

Iris: AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

HipKittens: Fast and Furious AMD Kernels

Fortran xDSL dialects

mt4g: Memory Topology 4 GPUs

Falcon: GPU-Based Floating-point Adaptive Lossless Compression

CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

Most viewed papers (last 30 days)