high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming » CUDA

Extending MAGMA Portability with OneAPI

Anna Fortenberry, Stanimire Tomov

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Heterogeneous systems, Linear Algebra, Matrix multiplication, nVidia, nVidia GeForce RTX 3060, oneAPI, Package, performance portability

December 25, 2022 by hgpu

GPU Load Balancing

Muhammad Osama

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Linear Algebra, load balancing, Matrix multiplication, nVidia, nVidia A100, Package, Sparse, Thesis

December 25, 2022 by hgpu

Kernel-as-a-Service: A Serverless Interface to GPUs

Nathan Pemberton, Anton Zabreyko, Zhoujie Ding, Randy Katz, Joseph Gonzalez

View

Download (PDF)

Source codes

Tags: Cloud, Computer science, CUDA, Deep learning, Distributed computing, nVidia, Package, Tesla V100

December 25, 2022 by hgpu

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

August Ernstsson, Dalvan Griebler, Christoph Kessler

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, Heterogeneous systems, nVidia, OpenCL, OpenMP, Package, performance portability, Tesla K20

December 11, 2022 by hgpu

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Jiangsu Du, Dongsheng Li, Yingpeng Wen, Jiazhi Jiang, Dan Huang, Xiangke Liao, Yutong Lu

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, CUDA, Deep learning, HPC, nVidia, PyTorch, Tesla V100

December 11, 2022 by hgpu

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

Mariko Tatsumi, Silviu-Ioan Filip, Caroline White, Olivier Sentieys, Guy Lemieux

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, FPGA, nVidia, Precision

December 11, 2022 by hgpu

Fast convolution kernels on pascal GPU with high memory efficiency

Qiong Chang, Masaki Onishi, Tsutomu Maruyama

View

Download (PDF)

Tags: CNN, Computer science, CUDA, Deep learning, nVidia, nVidia GeForce GTX 1080 Ti, Performance

December 4, 2022 by hgpu

Three Contributions to the Theory and Practice of Optimizing Compilers

Linxiao Wang

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, CUDA, LLVM, nVidia, nVidia GeForce GTX 1080 Ti, nVidia GeForce GTX 760 M, Package, Thesis

December 4, 2022 by hgpu

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

Basilis Mamalis, Marios Perlitis

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, OpenMP

November 27, 2022 by hgpu

Assessing Opportunities of SYCL and Intel oneAPI for Biological Sequence Alignment

Manuel Costanzo, Enzo Rucci, Carlos García Sánchez, Marcelo Naiouf, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computational biology, Computer science, CUDA, Heterogeneous systems, Intel, Intel UHD 630, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 980, nVidia GeForce RTX 2070, nVidia GeForce RTX 3090, OpenCL, Sequence alignment, SYCL, Tesla V100

November 27, 2022 by hgpu

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Maria Nektaria Xekalaki

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, FPGA, Heterogeneous systems, Java, nVidia, nVidia GeForce GTX 1060, nVidia Quadro GP100, OpenCL, Package, Performance, Tesla V100, Thesis

November 20, 2022 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Extending MAGMA Portability with OneAPI

GPU Load Balancing

Assessing Application Efficiency and Performance Portability in Single-Source Programming for Heterogeneous Parallel Systems

SAIH: A Scalable Evaluation Methodology for Understanding AI Performance Trend on HPC Systems

Mixing Low-Precision Formats in Multiply-Accumulate Units for DNN Training

Fast convolution kernels on pascal GPU with high memory efficiency

Three Contributions to the Theory and Practice of Optimizing Compilers

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

Assessing Opportunities of SYCL and Intel oneAPI for Biological Sequence Alignment

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)