high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

Exploring data flow design and vectorization with oneAPI for streaming applications on CPU+GPU

Cristian Campos, Rafael Asenjo, Angeles Navarro

View

Download (PDF)

Source codes

Tags: Computer science, Data parallelism, Heterogeneous systems, Intel, Intel UHD 770, oneAPI, Package, SYCL

January 27, 2025 by hgpu

Adaptive Optimization Techniques for High-Performance Computing

Gulsum Gudukbay Akbulut

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, Machine learning, nVidia, Optimization, Performance, Tesla K80, Thesis

January 27, 2025 by hgpu

Column-Oriented Datalog on the GPU

Yihao Sun, Sidharth Kumar, Thomas Gilray, Kristopher Micinski

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, nVidia, nVidia H100, Package

January 27, 2025 by hgpu

Good things come in small packages: Should we adopt Lite-GPUs in AI infrastructure?

Burcu Canakci, Junyi Liu, Xingbo Wu, Nathanaël Cheriere, Paolo Costa, Sergey Legtchenko, Dushyanth Narayanan, Ant Rowstron

View

Download (PDF)

Tags: AI, Computer science, Hardware Architecture

January 27, 2025 by hgpu

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Hongyuan Liu, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Hardware Architecture, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

January 27, 2025 by hgpu

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Naifeng Zhang, Franz Franchetti

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Linear Algebra, Modular arithmetic, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia V100, Package, Security

January 20, 2025 by hgpu

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

Dinei A. Rockenbach, Gabriell Araujo, Dalvan Griebler, Luiz Gustavo Fernandes

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Data parallelism, nVidia, nVidia GeForce RTX 3090, OpenCL, OpenMP, Package

January 20, 2025 by hgpu

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

Csaba Tóth, Danilo Jr Dela Cruz, Harald Oberhauser

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A100, Package, Python

January 20, 2025 by hgpu

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

Jonah Ekelund, Stefano Markidis, Ivy Peng

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, FDTD, HIP, nVidia, nVidia A100, nVidia H100, Package, Performance

January 20, 2025 by hgpu

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

Rémi Genet, Hugo Inzirillo

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Python, TensorFlow

January 20, 2025 by hgpu

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

Ruijun Feng, Hammond Pearce, Pietro Liguori, Yulei Sui

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Python, PyTorch, Security

January 13, 2025 by hgpu

CFAL-bench

Comparing Parallel Functional Array Languages: Programming and Performance

Efficient Graph Embedding at Scale: Optimizing CPU-GPU-SSD Integration

Can Large Language Models Predict Parallel Code Performance?

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Profiling Apple Silicon Performance for ML Training

Exploring data flow design and vectorization with oneAPI for streaming applications on CPU+GPU

Adaptive Optimization Techniques for High-Performance Computing

Column-Oriented Datalog on the GPU

Good things come in small packages: Should we adopt Lite-GPUs in AI infrastructure?

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

GSParLib: A multi-level programming interface unifying OpenCL and CUDA for expressing stream and data parallelism

A User’s Guide to KSig: GPU-Accelerated Computation of the Signature Kernel

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

CGP-Tuning: Structure-Aware Soft Prompt Tuning for Code Vulnerability Detection

Recent source codes

CFAL-bench

Efficient Graph Embedding at Scale: Optimizing CPU-GPU-SSD Integration

Can Large Language Models Predict Parallel Code Performance?

PELSI: Power-Efficient Layer-Switched Inference

Ouroboros: Virtualized Queues for dynamic memory management

MSCCL++: A GPU-driven communication stack for scalable AI applications

Benchmark compute shader of Unity against InteropUnityCUDA

Data-efficient LLM Fine-tuning for Code Generation

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

Most viewed papers (last 30 days)