high performance computing on graphics processing units: hgpu.org

Programming

hgpu.org » Programming

Testing GPU Numerics: Finding Numerical Differences Between NVIDIA and AMD GPUs

Anwar Hossain Zahid, Ignacio Laguna, Wei Le

View

Tags: AMD Radeon Instinct MI250, ATI, Computer science, CUDA, HIP, Numerical Analysis, nVidia, nVidia V100, Programming Languages

October 20, 2024 by hgpu

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Reza Abbasi, Sernam Lim

View

Download (PDF)

Source codes

Tags: AI, Artificial intelligence, Computer science, CUDA, LLM, Machine learning, Memory, nVidia, nVidia GeForce RTX 3090, nVidia Quadro RTX 8000, Package

October 20, 2024 by hgpu

Accelerating Drug Discovery in AutoDock-GPU with Tensor Cores

Gabin Schieffer, Ivy Peng

View

Download (PDF)

Tags: Chemistry, Computer science, CUDA, Macromolecule, molecular docking, nVidia, nVidia A100, nVidia V100, Physics, Tesla T4

October 20, 2024 by hgpu

Optimized Code Generation for Parallel and Polyhedral Loop Nests using MLIR

Arun Thangamani

View

Download (PDF)

Tags: AMD Radeon Instinct Mi50, ATI, Code generation, Computer science, CUDA, Heterogeneous systems, nVidia, nVidia A100, OpenCL, Thesis

October 13, 2024 by hgpu

Deep Learning and Machine Learning with GPGPU and CUDA: Unlocking the Power of Parallel Computing

Ming Li, Ziqian Bi, Tianyang Wang, Yizhu Wen, Qian Niu, Junyu Liu, Benji Peng, Sen Zhang, Xuanhe Pan, Jiawei Xu, Jinlang Wang, Keyu Chen, Caitlyn Heqi Yin, Pohsun Feng, Ming Liu

View

Download (PDF)

Tags: Book, Computer science, CUDA, Deep learning, FPGA, Machine learning, nVidia, OpenCL, OpenGL, TPU, Vulkan

October 13, 2024 by hgpu

Sound and Partially-Complete Static Analysis of Data-Races in GPU Programs

Dennis Liew, Tiago Cogumbreiro, Julien Lange

View

Download (PDF)

Source codes

Tags: Artificial intelligence, Computer science, CUDA, nVidia, Package, Performance

October 13, 2024 by hgpu

A domain-specific language for geospatial computations on the GPU

Louise Tidestav

View

Download (PDF)

Tags: Computer science, CUDA, DSL, nVidia, nVidia Quadro P 2000, Thesis

October 13, 2024 by hgpu

Effects of OpenCL-Based Parallelization Methods on Explicit Numerical Methods to Solve the Heat Equation

Dániel Koics, Endre Kovács 2, Olivér Hornyák

View

Download (PDF)

Source codes

Tags: nVidia, OpenCL, Package, PDEs, Performance, Physics

October 13, 2024 by hgpu

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores

Shaobo Ma, Chao Fang, Haikuo Shao, Zhongfeng Wang

View

Download (PDF)

Tags: Computer science, CUDA, Data recovery, Extended precision, LLM, Matrix multiplication, nVidia, nVidia GeForce RTX 3090, Security

October 6, 2024 by hgpu

Event-Based OpenMP Tasks for Time-Sensitive GPU-Accelerated Systems

Cyril Cetre, Chenle Yu, Sara Royuela, Rémi Barrere, Eduardo Quiñones, Damien Gratadour

View

Download (PDF)

Tags: AMD Radeon Instinct MI100, ATI, Computer science, CUDA, HIP, HPC, nVidia, nVidia A100, Performance

October 6, 2024 by hgpu

Benchmarking Thread Block Cluster

Tim Lühnen, Tobias Marschner, Sohan Lal

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, nVidia, nVidia H100, PTX

October 6, 2024 by hgpu

Bitstream Database-Driven FPGA Programming Flow Based on Standard OpenCL

Topi Leppänen, Leevi Leppänen, Joonas Multanen, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, Databases, FPGA, Heterogeneous systems, OpenCL, Package

September 29, 2024 by hgpu

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

Profile Util library: A quick and easy way to get MPI, OpenMP and GPU runtime information

MaC: Mamba CPU performance predictor

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Mixed-precision finite element kernels

Mixed-precision finite element kernels and assembly: Rounding error analysis and hardware acceleration

SHMT: The Simultaneous and Heterogenous Multithreading project

General-Purpose Computing on Tensor Processors

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Online Energy Optimization in GPUs: A Multi-Armed Bandit Approach

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Testing GPU Numerics: Finding Numerical Differences Between NVIDIA and AMD GPUs

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

Accelerating Drug Discovery in AutoDock-GPU with Tensor Cores

Optimized Code Generation for Parallel and Polyhedral Loop Nests using MLIR

Deep Learning and Machine Learning with GPGPU and CUDA: Unlocking the Power of Parallel Computing

Sound and Partially-Complete Static Analysis of Data-Races in GPU Programs

A domain-specific language for geospatial computations on the GPU

Effects of OpenCL-Based Parallelization Methods on Explicit Numerical Methods to Solve the Heat Equation

Efficient Arbitrary Precision Acceleration for Large Language Models on GPU Tensor Cores

Event-Based OpenMP Tasks for Time-Sensitive GPU-Accelerated Systems

Benchmarking Thread Block Cluster

Bitstream Database-Driven FPGA Programming Flow Based on Standard OpenCL

Recent source codes

Kokkidio: Kokkos+Eigen - write fast, readable multi-platform code

LLaMA-Inference-Bench

MATAR

Over-synchronization in GPU Programs

profile_util: simple C++ library to report memory, timing, thread affinity

MaC: Mamba CPU performance predictor

Mixed-precision finite element kernels

SHMT: The Simultaneous and Heterogenous Multithreading project

Superpipeline: A Universal Approach for Reducing GPU Memory Usage in Large Models

EnergyUCB-Bandit

Most viewed papers (last 30 days)