high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Pedro Valero-Lara, Alexis Huante, Mustafa Al Lail, William F. Godoy, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Deep learning, Fortran, HIP, HPC, nVidia, OpenACC, OpenMP, Package, Python

September 17, 2023 by hgpu

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

Jan Solanti, Michal Babej, Julius Ikkala, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, Distributed computing, Fluid dynamics, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A6000, OpenCL, Package, Rendering

September 6, 2023 by hgpu

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Zane Fink, Konstantinos Parasyris, Giorgis Georgakoudis, Harshitha Menon

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Code generation, Computer science, HPC, LLVM, nVidia, nVidia V100, OpenMP, Package

September 6, 2023 by hgpu

Sieve: Stratified GPU-Compute Workload Sampling

Mahmood Naderan-Tahan, Hossein SeyyedAghaei, Lieven Eeckhout

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3080, Package, Performance

August 28, 2023 by hgpu

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Raúl Nozal, Jose Luis Bosque

View

Download (PDF)

Source codes

Tags: AMD Radeon RX 5700 XT, ATI, Computer science, Heterogeneous systems, HPC, Molecular dynamics, OpenCL, OpenMP, Package, performance portability

August 28, 2023 by hgpu

Novel insights on atomic synchronization for sort-based group-by on GPUs

Bala Gurumurthy, David Broneske, Martin Schäler, Thilo Pionteck

View

Download (PDF)

Source codes

Tags: Computer science, Databases, Hashing, Heterogeneous systems, nVidia, nVidia A100, nVidia GeForce GTX 1050 Ti, nVidia GeForce RTX 2080 Ti, nVidia V100, OpenCL, Package, Sorting

August 28, 2023 by hgpu

Performant low-order matrix-free finite element kernels on GPU architectures

Randolph R. Settgast, Yohann Dudouit, Nicola Castelletto, William R. Tobin, Benjamin C. Corbett, Sergey Klevtsov

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, FEM, Finite element method, Mathematics, Numerical Analysis, nVidia, nVidia A100, nVidia V100, Package, Sparse

August 28, 2023 by hgpu

Quantifying OpenMP: Statistical Insights into Usage and Adoption

Tal Kadosh, Niranjan Hasabnis, Timothy Mattson, Yuval Pinter, Gal Oren

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Fortran, HPC, MPI, nVidia, OpenACC, OpenCL, OpenMP, Package, SYCL

August 20, 2023 by hgpu

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Hyun Park, Parth Patel, Roland Haas, E. A. Huerta

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Biology, Biomolecules, Biophysics, nVidia, nVidia A100, nVidia A40, Package

August 20, 2023 by hgpu

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Phuong Nguyen, Pratik Nayak, Hartwig Anzt

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Intel, Intel Data Center GPU Max 1550, nVidia, nVidia A100, nVidia H100, Package, performance portability, Physics, SYCL

August 20, 2023 by hgpu

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Xinchi Han, Weihao Jiang, Peirui Cao, Qinwei Yang, Yunzhuo Liu, Shuyao Qi, Shengkai Lin, Shizhen Zhao

View

Download (PDF)

Source codes

Tags: Computer science, GPU cluster, Machine learning, Neural networks, nVidia, nVidia V100, Package

August 13, 2023 by hgpu

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

LLMQ: Efficient Lower-Precision LLM Training for Consumer GPUs

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

True 4-Bit Quantized Convolutional Neural Network Training on CPU: Achieving Full-Precision Parity

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

Hunting CUDA Bugs at Scale with cuFuzz

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

Making LLMs Optimize Multi-Scenario CUDA Kernels Like Experts

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

RepoLaunch: Automating Build & Test Pipeline of Code Repositories on ANY Language and ANY Platform

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Scope is all you need: Transforming LLMs for HPC Code

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Sieve: Stratified GPU-Compute Workload Sampling

Mashing load balancing algorithm to boost hybrid kernels in molecular dynamics simulations

Novel insights on atomic synchronization for sort-based group-by on GPUs

Performant low-order matrix-free finite element kernels on GPU architectures

Quantifying OpenMP: Statistical Insights into Usage and Adoption

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Porting Batched Iterative Solvers onto Intel GPUs with SYCL

Isolated Scheduling for Distributed Training Tasks in GPU Clusters

Recent source codes

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

Triton-Sanitizer: A Fast and Device-Agnostic Memory Sanitizer for Triton with Rich Diagnostic Context

LLM.Q: Quantized LLM training in pure CUDA/C++

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

True 4-Bit Quantized CNN Training on CPU

cuFuzz: A GPU-oriented coverage-guided fuzzer for userland CUDA application

KernelSkill: A Multi-Agent Framework for GPU Kernel Optimization

MSKernelBench & CUDAMaster

EvoScientist: Harness Vibe Research with Self-evolving AI Scientists

RepoLaunch: Automating Build and Test Pipeline of Code Repositories on ANY Language and ANY Platform

Most viewed papers (last 30 days)