high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Pedro Valero-Lara, Alexis Huante, Mustafa Al Lail, William F. Godoy, Keita Teranishi, Prasanna Balaprakash, Jeffrey S. Vetter

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Deep learning, Fortran, HIP, HPC, nVidia, OpenACC, OpenMP, Package, Python

September 17, 2023 by hgpu

Many Cores, Many Models: GPU Programming Model vs. Vendor Compatibility Overview

Andreas Herten

View

Download (PDF)

Tags: Computer science, CUDA, Fortran, HIP, HPC, nVidia, Overview, programming model, SYCL

September 17, 2023 by hgpu

host device — Generic programming in Cuda

Thomas Mejstrik

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, Programming Languages

September 17, 2023 by hgpu

Unified Shared Memory: Friend or Foe?

Juan Fumero Alfonso, Florin-Gabriel Blanaru, Athanasios Stratikopoulos, Steve Dohrmann, Sandhya Viswanathan, Christos-Efthymios Kotselidis

View

Download (PDF)

Tags: Code generation, Computer science, CUDA, FPGA, Heterogeneous systems, Java, Memory, nVidia, nVidia GeForce RTX 3070, OpenCL

September 17, 2023 by hgpu

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

Guangsen Zeng, Yi Zou

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A40, Sparse matrix

September 6, 2023 by hgpu

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

Jan Solanti, Michal Babej, Julius Ikkala, Pekka Jääskeläinen

View

Download (PDF)

Source codes

Tags: Computer science, Distributed computing, Fluid dynamics, Heterogeneous systems, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A6000, OpenCL, Package, Rendering

September 6, 2023 by hgpu

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Zane Fink, Konstantinos Parasyris, Giorgis Georgakoudis, Harshitha Menon

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, Code generation, Computer science, HPC, LLVM, nVidia, nVidia V100, OpenMP, Package

September 6, 2023 by hgpu

Performant low-order matrix-free finite element kernels on GPU architectures

Randolph R. Settgast, Yohann Dudouit, Nicola Castelletto, William R. Tobin, Benjamin C. Corbett, Sergey Klevtsov

View

Download (PDF)

Source codes

Tags: AMD Radeon Instinct MI250X, ATI, FEM, Finite element method, Mathematics, Numerical Analysis, nVidia, nVidia A100, nVidia V100, Package, Sparse

August 28, 2023 by hgpu

Sieve: Stratified GPU-Compute Workload Sampling

Mahmood Naderan-Tahan, Hossein SeyyedAghaei, Lieven Eeckhout

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, nVidia GeForce RTX 3080, Package, Performance

August 28, 2023 by hgpu

Novel insights on atomic synchronization for sort-based group-by on GPUs

Bala Gurumurthy, David Broneske, Martin Schäler, Thilo Pionteck

View

Download (PDF)

Source codes

Tags: Computer science, Databases, Hashing, Heterogeneous systems, nVidia, nVidia A100, nVidia GeForce GTX 1050 Ti, nVidia GeForce RTX 2080 Ti, nVidia V100, OpenCL, Package, Sorting

August 28, 2023 by hgpu

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Hyun Park, Parth Patel, Roland Haas, E. A. Huerta

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Biology, Biomolecules, Biophysics, nVidia, nVidia A100, nVidia A40, Package

August 20, 2023 by hgpu

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

* * *

high performance computing on graphics processing units: hgpu.org

Comparing Llama-2 and GPT-3 LLMs for HPC kernels generation

Many Cores, Many Models: GPU Programming Model vs. Vendor Compatibility Overview

host device — Generic programming in Cuda

Unified Shared Memory: Friend or Foe?

Scope is all you need: Transforming LLMs for HPC Code

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

PoCL-R: An Open Standard Based Offloading Layer for Heterogeneous Multi-Access Edge Computing with Server Side Scalability

HPAC-Offload: Accelerating HPC Applications with Portable Approximate Computing on the GPU

Performant low-order matrix-free finite element kernels on GPU architectures

Sieve: Stratified GPU-Compute Workload Sampling

Novel insights on atomic synchronization for sort-based group-by on GPUs

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Recent source codes

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Vortex-Optimized Light-weight Toolchain (VOLT)

SciDef: Automated Definition Extraction from Scientific Literature

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Awesome LLM-Driven Kernel Generation

Most viewed papers (last 30 days)