high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia A40

Scope is all you need: Transforming LLMs for HPC Code

Tal Kadosh, Niranjan Hasabnis, Vy A. Vo, Nadav Schneider, Neva Krien, Abdul Wasay, Nesreen Ahmed, Ted Willke, Guy Tamir, Yuval Pinter, Timothy Mattson, Gal Oren

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, Deep learning, HPC, nVidia, nVidia A40, nVidia H100, OpenMP, Package

September 6, 2023 by hgpu

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

Guangsen Zeng, Yi Zou

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia A40, Sparse matrix

September 6, 2023 by hgpu

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

Hyun Park, Parth Patel, Roland Haas, E. A. Huerta

View

Download (PDF)

Source codes

Tags: AI, Algorithms, Biology, Biomolecules, Biophysics, nVidia, nVidia A100, nVidia A40, Package

August 20, 2023 by hgpu

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, Matrix multiplication, nVidia, nVidia A40, Package, PyTorch

August 21, 2022 by hgpu

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Scope is all you need: Transforming LLMs for HPC Code

Leveraging Memory Copy Overlap for Efficient Sparse Matrix-Vector Multiplication on GPUs

APACE: AlphaFold2 and advanced computing as a service for accelerated discovery in biophysics

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Recent source codes

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Device Virtual Machine (DVM)

Agentic Code Optimization via Compiler-LLM Cooperation

AutoKernel: Autoresearch for GPU kernels. Give it any PyTorch model, go to sleep, wake up to optimized Triton kernels

SOL-ExecBench: Speed-of-Light Benchmarking for Real-World GPU Kernels Against Hardware Limits

Most viewed papers (last 30 days)