high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » Applications » Computer science

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

Yixuan Mei, Yonghao Zhuang, Xupeng Miao, Juncheng Yang, Zhihao Jia, Rashmi Vinayak

View

Download (PDF)

Tags: Computer science, GPU cluster, Heterogeneous systems, nVidia, nVidia A100, nVidia V100, Tesla T4

June 9, 2024 by hgpu

More Bang For Your Buck(et): Fast and Space-efficient Hardware-accelerated Coarse-granular Indexing on GPUs

Justus Henneberg, Felix Schuhknecht, Rosina Kharal, Trevor Brown

View

Download (PDF)

Tags: 3D Graphics and Realism, Databases, nVidia, nVidia GeForce RTX 4090, Raytracing

June 9, 2024 by hgpu

Machine learning enhanced code optimization for high-level synthesis (ML-ECOHS)

Robert P. Munafo

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, FPGA, HLS, Machine learning, OpenCL, Package, Thesis

June 2, 2024 by hgpu

Addressing Challenges in Utilizing GPUs for Accelerating Privacy-Preserving Computation

Ardhi Wiratama Baskara Yudha

View

Download (PDF)

Tags: Computer science, CUDA, Machine learning, nVidia, nVidia GeForce RTX 2080, nVidia GeForce RTX 3090, Security, Thesis

June 2, 2024 by hgpu

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

L.A. Torres, Carlos J. Barrios H, Yves Denneulin

View

Download (PDF)

Source codes

Tags: Computer science, CUBLAS, CUDA, Linear Algebra, Matrix multiplication, Neural networks, nVidia, nVidia A100, Package, Performance, SYCL

June 2, 2024 by hgpu

A Survey of Cloud-Based GPU Threats and Their Impact on AI, HPC, and Cloud Computing

Numaan Huq, Philippe Lin, Roel Reyes, Charles Perine

View

Download (PDF)

Tags: AMD Radeon Pro V520, Artificial intelligence, ATI, Cloud, Computer science, CUDA, Deep learning, nVidia, OpenCL, Security, Tesla T4

June 2, 2024 by hgpu

Enabling full-speed random access to the entire memory on the A100 GPU

Alden Walker

View

Download (PDF)

Tags: Computer science, nVidia, nVidia A100, Performance, PTX

May 26, 2024 by hgpu

GPU Implementations for Midsize Integer Addition and Multiplication

Cosmin E. Oancea, Stephen M. Watt

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia A100, Performance, Programming Languages

May 26, 2024 by hgpu

STuning-DL: Model-Driven Autotuning of Sparse GPU Kernels for Deep Learning

Roberto L. Castro, Diego Andrade, Basilio B. Fraguela

View

Download (PDF)

Tags: Auto-Tuning, Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia A100, Tesla T4

May 26, 2024 by hgpu

Kernel-Centric Optimizations for Deep Neural Networks on GPGPU

Zhaodong Chen

View

Download (PDF)

Tags: Computer science, Computer vision, CUDA, Deep learning, Neural networks, nVidia, nVidia A100, nVidia V100, Thesis

May 26, 2024 by hgpu

Hierarchical Resource Partitioning on Modern GPUs: A Reinforcement Learning Approach

Urvij Saroliya, Eishi Arima, Dai Liu, Martin Schulz

View

Download (PDF)

Tags: Computer science, CUDA, Heterogeneous systems, Machine learning, nVidia, nVidia A100, PC cluster, Task scheduling

May 20, 2024 by hgpu

CUDAnalyst (CUDA + Analyst)

Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation

CodegenBench

CodegenBench: Can LLMs Write Efficient Code Across Architectures?

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Evaluating CUDA Tile for AI Workloads on Hopper and Blackwell GPUs

Device Virtual Machine (DVM)

DVM: Real-Time Kernel Generation for Dynamic AI Models

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Helix: Distributed Serving of Large Language Models via Max-Flow on Heterogeneous GPUs

More Bang For Your Buck(et): Fast and Space-efficient Hardware-accelerated Coarse-granular Indexing on GPUs

Machine learning enhanced code optimization for high-level synthesis (ML-ECOHS)

Addressing Challenges in Utilizing GPUs for Accelerating Privacy-Preserving Computation

Evaluation of computational and energy performance in matrix multiplication algorithms on CPU and GPU using MKL, cuBLAS and SYCL

Enabling full-speed random access to the entire memory on the A100 GPU

GPU Implementations for Midsize Integer Addition and Multiplication

STuning-DL: Model-Driven Autotuning of Sparse GPU Kernels for Deep Learning

Kernel-Centric Optimizations for Deep Neural Networks on GPGPU

Hierarchical Resource Partitioning on Modern GPUs: A Reinforcement Learning Approach

Recent source codes

CUDAnalyst (CUDA + Analyst)

CodegenBench

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels

CUDA Kernel Fusion Benchmarks

IntelliKit: Agent-first tooling for AMD hardware

DITRON: Distributed Compiler based on Triton for Parallel Systems

CuTile Benchmark Suite: Performance and Productivity Tradeoffs for GPU Kernel Programming on Blackwell Architecture

Device Virtual Machine (DVM)

MegaTrain: Full Precision Training of 100B+ Parameter Large Language Models on a Single GPU

Agentic Code Optimization via Compiler-LLM Cooperation

Most viewed papers (last 30 days)