high performance computing on graphics processing units: hgpu.org

hgpu.org » LLM

Acceleration as a Service (XaaS) Source Containers

Eiman Alnuaimi

View

Download (PDF)

Source codes

Tags: Computer science, Heterogeneous systems, HPC, Intel, Intel Data Center GPU Max 1550, LLM, MPI, nVidia, nVidia GH200, nVidia V100, Optimization, Package, performance portability, Thesis

June 8, 2025 by hgpu

MemAscend: System Memory Optimization for SSD-Offloaded LLM Fine-Tuning

Yong-Cheng Liaw, Shuo-Han Chen

View

Download (PDF)

Tags: Artificial intelligence, Benchmarking, Computer science, LLM, Memory, nVidia, nVidia H100, nVidia RTX A5000

June 8, 2025 by hgpu

Performance of Confidential Computing GPUs

Antonio Martínez Ibarra, Julian James Stephen, Aurora González Vidal, K. R. Jayaram, Antonio Fernando Skarmeta Gómez

View

Download (PDF)

Tags: Computer science, CUDA, LLM, nVidia, nVidia H100, Performance, Security

May 25, 2025 by hgpu

Can Large Language Models Predict Parallel Code Performance?

Gregory Bolet, Giorgis Georgakoudis, Harshitha Menon, Konstantinos Parasyris, Niranjan Hasabnis, Hayden Estes, Kirk W. Cameron, Gal Oren

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 3080, OpenMP, Package, Performance, performance portability

May 18, 2025 by hgpu

GPU Performance Portability needs Autotuning

Burkhard Ringlein, Thomas Parnell, Radu Stoica

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, ATI, Auto-Tuning, Computer science, CUDA, DSL, HIP, LLM, nVidia, nVidia A100, Performance, performance portability

May 18, 2025 by hgpu

LIFT: LLM-Based Pragma Insertion for HLS via GNN Supervised Fine-Tuning

Neha Prakriya, Zijian Ding, Yizhou Sun, Jason Cong

View

Download (PDF)

Tags: AMD Radeon Instinct MI250, ATI, Computer science, FPGA, HLS, LLM, Machine learning, Neural networks, PyTorch

May 4, 2025 by hgpu

Scaling On-Device GPU Inference for Large Generative Models

Jiuqiang Tang, Raman Sarokin, Ekaterina Ignasheva, Grant Jensen, Lin Chen, Juhyun Lee, Andrei Kulik, Matthias Grundmann

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, OpenCL

May 4, 2025 by hgpu

Data-efficient LLM Fine-tuning for Code Generation

Weijie Lv, Xuan Xia, Sheng-Jun Huang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia A100, Package, Python, PyTorch

April 27, 2025 by hgpu

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

Dimitar Mileski, Nikola Petrovski, Marjan Gusev

View

Download (PDF)

Tags: Computer science, CUDA, Deep learning, HPC, LLM, nVidia, nVidia A100, PTX, PyTorch

April 13, 2025 by hgpu

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

Meng Wang, Jinshuo Liu, Zimeng Xu, Chang Ding, Xiaomeng Huang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 4090, Package

April 13, 2025 by hgpu

Efficient allocation of image recognition and LLM tasks on multi-GPU system

Marcin Lawenda, Krzesimir Samborski, Kyrylo Khloponin, Łukasz Szustak

View

Download (PDF)

Tags: Computer science, CUDA, Data parallelism, Image recognition, LLM, Machine learning, nVidia, nVidia H100, Performance

March 30, 2025 by hgpu

TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives

Size Zheng, Jin Fang, Xuegui Zheng, Qi Hou, Wenlei Bao, Ningxin Zheng, Ziheng Jiang, Dongyang Wang, Jianxi Ye, Haibin Lin, Li-Wen Chang, Xin Liu

View

Download (PDF)

Tags: Computer science, Deep learning, LLM, nVidia, nVidia H800, PTX

March 30, 2025 by hgpu

* * *

high performance computing on graphics processing units: hgpu.org

Acceleration as a Service (XaaS) Source Containers

MemAscend: System Memory Optimization for SSD-Offloaded LLM Fine-Tuning

Performance of Confidential Computing GPUs

Can Large Language Models Predict Parallel Code Performance?

GPU Performance Portability needs Autotuning

LIFT: LLM-Based Pragma Insertion for HLS via GNN Supervised Fine-Tuning

Scaling On-Device GPU Inference for Large Generative Models

Data-efficient LLM Fine-tuning for Code Generation

Scalability Evaluation of HPC Multi-GPU Training for ECG-based LLMs

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

Efficient allocation of image recognition and LLM tasks on multi-GPU system

TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives

Recent source codes

Kernel Library for LLM Serving

Adaptivity in AdaptiveCpp: Optimizing Performance by Leveraging Runtime Information During JIT-Compilation

Neptune: Advanced ML Operator Fusion for Locality and Parallelism on GPUs

Genten: Software for Generalized Tensor Decompositions by Sandia National Laboratories

Interleaved Learning and Exploration: A Self-Adaptive Fuzz Testing Framework for MLIR

Pinocchio: PINpointing Orbit Crossing Collapsed Hierarchical Objects

KernelCoder: trained on a curated dataset of reasoning traces and CUDA kernel pairs

VibeCodeHPC - Multi Agentic Vibe Coding for HPC

Compile-Time Resource Safety for GPU APIs: A Low-Overhead Typestate Framework

exa-AMD: Exascale Accelerated Materials Discovery

Most viewed papers (last 30 days)