high performance computing on graphics processing units: hgpu.org

hgpu.org » NLP

SciDef: Automating Definition Extraction from Academic Literature with Large Language Models

Filip Kučera, Christoph Mandl, Isao Echizen, Radu Timofte, Timo Spinde

View

Download (PDF)

Source codes

Tags: Computer science, Data mining, LLM, NLP, Package

February 8, 2026 by hgpu

PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformations

Muhammad Usman Tariq, Abhinav Jangda, Angelica Moreira, Madan Musuvathi, Tyler Sorensen

View

Download (PDF)

Tags: AI, AMD, AMD Radeon Instinct MI200, ATI, Computer science, CUDA, HIP, HLSL, LLM, NLP, nVidia, nVidia RTX A6000

December 29, 2025 by hgpu

Serve Programs, Not Prompts

In Gim, Lin Zhong

View

Download (PDF)

Tags: Computer science, LLM, NLP

November 2, 2025 by hgpu

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Heejun Lee, Geon Park, Jaduk Suh, Sung Ju Hwang

View

Download (PDF)

Source codes

Tags: Computer science, LLM, NLP, nVidia, nVidia GeForce RTX 4090, Package

February 16, 2025 by hgpu

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Ferdi Kossmann, Bruce Fontaine, Daya Khudia, Michael Cafarella, Samuel Madden

View

Download (PDF)

Tags: Computer science, LLM, NLP, nVidia, nVidia A100, nVidia H100, Task scheduling

November 3, 2024 by hgpu

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, NLP, nVidia, nVidia A800

July 28, 2024 by hgpu

A Survey on Hardware Accelerators for Large Language Models

Christoforos Kachris

View

Download (PDF)

Tags: Computer science, Energy-efficient computing, FPGA, Hardware Architecture, NLP, survey

January 21, 2024 by hgpu

Cramming: Training a Language Model on a Single GPU in One Day

Jonas Geiping, Tom Goldstein

View

Download (PDF)

Source codes

Tags: Computer science, Deep learning, NLP, nVidia, nVidia GeForce RTX 2080 Ti, nVidia RTX A4000, nVidia RTX A6000, Package

January 8, 2023 by hgpu

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Jiangsu Du, Ziming Liu, Jiarui Fang, Shenggui Li, Yongbin Li, Yutong Lu, Yang You

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Heterogeneous systems, NLP, nVidia, nVidia A100, Package

September 11, 2022 by hgpu

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Petros Vavaroutsos, Ioannis Oroutzoglou, Dimosthenis Masouros, Dimitrios Soudris

View

Download (PDF)

Tags: AMD Radeon HD 7970, ATI, Computer science, Deep learning, Machine learning, NLP, nVidia, nVidia GeForce GTX 970, OpenCL

September 4, 2022 by hgpu

Long Code for Code Search

Fan Hu, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Xirong Li

View

Download (PDF)

Tags: Computer science, Deep learning, NLP, nVidia, Software Engineering, Tesla V100

August 28, 2022 by hgpu

MapReduce for Counting Word Frequencies with MPI and GPUs

Nithin Kavi

View

Download (PDF)

Source codes

Tags: Algorithms, Computer science, CUDA, Julia, MapReduce, MPI, NLP, nVidia, Optimization, Package, Tesla V100

June 19, 2022 by hgpu

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)

Awesome LLM-Driven Kernel Generation

Towards Automated Kernel Generation in the Era of LLMs

PhysProver: Advancing Automatic Theorem Proving for Physics

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

SciDef: Automating Definition Extraction from Academic Literature with Large Language Models

PEAK: A Performance Engineering AI-Assistant for GPU Kernels Powered by Natural Language Transformations

Serve Programs, Not Prompts

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs

A Survey on Hardware Accelerators for Large Language Models

Cramming: Training a Language Model on a Single GPU in One Day

EnergonAI: An Inference System for 10-100 Billion Parameter Transformer Models

Towards making the most of NLP-based device mapping optimization for OpenCL kernels

Long Code for Code Search

MapReduce for Counting Word Frequencies with MPI and GPUs

Recent source codes

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Vortex-Optimized Light-weight Toolchain (VOLT)

SciDef: Automated Definition Extraction from Scientific Literature

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Awesome LLM-Driven Kernel Generation

PhysProver: Advancing Automatic Theorem Proving for Physics

Most viewed papers (last 30 days)