high performance computing on graphics processing units: hgpu.org

Applications

hgpu.org » paper

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Databases, Deep learning, nVidia, nVidia Titan RTX, Package

December 4, 2022 by hgpu

User-Driven Online Kernel Fusion for SYCL

Victor Perez, Lukas Sommer, Victor Lomüller, Kumudha Narasimhan, Mehdi Goli

View

Download (PDF)

Source codes

Tags: Compilers, Computer science, Deep learning, OpenCL, Package, SYCL

November 27, 2022 by hgpu

A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

Basilis Mamalis, Marios Perlitis

View

Download (PDF)

Tags: Algorithms, Computer science, CUDA, nVidia, nVidia GeForce RTX 2080 Ti, OpenMP

November 27, 2022 by hgpu

SciAI4Industry – Solving PDEs for industry-scale problems with deep learning

Philipp A. Witte, Russell J. Hewett, Kumar Saurabh, AmirHossein Sojoodi, Ranveer Chandra

View

Download (PDF)

Tags: AI, Cloud, Computational Physics, Computer science, Deep learning, Differential equations, Neural networks, nVidia, nVidia A100, nVidia DGX-A100, Partial differential equations, PDEs

November 27, 2022 by hgpu

Design Space Exploration of Concurrency Mapping to FPGAs in Weather and Climate Applications with Xilinx SDSoC OpenCL, SDSoC C++ and Vivad

Moteb Salem Alghamdi

View

Download (PDF)

Tags: Computer science, Design space exploration, FPGA, HLS, HPC, OpenCL, Thesis

November 27, 2022 by hgpu

Assessing Opportunities of SYCL and Intel oneAPI for Biological Sequence Alignment

Manuel Costanzo, Enzo Rucci, Carlos García Sánchez, Marcelo Naiouf, Manuel Prieto-Matías

View

Download (PDF)

Source codes

Tags: Bioinformatics, Biology, Computational biology, Computer science, CUDA, Heterogeneous systems, Intel, Intel UHD 630, nVidia, nVidia GeForce GTX 1080, nVidia GeForce GTX 980, nVidia GeForce RTX 2070, nVidia GeForce RTX 3090, OpenCL, Sequence alignment, SYCL, Tesla V100

November 27, 2022 by hgpu

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Saghar Irandoust, Thibaut Durand, Yunduz Rakhmangulova, Wenjie Zi, Hossein Hajimirsadeghi

View

Download (PDF)

Tags: Benchmarking, Computer science, Computer vision, Deep learning

November 20, 2022 by hgpu

Hardware Checkpointing and Productive Debugging Flows for FPGAs

Sameh Attia

View

Download (PDF)

Source codes

Tags: Computer science, FPGA, Package, Thesis

November 20, 2022 by hgpu

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Maria Nektaria Xekalaki

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, CUDA, FPGA, Heterogeneous systems, Java, nVidia, nVidia GeForce GTX 1060, nVidia Quadro GP100, OpenCL, Package, Performance, Tesla V100, Thesis

November 20, 2022 by hgpu

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

Richard Schoonhoven, Bram Veenboer, Ben van Werkhoven, Kees Joost Batenburg

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Energy-efficient computing, nVidia, nVidia RTX A4000, OpenCL, Package, Tesla A100

November 20, 2022 by hgpu

TorchOpt: An Efficient Library for Differentiable Optimization

Jie Ren, Xidong Feng, Bo Liu, Xuehai Pan, Yao Fu, Luo Mai, Yaodong Yang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Mathematical Software, nVidia, OpenMP, Package, PyTorch

November 20, 2022 by hgpu

A Study on Neural-based Code Summarization in Low-resource Settings

Yang He

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, nVidia, PyTorch, Software Engineering, Tesla V100, Thesis

November 13, 2022 by hgpu

CL4SE: A Context Learning Benchmark For Software Engineering Tasks

CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Applications

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism

User-Driven Online Kernel Fusion for SYCL

A Hybrid Multi-GPU Implementation of Simplex Algorithm with CPU Collaboration

Design Space Exploration of Concurrency Mapping to FPGAs in Weather and Climate Applications with Xilinx SDSoC OpenCL, SDSoC C++ and Vivad

Assessing Opportunities of SYCL and Intel oneAPI for Biological Sequence Alignment

Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Hardware Checkpointing and Productive Debugging Flows for FPGAs

Challenges and Techniques for Transparent Acceleration of Unmodified Big Data Applications

Going green: optimizing GPUs for energy efficiency through model-steered auto-tuning

TorchOpt: An Efficient Library for Differentiable Optimization

A Study on Neural-based Code Summarization in Low-resource Settings

Recent source codes

CL4SE: A Context Learning Benchmark For Software Engineering Tasks

CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Vortex-Optimized Light-weight Toolchain (VOLT)

SciDef: Automated Definition Extraction from Scientific Literature

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Most viewed papers (last 30 days)