high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia GeForce RTX 4090

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Heejun Lee, Geon Park, Jaduk Suh, Sung Ju Hwang

View

Download (PDF)

Source codes

Tags: Computer science, LLM, NLP, nVidia, nVidia GeForce RTX 4090, Package

February 16, 2025 by hgpu

Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs

Youhe Jiang, Fangcheng Fu, Xiaozhe Yao, Guoliang He, Xupeng Miao, Ana Klimovic, Bin Cui, Binhang Yuan, Eiko Yoneki

View

Download (PDF)

Source codes

Tags: Benchmarking, Cloud, Computer science, Heterogeneous systems, LLM, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia RTX A6000, Package

February 10, 2025 by hgpu

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Download (PDF)

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Hongyuan Liu, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Hardware Architecture, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

January 27, 2025 by hgpu

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Naifeng Zhang, Franz Franchetti

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Linear Algebra, Modular arithmetic, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia V100, Package, Security

January 20, 2025 by hgpu

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

Rémi Genet, Hugo Inzirillo

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Python, TensorFlow

January 20, 2025 by hgpu

RTCUDB: Building Databases with RT Processors

Xuri Shi, Kai Zhang, X. Sean Wang, Xiaodong Zhang, Rubao Lee

View

Download (PDF)

Tags: Computer science, CUDA, Databases, nVidia, nVidia GeForce GTX Titan X, nVidia GeForce RTX 4090

December 15, 2024 by hgpu

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach

Yijia Zhang, Zhihong Gou, Shijie Cao, Weigang Feng, Sicheng Zhang, Guohao Dai, Ningyi Xu

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Machine learning, Neural networks, nVidia, nVidia A100, nVidia GeForce RTX 4090, Performance

December 8, 2024 by hgpu

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Xiaoman Liu

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Performance, TensorFlow

November 3, 2024 by hgpu

Characterizing CUDA and OpenMP Synchronization Primitives

Brandon Alexander Burtchell, Martin Burtscher

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 2070, nVidia GeForce RTX 4090, OpenMP, Package, Performance

August 25, 2024 by hgpu

RBMD: A molecular dynamics package enabling to simulate 10 million all-atom particles in a single graphics processing unit

Weihang Gao, Teng Zhao, Yongfa Guo, Jiuyang Liang, Huan Liu, Maoying Luo, Zedong Luo, Wei Qin, Yichao Wang, Qi Zhou, Shi Jin, Zhenli Xu

View

Download (PDF)

Source codes

Tags: Computational Physics, CUDA, Heterogeneous systems, Molecular dynamics, nVidia, nVidia GeForce RTX 4090, Package, Physics, Tesla A100, Tesla V100

July 28, 2024 by hgpu

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

Hani Khader

View

Download (PDF)

Tags: AMD Radeon RX 6800, ATI, Computer science, CUDA, nVidia, nVidia GeForce RTX 4090, OpenCL, Security, Thesis

July 14, 2024 by hgpu

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

Advances in Semantic Patching for HPC-oriented Refactorings with Coccinelle

DuoReduce: MLIR's benchmark

Hardware-Assisted Software Testing and Debugging for Heterogeneous Computing

Shamrock: Multi-GPU hydrodynamics for astrophysics

The Shamrock code: I- Smoothed Particle Hydrodynamics on GPUs

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

* * *

high performance computing on graphics processing units: hgpu.org

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Profiling Apple Silicon Performance for ML Training

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

RTCUDB: Building Databases with RT Processors

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Characterizing CUDA and OpenMP Synchronization Primitives

RBMD: A molecular dynamics package enabling to simulate 10 million all-atom particles in a single graphics processing unit

The Impact of Modern Consumer GPUs on Commonly Used Secure Password Standards

Recent source codes

Coccinelle: a C code transformation engine using SmPL for matches, refactorings, and bug fixing

DuoReduce: MLIR's benchmark

Shamrock: Multi-GPU hydrodynamics for astrophysics

LLMPerf: GPU Performance Modeling meets Large Language Models

Hercules: A Compiler for Productive Programming of Heterogeneous Systems

Celerity Runtime: High-level C++ for Accelerator Clusters

wgpy: WebGL accelerated numpy-compatible array library for web browser

Microbenchmarking OpenMP target offload with Catch2

SUperman: Highly Efficient Permanent Computation Library

TransCL: An Automatic CUDA-to-OpenCL Programs Transformation Framework

Most viewed papers (last 30 days)