high performance computing on graphics processing units: hgpu.org

hgpu.org » nVidia GeForce RTX 4090

Scaling On-Device GPU Inference for Large Generative Models

Jiuqiang Tang, Raman Sarokin, Ekaterina Ignasheva, Grant Jensen, Lin Chen, Juhyun Lee, Andrei Kulik, Matthias Grundmann

View

Download (PDF)

Tags: AI, Computer science, CUDA, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, OpenCL

May 4, 2025 by hgpu

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

Meng Wang, Jinshuo Liu, Zimeng Xu, Chang Ding, Xiaomeng Huang

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, LLM, nVidia, nVidia GeForce RTX 4090, Package

April 13, 2025 by hgpu

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Heejun Lee, Geon Park, Jaduk Suh, Sung Ju Hwang

View

Download (PDF)

Source codes

Tags: Computer science, LLM, NLP, nVidia, nVidia GeForce RTX 4090, Package

February 16, 2025 by hgpu

Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs

Youhe Jiang, Fangcheng Fu, Xiaozhe Yao, Guoliang He, Xupeng Miao, Ana Klimovic, Bin Cui, Binhang Yuan, Eiko Yoneki

View

Download (PDF)

Source codes

Tags: Benchmarking, Cloud, Computer science, Heterogeneous systems, LLM, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia RTX A6000, Package

February 10, 2025 by hgpu

Profiling Apple Silicon Performance for ML Training

Dahua Feng, Zhiming Xu, Rongxiang Wang, Felix Xiaozhu Lin

View

Download (PDF)

Tags: AI, Apple M2 Max, Apple M2 Pro, Apple M2 Ultra, Computer science, CUDA, Linear Algebra, LLM, Machine learning, nVidia, nVidia GeForce RTX 4090, nVidia GeFroce RTX 2080 Ti, nVidia Quadro RTX 4000, nVidia RTX A6000, Performance, PyTorch

February 3, 2025 by hgpu

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Hongyuan Liu, Qiang Wang, Xiaowen Chu

View

Download (PDF)

Tags: Benchmarking, Computer science, CUDA, Hardware Architecture, nVidia, nVidia A100, nVidia GeForce RTX 4090, nVidia H800, Performance, PTX

January 27, 2025 by hgpu

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Naifeng Zhang, Franz Franchetti

View

Download (PDF)

Source codes

Tags: Code generation, Computer science, CUDA, Linear Algebra, Modular arithmetic, nVidia, nVidia GeForce RTX 4090, nVidia H100, nVidia V100, Package, Security

January 20, 2025 by hgpu

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

Rémi Genet, Hugo Inzirillo

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Deep learning, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Python, TensorFlow

January 20, 2025 by hgpu

RTCUDB: Building Databases with RT Processors

Xuri Shi, Kai Zhang, X. Sean Wang, Xiaodong Zhang, Rubao Lee

View

Download (PDF)

Tags: Computer science, CUDA, Databases, nVidia, nVidia GeForce GTX Titan X, nVidia GeForce RTX 4090

December 15, 2024 by hgpu

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach

Yijia Zhang, Zhihong Gou, Shijie Cao, Weigang Feng, Sicheng Zhang, Guohao Dai, Ningyi Xu

View

Download (PDF)

Tags: Computer science, CUDA, Energy-efficient computing, Machine learning, Neural networks, nVidia, nVidia A100, nVidia GeForce RTX 4090, Performance

December 8, 2024 by hgpu

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Xiaoman Liu

View

Download (PDF)

Source codes

Tags: Benchmarking, Computer science, Machine learning, nVidia, nVidia GeForce RTX 4090, Package, Performance, TensorFlow

November 3, 2024 by hgpu

Characterizing CUDA and OpenMP Synchronization Primitives

Brandon Alexander Burtchell, Martin Burtscher

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, nVidia, nVidia A100, nVidia GeForce RTX 2070, nVidia GeForce RTX 4090, OpenMP, Package, Performance

August 25, 2024 by hgpu

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

Efficient Graph Embedding at Scale: Optimizing CPU-GPU-SSD Integration

Can Large Language Models Predict Parallel Code Performance?

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Scaling On-Device GPU Inference for Large Generative Models

Large Language Model Powered C-to-CUDA Code Translation: A Novel Auto-Parallelization Framework

InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU

Profiling Apple Silicon Performance for ML Training

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Code Generation for Cryptographic Kernels using Multi-word Modular Arithmetic on GPU

Keras Sig: Efficient Path Signature Computation on GPU in Keras 3

RTCUDB: Building Databases with RT Processors

Automating Energy-Efficient GPU Kernel Generation: A Fast Search-Based Compilation Approach

MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction

Characterizing CUDA and OpenMP Synchronization Primitives

Recent source codes

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration

chemtrain: Training Molecular Dynamics Potentials in JAX

microSYCL: SYCL micro-benchmarks repository

XaaS containers

SYCL Container

CASS: Cuda-Amd aSSembly

Cluser of smartphones for edge computing application using TensorFlow

CFAL-bench

Efficient Graph Embedding at Scale: Optimizing CPU-GPU-SSD Integration

Can Large Language Models Predict Parallel Code Performance?

Most viewed papers (last 30 days)