30036
hgpu.org » nVidia H200

Serving LLMs in HPC Clusters: A Comparative Study of Qualcomm Cloud AI 100 Ultra and High-Performance GPUs

Mohammad Firas Sada, John J. Graham, Elham E Khoda, Mahidhar Tatineni, Dmitry Mishin, Rajesh K. Gupta, Rick Wagner, Larry Smarr, Thomas A. DeFanti, Frank Würthwein
View View   Download Download (PDF)   

Tags: , , , , , , , ,

July 13, 2025 by hgpu

Recent source codes

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

pytest-gpu-proof: A Simple Pytest Extension for Local GPU Code Testing

pytest-gpu-proof: Enabling Cloud-CPU Continuous Integration for GPU Code with Local GPU Attestation
Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures

Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures
AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines

AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines
nvsass-disassembler

nvsass-disassembler

Automated Instruction Encoding Synthesis for Modern GPU ISA Compression
PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving
FP4 FlashAttention forward, backward, and TorchTitan reproduction code

FP4 FlashAttention forward, backward, and TorchTitan reproduction code

Hardware-Aware FP4 FlashAttention-4
EinsummableV3 - graph-based computation with tensor operations support

EinsummableV3 - graph-based computation with tensor operations support

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable
MaxKernel: Intelligent TPU Kernel Engineering Agents

MaxKernel: Intelligent TPU Kernel Engineering Agents

MaxKernel: Agentic Kernel Generation for TPUs
PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX
RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks
See all packages

* * *

* * *

HGPU group © 2010-2026 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: