hgpu.org » LLM
Kangwei Xu, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann, Bing Li
Tags: Code generation, Computer science, FPGA, HLS, LLM
July 14, 2024 by hgpu
Ali Doosthosseini, Jonathan Decker, Hendrik Nolte, Julian M. Kunkel
Tags: AI, Cloud, Computer science, HPC, LLM, nVidia, nVidia H100, Package, PC cluster
July 7, 2024 by hgpu
Avinash Maurya, Jie Ye, M. Mustafa Rafique, Franck Cappello, Bogdan Nicolae
Tags: Computer science, CUDA, LLM, Memory, nVidia, nVidia A100, nVidia H100, Performance
June 23, 2024 by hgpu
Recent source codes
* * *
Most viewed papers (last 30 days)
- DeepSeek-V4-Flash on AMD gfx90a: Correctness Recovery and Inference Performance Engineering
- AutoTuneBench: Trustworthy Measurement for Agent Auto-Tuning of LLM Serving Engines
- Accelerating the Solving of Many Tiny General Linear Systems on GPUs: Application to Constitutive Laws
- PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving
- Microarchitectural Memory Bandwidth Saturation, KV-Cache Paging Dynamics, and Time-to-First-Token Latency: A Comparative Benchmark of vLLM, TensorRT-LLM, and FlashAttention-3 on NVIDIA Hopper H100 versus AMD Instinct MI300X
- Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures
- pytest-gpu-proof: Enabling Cloud-CPU Continuous Integration for GPU Code with Local GPU Attestation
- KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization
- AI as a Compiler: Compiling Triton kernels without the Triton compiler
- Automatically Generating ML Compiler Backends from Tensor Accelerator ISA Descriptions
* * *



