27120
hgpu.org » nVidia A40

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale

Tim Dettmers, Mike Lewis, Younes Belkada, Luke Zettlemoyer
View View   Download Download (PDF)   Source codes Source codes

Tags: , , , , , , , ,

August 21, 2022 by hgpu

Recent source codes

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5

A Safety Report on GPT-5.2, Gemini 3 Pro, Qwen3-VL, Grok 4.1 Fast, Nano Banana Pro, and Seedream 4.5
DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels

DICE: Diffusion Large Language Models Excel at Generating CUDA Kernels
KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

KernelGYM & Dr. Kernel: A distributed GPU environment and a collection of RL training methods to support RL for Kernel Generations

Dr. Kernel: Reinforcement Learning Done Right for Triton Kernel Generations
Vortex-Optimized Light-weight Toolchain (VOLT)

Vortex-Optimized Light-weight Toolchain (VOLT)

Inside VOLT: Designing an Open-Source GPU Compiler (Tool)
SciDef: Automated Definition Extraction from Scientific Literature

SciDef: Automated Definition Extraction from Scientific Literature

SciDef: Automating Definition Extraction from Academic Literature with Large Language Models
bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

bioagent-bench: Benchmark for evaluating LLM agents in bioinformatics

BioAgent Bench: An AI Agent Evaluation Suite for Bioinformatics
Benchmark suite for LLM inference on NVIDIA consumer GPUs

Benchmark suite for LLM inference on NVIDIA consumer GPUs

Private LLM Inference on Consumer Blackwell GPUs: A Practical Guide for Cost-Effective Local Deployment in SMEs
Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Theorizer: from the paper Generating Literature-Driven Scientific Discoveries at Scale

Generating Literature-Driven Scientific Theories at Scale
Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Nsight Python: a Python kernel profiling interface based on NVIDIA Nsight Tools

Nsight Python: A Python-First Profiling Toolkit for Seamless GPU Kernel Analysis (Tool)
Awesome LLM-Driven Kernel Generation

Awesome LLM-Driven Kernel Generation

Towards Automated Kernel Generation in the Era of LLMs
See all packages

* * *

* * *

HGPU group © 2010-2026 hgpu.org

All rights belong to the respective authors

Login | Sitemap | Feedback | Policy

Contact us: