Live gallery: https://arpitsinghgautam.me/llm-quantization-gallery/

A curated, visual reference for LLM quantization methods — 93 methods across 8 categories, each with a flowchart diagram, fact sheet, and cross-references.

Modeled after Sebastian Raschka's llm-architecture-gallery.

Browse:

• Full method cards — fact sheets, diagrams, key ideas
• Timeline — all methods sorted by date
• Lineage graph — builds-on relationships
• Notation guide — W4A16, W8A8KV4, group sizes
• Glossary
• Contributing

AQLM	AutoRound	AWQ	EXL2	FLUTE	FP6-LLM
GGUF I-quants	GGUF K-quants	GPTQ	HQQ	LittleBit	Marlin
NF4 / QLoRA	OBQ	OBS	OmniQuant	OWQ	QTIP
QuaRot / Quant-LLM (FP6)	QuIP	QuIP#	RAMP	RTN	SpQR
SqueezeLLM	AffineQuant	Atom	DuQuant	FlatQuant	LLM.int8()
Outlier Suppression	Outlier Suppression+	ParoQuant	QLLM	QServe	QuaRot
ResQ	RPTQ	SmoothQuant	SpinQuant	ZeroQuant	ZeroQuant(4+2)
ZeroQuant-FP	ZeroQuant-V2	ApiQ	BitDistiller	EfficientQAT	IR-QLoRA
LLM-QAT	LoftQ	PEQA	PV-Tuning	QA-LoRA	QLoRA
BiLLM	BitNet	BitNet b1.58	BitNet b1.58 2B4T	MatMul-free LM	OneBit
PB-LLM	Spectra	Tequila	Coupled Quantization	GEAR	KIVI
KVQuant	Palu	PM-KVQ	PQCache	QAQ	RotateKV
SageAttention	SKVQ	SnapKV	ThinK	TurboQuant	WKVQuant
ZipCache	DeepSeek FP8 Training	FP8 Training (Transformer Engine)	MX Formats (MXFP8/MXFP6/MXFP4)	NVFP4	MC-MoE
MoQE	AutoAWQ	AutoGPTQ	bitsandbytes	ExLlamaV2	llama.cpp (GGUF)
MLC-LLM	SGLang (Quantization)	vLLM (Quantization)

93 methods · 8 categories · updated 2026-04-07