Fine-Tuning 2-Bit Qwen3 Models on Your Computer

Accurate 2-bit Quantization: Run Massive LLMs on a Single Consumer GPU

How Well Does Qwen3 Handle 4-bit and 2-bit Quantization?

Mistral Small 3: An Excellent 24B-Parameter Wide-Shallow LLM

Quantize and Run Llama 3.3 70B Instruct on Your GPU

The Recipe for Extremely Accurate and Cheap Quantization of 70B+ LLMs

The Impact of the Calibration Dataset for AutoRound and AWQ Quantization

Mistral-NeMo: 4.1x Smaller with Quantized Minitron

Fine-tuning Phi-3.5 MoE and Mini on Your Computer

QLoRA with AutoRound: Cheaper and Better LLM Fine-tuning on Your GPU

Intel AutoRound: Accurate Low-bit Quantization for LLMs