The Kaitchup – AI on a Budget

Home
Notes
AI Notebooks
The Kaitchup Pro
The Kaitchup's Book
AI Toolboxes
Tutorials
Models
LLM Leaderboards
Archive
About
Fine-Tune Llama 3.2 Vision, Pixtral, and Qwen2-VL on Your Computer with Unsloth
Step-by-step guide for memory-efficient fine-tuning
 • 
Benjamin Marie
Fast Speculative Decoding with Llama 3.2 and vLLM
Boost LLM inference speed with speculative decoding!
 • 
Benjamin Marie
2
DPO Full Training vs. LoRA: How Good is LoRA for DPO Training?
One model, two adapters
 • 
Benjamin Marie
Fine-Tuning Meta's Llama 3.2 1B & 3B Models on Budget GPUs
And how they were created
 • 
Benjamin Marie
4
Quantize and Run Llama 3.3 70B Instruct on Your GPU
4-bit👍, 3-bit👎, and 2-bit👎quantization
 • 
Benjamin Marie
Most Popular
View all
Run Llama 2 70B on Your GPU with ExLlamaV2
 • Benjamin Marie
Fine-tune Llama 3 on Your Computer
 • Benjamin Marie
38
Multimodal RAG with ColPali and Qwen2-VL on Your Computer
 • Benjamin Marie
11
QLoRA: Fine-Tune a Large Language Model on Your GPU
 • Benjamin Marie
The Weekly Kaitchup #70
EuroLLM - Unsloth's Quantization - PaliGemma 2 - bitsandbytes updates
 • 
Benjamin Marie
Multi-GPU DPO Training with FSDP: Full Training, LoRA, and QLoRA
DPO training for Qwen2.5 72B and Llama 3.1 70B on consumer hardware
 • 
Benjamin Marie
3
LLM Alignment: Searching for Optimal ORPO Hyperparameters
Higher learning rate and beta
 • 
Benjamin Marie
2
The Weekly Kaitchup #69
OLMo 2 and Tulu 3 Quantized - QwQ - SmolVLM - Evaluation
 • 
Benjamin Marie
The Recipe for Extremely Accurate and Cheap Quantization of 70B+ LLMs
Cost and accuracy for quantizing large models to 4-bit and 2-bit
 • 
Benjamin Marie
3
The Weekly Kaitchup #68
Judge Arena - Fine-Tuning VLMs - Orca AgentInstruct
 • 
Benjamin Marie
Find the Best LLM for Your GPU
The leaderboards of memory efficiency
 • 
Benjamin Marie
Black Friday Discounts
30% off for the yearly subscription, a reworked Kaitchup Pro, and the Llama 3.1/3.2 toolbox
 • 
Benjamin Marie
3
The Weekly Kaitchup #67
Qwen2.5 Coder 32B - Quantization for Models Trained on Large Datasets
 • 
Benjamin Marie
The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Weekly tutorials, tips, and news on fine-tuning, running, and serving large language models on your computer. The Kaitchup also publishes two new AI notebooks every week.
Recommendations
View all 10
AI Tidbits
AI Tidbits
Sahar Mor
The Salt - Curated AI
The Salt - Curated AI
Benjamin Marie
Generative AI Publication
Generative AI Publication
Jim Clyde Monge
The Poor GPU Guy's Substack
The Poor GPU Guy's Substack
Fabio
Why Try AI
Why Try AI
Daniel Nest

The Kaitchup – AI on a Budget

AboutArchiveRecommendationsSitemap
© 2024 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture