The Kaitchup – AI on a Budget

Home
Notes
AI Notebooks
The Kaitchup Pro
The Kaitchup's Book
AI Toolboxes
Tutorials
Models
LLM Leaderboards
Archive
About
DeepSeek-R1: Reinforcement Learning with Simple and Verifiable Rewards
Qwen2.5 and Llama 3.x are good students
 • 
Benjamin Marie
2
Local Agentic AI with smolagents and Qwen2.5 Coder
When to use it and when does it fail
 • 
Benjamin Marie
3
DeepSeek-V3: Understanding and Running the Best Open LLM Locally
A huge but efficient MoE
 • 
Benjamin Marie
1
Fine-Tuning Llama 3.3 70B with a Single GPU
And how to fix a poorly accurate 2-bit model
 • 
Benjamin Marie
Fine-Tune Llama 3.2 Vision, Pixtral, and Qwen2-VL on Your Computer with Unsloth
Step-by-step guide for memory-efficient fine-tuning
 • 
Benjamin Marie
Most Popular
View all
Multimodal RAG with ColPali and Qwen2-VL on Your Computer
 • Benjamin Marie
11
Fine-tune Llama 3 on Your Computer
 • Benjamin Marie
38
QLoRA: Fine-Tune a Large Language Model on Your GPU
 • Benjamin Marie
2
DeepSeek-V3: Understanding and Running the Best Open LLM Locally
 • Benjamin Marie
1
Fine-Tuning Your LLM to "Think" Like DeepSeek R1, on Your Computer
Experiments with SFT, Llama 3.2 3B, and Training Data Generated by DeepSeek R1
 • 
Benjamin Marie
The Weekly Kaitchup #77
Qwen2.5-VL - Mistral AI and Apache 2.0 - vLLM v1, Janus 7B, and DeepSeek-R1 1.58-bit
 • 
Benjamin Marie
Extract Post-Training Weights as a LoRA Adapter for LLMs
Can we turn DeepSeek-R1 into an adapter?
 • 
Benjamin Marie
2-bit VPTQ: 6.5x Smaller LLMs, >95% Accuracy
Very accurate 2-bit quantization for running 70B LLMs on a 24 GB GPU
 • 
Benjamin Marie
3
The Weekly Kaitchup #76
GRPO/TRL - SmolVLM - Coconut
 • 
Benjamin Marie
Estimating Memory Usage for LLMs During Inference (V2)
KV cache, GQA, FlashAttention, activations, batching...
 • 
Benjamin Marie
6
The Weekly Kaitchup #75
MiniMax-01 - Qwen2.5 PRM - Kokoro and OuteTTS
 • 
Benjamin Marie
MMLU: Do LLMs Really Know?
When 1. = １. = A. = Ａ. = a. = A) disrupts LLM's world knowledge and language understanding capabilities
 • 
Benjamin Marie
3
The Weekly Kaitchup #74
Open Phi-4 - OLMo 2 Paper
 • 
Benjamin Marie
The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Weekly tutorials, tips, and news on fine-tuning, running, and serving large language models on your computer. The Kaitchup also publishes two new AI notebooks every week.
Recommendations
View all 10
AI Tidbits
AI Tidbits
Sahar Mor
💎DiamantAI
💎DiamantAI
Nir Diamant
AI Disruption
AI Disruption
Meng Li
Generative AI Publication
Generative AI Publication
Jim Clyde Monge
Why Try AI
Why Try AI
Daniel Nest

The Kaitchup – AI on a Budget

AboutArchiveRecommendationsSitemap
© 2025 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture