The Kaitchup – AI on a Budget

The Kaitchup – AI on a Budget

Home
Notes
AI Notebooks
The Kaitchup's Book
Weekly Kaitchup
Tutorials
Archive
About

The Weekly Kaitchup #100

The Kaitchup, Year 3
READ THE LATEST
The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Weekly tutorials, tips, and news on fine-tuning, running, and serving large language models on your computer. The Kaitchup also publishes two new AI notebooks every week.

Recent posts

View all
Better Packing for Fine-Tuning LLMs with the First Fit Decreasing (FFD) Strategy
No more over-segmentation, no more cross-contamination
 • 
Benjamin Marie
vLLM vs Ollama: How They Differ and When To Use Them
With Examples of Offline and Online Inference
 • 
Benjamin Marie
The Weekly Kaitchup #99
IFBench - ERNIE 4.5 - Gemma 3n
 • 
Benjamin Marie
Gemma 3n: Fine-Tuning, Inference, and Submodel Extraction
Running Gemma 3n with vLLM and fine-tuning with TRL
 • 
Benjamin Marie
The Weekly Kaitchup #98
Survey - Mistral 3.2 - And More News
 • 
Benjamin Marie
Get the Best from GGUF Models: Optimize Your Inference Hyperparameters
The default hyperparameters are suboptimal for quantized models
 • 
Benjamin Marie
2
Top posts
Multimodal RAG with ColPali and Qwen2-VL on Your Computer
 • Benjamin Marie
11
RAG with Qwen3 Embedding and Qwen3 Reranker
 • Benjamin Marie
4
LoRA Adapters: When a Naive Merge Leads to Poor Performance
 • Benjamin Marie
46
GRPO: Train LLMs with DeepSeek-R1's Reinforcement Learning Method
 • Benjamin Marie
5
Combine Multiple LoRA Adapters for Llama 2
 • Benjamin Marie
7
Recommendations
View all 10
AI Horizon Forecast
AI Horizon Forecast
Nikos Kafritsas
💎DiamantAI
💎DiamantAI
Nir Diamant
AI Tidbits
AI Tidbits
Sahar Mor
Artificial Ignorance
Artificial Ignorance
Charlie Guo
Why Try AI
Why Try AI
Daniel Nest
150+ AI Notebooks Now + 2 Each Week:

Tutorials

View all
Gemma 3n: Fine-Tuning, Inference, and Submodel Extraction
Running Gemma 3n with vLLM and fine-tuning with TRL
 • 
Benjamin Marie
RAG with Qwen3 Embedding and Qwen3 Reranker
How to use embedding and reranker models to efficiently retrieve only the most relevant chunks or documents given a user query
 • 
Benjamin Marie
4
RTX 6000 Pro vs H100 & A100: Best Single-GPU Choice for Fast, Low-Cost LLM Fine-Tuning
Faster, cheaper single-GPU training
 • 
Benjamin Marie
1
Fine-Tuning 2-Bit Qwen3 Models on Your Computer
Code and best practices
 • 
Benjamin Marie
Qwulu 3: Fine-Tuning Qwen3 Base with LoRA and TULU 3's Supervised Fine-Tuning Recipe
Can a supervised fine-tuning recipe that works effectively on Llama 3.1 be applied directly to Qwen3?
 • 
Benjamin Marie
© 2025 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture