The Kaitchup – AI on a Budget

The Kaitchup – AI on a Budget

Home
Notes
AI Notebooks
The Kaitchup's Book
Weekly Kaitchup
Tutorials
Archive
About

Gemma 3n: Fine-Tuning, Inference, and Submodel Extraction

Running Gemma 3n with vLLM and fine-tuning with TRL
READ THE LATEST
The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Weekly tutorials, tips, and news on fine-tuning, running, and serving large language models on your computer. The Kaitchup also publishes two new AI notebooks every week.

Recent posts

View all
vLLM vs Ollama: How They Differ and When To Use Them
With Examples of Offline and Online Inference
 • 
Benjamin Marie
The Weekly Kaitchup #99
IFBench - ERNIE 4.5 - Gemma 3n
 • 
Benjamin Marie
The Weekly Kaitchup #98
Survey - Mistral 3.2 - And More News
 • 
Benjamin Marie
Get the Best from GGUF Models: Optimize Your Inference Hyperparameters
The default hyperparameters are suboptimal for quantized models
 • 
Benjamin Marie
2
The Weekly Kaitchup #97
Survey - Axolotl + LLM Compressor
 • 
Benjamin Marie
2
RAG with Qwen3 Embedding and Qwen3 Reranker
How to use embedding and reranker models to efficiently retrieve only the most relevant chunks or documents given a user query
 • 
Benjamin Marie
4
Top posts
Multimodal RAG with ColPali and Qwen2-VL on Your Computer
 • Benjamin Marie
11
RAG with Qwen3 Embedding and Qwen3 Reranker
 • Benjamin Marie
4
GRPO: Train LLMs with DeepSeek-R1's Reinforcement Learning Method
 • Benjamin Marie
5
LoRA Adapters: When a Naive Merge Leads to Poor Performance
 • Benjamin Marie
46
Combine Multiple LoRA Adapters for Llama 2
 • Benjamin Marie
7
Recommendations
View all 10
Why Try AI
Why Try AI
Daniel Nest
Generative AI Publication
Generative AI Publication
Jim Clyde Monge
The Poor GPU Guy's Substack
The Poor GPU Guy's Substack
Fabio
AI Horizon Forecast
AI Horizon Forecast
Nikos Kafritsas
AI Disruption
AI Disruption
Meng Li
150+ AI Notebooks Now + 2 Each Week:

Tutorials

View all
Gemma 3n: Fine-Tuning, Inference, and Submodel Extraction
Running Gemma 3n with vLLM and fine-tuning with TRL
 • 
Benjamin Marie
RAG with Qwen3 Embedding and Qwen3 Reranker
How to use embedding and reranker models to efficiently retrieve only the most relevant chunks or documents given a user query
 • 
Benjamin Marie
4
RTX 6000 Pro vs H100 & A100: Best Single-GPU Choice for Fast, Low-Cost LLM Fine-Tuning
Faster, cheaper single-GPU training
 • 
Benjamin Marie
1
Fine-Tuning 2-Bit Qwen3 Models on Your Computer
Code and best practices
 • 
Benjamin Marie
Qwulu 3: Fine-Tuning Qwen3 Base with LoRA and TULU 3's Supervised Fine-Tuning Recipe
Can a supervised fine-tuning recipe that works effectively on Llama 3.1 be applied directly to Qwen3?
 • 
Benjamin Marie
© 2025 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture