The Kaitchup – AI on a Budget
Subscribe
Sign in
Home
Notes
AI Notebooks
The Kaitchup Pro
The Kaitchup's Book
AI Toolboxes
Tutorials
Models
LLM Leaderboards
Archive
About
Latest
Top
Discussions
Fast and Memory-Efficient Text-to-SQL with Qwen2.5 Coder 32B Instruct on Your GPU
Quantization and prompting with vLLM
Dec 23
•
Benjamin Marie
7
Share this post
The Kaitchup – AI on a Budget
Fast and Memory-Efficient Text-to-SQL with Qwen2.5 Coder 32B Instruct on Your GPU
Copy link
Facebook
Email
Notes
More
1
The Weekly Kaitchup #72
Falcon 3 - Apollo-LMMs - Qwen2.5 report
Dec 20
•
Benjamin Marie
6
Share this post
The Kaitchup – AI on a Budget
The Weekly Kaitchup #72
Copy link
Facebook
Email
Notes
More
Phi-4: What's New and How to Fine-Tune It on Your Computer (+ quantized version)
The good student of GPT-4
Dec 19
•
Benjamin Marie
10
Share this post
The Kaitchup – AI on a Budget
Phi-4: What's New and How to Fine-Tune It on Your Computer (+ quantized version)
Copy link
Facebook
Email
Notes
More
3
Schedule-Free Optimizer: Does It Work for LLMs?
Experiments with Llama 3.2: schedule-free vs. standard AdamW
Dec 16
•
Benjamin Marie
6
Share this post
The Kaitchup – AI on a Budget
Schedule-Free Optimizer: Does It Work for LLMs?
Copy link
Facebook
Email
Notes
More
The Weekly Kaitchup #71
efficient long context - Phi-4 - Molmo recipe
Dec 13
•
Benjamin Marie
7
Share this post
The Kaitchup – AI on a Budget
The Weekly Kaitchup #71
Copy link
Facebook
Email
Notes
More
5
Fine-Tuning Llama 3.3 70B with a Single GPU
And how to fix a poorly accurate 2-bit model
Dec 12
•
Benjamin Marie
11
Share this post
The Kaitchup – AI on a Budget
Fine-Tuning Llama 3.3 70B with a Single GPU
Copy link
Facebook
Email
Notes
More
Quantize and Run Llama 3.3 70B Instruct on Your GPU
4-bit👍, 3-bit👎, and 2-bit👎quantization
Dec 9
•
Benjamin Marie
10
Share this post
The Kaitchup – AI on a Budget
Quantize and Run Llama 3.3 70B Instruct on Your GPU
Copy link
Facebook
Email
Notes
More
1
The Weekly Kaitchup #70
EuroLLM - Unsloth's Quantization - PaliGemma 2 - bitsandbytes updates
Dec 6
•
Benjamin Marie
5
Share this post
The Kaitchup – AI on a Budget
The Weekly Kaitchup #70
Copy link
Facebook
Email
Notes
More
Multi-GPU DPO Training with FSDP: Full Training, LoRA, and QLoRA
DPO training for Qwen2.5 72B and Llama 3.1 70B on consumer hardware
Dec 5
•
Benjamin Marie
6
Share this post
The Kaitchup – AI on a Budget
Multi-GPU DPO Training with FSDP: Full Training, LoRA, and QLoRA
Copy link
Facebook
Email
Notes
More
6
LLM Alignment: Searching for Optimal ORPO Hyperparameters
Higher learning rate and beta
Dec 2
•
Benjamin Marie
7
Share this post
The Kaitchup – AI on a Budget
LLM Alignment: Searching for Optimal ORPO Hyperparameters
Copy link
Facebook
Email
Notes
More
2
November 2024
The Weekly Kaitchup #69
OLMo 2 and Tulu 3 Quantized - QwQ - SmolVLM - Evaluation
Nov 29
•
Benjamin Marie
6
Share this post
The Kaitchup – AI on a Budget
The Weekly Kaitchup #69
Copy link
Facebook
Email
Notes
More
Fine-Tune Llama 3.2 Vision, Pixtral, and Qwen2-VL on Your Computer with Unsloth
Step-by-step guide for memory-efficient fine-tuning
Nov 28
•
Benjamin Marie
9
Share this post
The Kaitchup – AI on a Budget
Fine-Tune Llama 3.2 Vision, Pixtral, and Qwen2-VL on Your Computer with Unsloth
Copy link
Facebook
Email
Notes
More
Share
Copy link
Facebook
Email
Notes
More
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts