The Kaitchup – AI on a Budget

Home
Notes
AI Notebooks
Table of Contents
Tutorials
Models
Hardware for LLMs
Archive
About
Fine-tune Llama 3 70B on Your GPU with AQLM 2-bit
It's possible to fine-tune Llama 3 70B with only 24 GB of GPU RAM
 • 
Benjamin Marie
The Weekly Kaitchup #40
RWKV-6 - DeepSeek-V2 - Panza
 • 
Benjamin Marie
Fine-tune Tiny Chat Models with Apple OpenELM and ORPO
Can we make a good chat model with a 270M LLM?
 • 
Benjamin Marie
Run Llama 3 70B on Your GPU with ExLlamaV2
2.5 bits per weight, on average, is good enough
 • 
Benjamin Marie
The Weekly Kaitchup #39
GSM1k - Llama 3 Quantized? - Predict Multiple Tokens at Once
 • 
Benjamin Marie
Phi-3: Fine-tuning and Quantization on Your Computer
Larger and better than Phi-2
 • 
Benjamin Marie
17

April 2024

Turn Llama 3 into an Embedding Model with LLM2Vec
RAG with Llama 3 for the generation and the retrieval
 • 
Benjamin Marie
13
The Weekly Kaitchup #38
Phi-3 - OpenELM - Llama 3 with QDoRA - FineWeb
 • 
Benjamin Marie
Estimate the Memory Consumption of LLMs for Inference and Fine-tuning
A close look at the memory consumption of Command-R+, Mixtral-8x22B, and Llama 3 70B
 • 
Benjamin Marie
Fine-tune Llama 3 on Your Computer
With code to merge QLoRA adapters and quantize the model
 • 
Benjamin Marie
21
The Weekly Kaitchup #37
Llama 3 - Mixtral-8x22B - Megalodon - WizardLM-2
 • 
Benjamin Marie
21
Training, Loading, and Merging QDoRA, QLoRA, and LoftQ Adapters
And How to Quantize LLMs After a Merge
 • 
Benjamin Marie
2
© 2024 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture