The Kaitchup – AI on a Budget

The Kaitchup – AI on a Budget

Share this post

The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Fine-tune a Chat Model on Your Data with QLoRA
Copy link
Facebook
Email
Notes
More

Fine-tune a Chat Model on Your Data with QLoRA

Your GPU is all you need

Benjamin Marie's avatar
Benjamin Marie
Jul 05, 2023
∙ Paid
3

Share this post

The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Fine-tune a Chat Model on Your Data with QLoRA
Copy link
Facebook
Email
Notes
More
3
1
Share

A guanaco — Photo by Thomas Griggs on Unsplash

GPT-NeoX-20B is among the most popular open GPT models (Apache 2.0 License, commercial use allowed). You can fine-tune this model on an instruction dataset to obtain your own chatbot similar to ChatGPT.

But GPT-NeoX-20B is a 20-billion parameter model. It won’t directly fit on your GPU.

With quantization, e.g.…

This post is for paid subscribers

Already a paid subscriber? Sign in
© 2025 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share

Copy link
Facebook
Email
Notes
More