Fine-tune a Chat Model on Your Data with QLoRA
Your GPU is all you need
GPT-NeoX-20B is among the most popular open GPT models (Apache 2.0 License, commercial use allowed). You can fine-tune this model on an instruction dataset to obtain your own chatbot similar to ChatGPT.
But GPT-NeoX-20B is a 20-billion parameter model. It won’t directly fit on your GPU.
With quantization, e.g.…