The Kaitchup – AI on a Budget

The Kaitchup – AI on a Budget

Share this post

The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Run Llama 3.1 70B Instruct on Your GPU with ExLlamaV2 (2.2, 2.5, 3.0, and 4.0-bit)

Run Llama 3.1 70B Instruct on Your GPU with…

Benjamin Marie
Aug 29, 2024
8

Share this post

The Kaitchup – AI on a Budget
The Kaitchup – AI on a Budget
Run Llama 3.1 70B Instruct on Your GPU with ExLlamaV2 (2.2, 2.5, 3.0, and 4.0-bit)
8

This thread is only visible to paid subscribers of The Kaitchup – AI on a Budget

Subscribe to view →

Comments on this post are for paid subscribers

Already a paid subscriber? Sign in
© 2025 The Kaitchup
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share