The Kaitchup – AI on a Budget
Subscribe
Sign in
Share this post
The Kaitchup – AI on a Budget
Run a 7.7x Smaller Mixtral-8x7B on Your GPU with AQLM 2-bit Quantization
Copy link
Facebook
Email
Notes
More
Run a 7.7x Smaller Mixtral-8x7B on Your GPU…
Benjamin Marie
Feb 22, 2024
8
Share this post
The Kaitchup – AI on a Budget
Run a 7.7x Smaller Mixtral-8x7B on Your GPU with AQLM 2-bit Quantization
Copy link
Facebook
Email
Notes
More
6
1
This thread is only visible to paid subscribers of The Kaitchup – AI on a Budget
Subscribe to view →
Comments on this post are for paid subscribers
Subscribe
Already a paid subscriber?
Sign in
Share
Copy link
Facebook
Email
Notes
More
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
Share this post
Run a 7.7x Smaller Mixtral-8x7B on Your GPU…
Share this post
This thread is only visible to paid subscribers of The Kaitchup – AI on a Budget
Comments on this post are for paid subscribers