All the models are stored in The Kaitchup’s repository on the Hugging Face Hub.
Models tagged [Basics] are only available to paid subscribers. If you are a paid subscriber, you will find your access token at the bottom of this page.
[Basics] Quantized Qwen2
Qwen2 0.5B, 1.5B, and 7B (base and instruct) quantized to 8, 4, 3, 2 bits with AutoGPTQ and 8 and 4…