The Weekly Kaitchup #125
I didn't try it yet. But the model card says it does.
Yeah, I saw that...but some models have half-baked support in vLLM.
Do you know if Falcon H1R-7B works well with vLLM?
I didn't try it yet. But the model card says it does.
Yeah, I saw that...but some models have half-baked support in vLLM.
Do you know if Falcon H1R-7B works well with vLLM?