Tag for IQ3_XS
Hello! Can you please add the tag for IQ3_XS? I am not being able to pull it. Thanks!
Hello! Can you please add the tag for IQ3_XS? I am not being able to pull it. Thanks!
It's right here in the repo at https://huggingface.co/SpongeEngine/Cydonia-22B-v1.3-i1-GGUF/tree/main, I can also download it at https://huggingface.co/SpongeEngine/Cydonia-22B-v1.3-i1-GGUF/blob/main/cydonia-22b-v1.3-i1-IQ3_XS.gguf. Perhaps the issue is on your end?
I am really not sure what do you mean by tag. I don't have that much experience quantizing ggufs.
Indeed the file is available, however for some reason I cannot pull it through the CLI, for example:
ollama pull hf.co/backyardai/Cydonia-22B-v1.3-GGUF:IQ3_XS
I receive a not found error for the command above. The other tags works fine, like IQ3_XXS and IQ3_S.
Maybe it's some missing metadata in HuggingFace? Taking a closer look the IQ3_XS is not available at the GGFU list:
As far as I know, users don't have control over that. It seems HuggingFace does it automatically, I can't find any config for it. Are there any repos where you can find them? Perhaps it's not recognized in any repo?
Apparently it is a HuggingFace issue, there is a similar report here:
https://huggingface.co/bartowski/Mistral-Small-24B-Instruct-2501-GGUF/discussions/1
Thanks for checking!
Apparently it is a HuggingFace issue, there is a similar report here:
https://huggingface.co/bartowski/Mistral-Small-24B-Instruct-2501-GGUF/discussions/1Thanks for checking!
I pinged Clem in the other thread maybe he'll fix it.