UD quants missing some files

#2
by MLDataScientist - opened

Hi Daniel,
Thank you for sharing these awesome quants for QWEN3.
Similar to my previous post.
I noticed that UD files are small in size. e.g. Qwen3-235B-A22B-UD-Q4_K_XL.gguf is only ~31GB. Meanwhile, Q4_1 is almost ~150GB. So, UD quants may be missing some more files.

same ,they seem suspiciously small.

There's also the 907 MB IQ4_NL and 1.15GB IQ1_S. These are suspicious.

Unsloth AI org
This comment has been hidden

@MLDataScientist @rdsm @stduhpf @chadima @Panchovix

ONLY use the avalable versions for now. We deleted all of the rest that dont work

Unsloth AI org

@MLDataScientist @rdsm @stduhpf @chadima @Panchovix

Edit: We deleted the ones that don't work. The remaining versions should work!

@MLDataScientist @rdsm @stduhpf @chadima @Panchovix

Edit: We deleted the ones that don't work. The remaining versions should work!

Appreciate your work. And would there be UD quantized versions in the future?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment