Possible to do the "1/2" version - 16B ?
#1
by
DavidAU
- opened
Hey;
Was wondering if it is possible to "abliterate" this version:
https://huggingface.co/kalomaze/Qwen3-16B-A3B
I have downloaded/tested and Imatrixed - this version works great at 1/2 the size.
Kalomaze selected top 64 experts of 128 used , and made this version.
Thank you for all you do - your models are great.
I have used them in MOEs and merges.
Alright, we'll give it a try.
Can we just prune the abliterated model in the same way, rather than recompute the abliteration vector?
Let's test it to see if it works.
Excellent. ; thanks! ;
Thank is wonderful - thanks so much.