Possible to do the "1/2" version - 16B ?

#1
by DavidAU - opened

Hey;

Was wondering if it is possible to "abliterate" this version:

https://huggingface.co/kalomaze/Qwen3-16B-A3B

I have downloaded/tested and Imatrixed - this version works great at 1/2 the size.
Kalomaze selected top 64 experts of 128 used , and made this version.

Thank you for all you do - your models are great.
I have used them in MOEs and merges.

Alright, we'll give it a try.

Can we just prune the abliterated model in the same way, rather than recompute the abliteration vector?

Let's test it to see if it works.

Excellent. ; thanks! ;

Thank is wonderful - thanks so much.

Sign up or log in to comment