huihui-ai
/

Moonlight-16B-A3B-Instruct-abliterated-Pruned

Text Generation

Model card Files Files and versions Community

huihui-ai commited on 21 days ago

Commit

bf09105

·

verified ·

1 Parent(s): 9fb7788

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ tags:
 This is a pruned version of the [huihui-ai/Moonlight-16B-A3B-Instruct-abliterated](https://huggingface.co/huihui-ai/Moonlight-16B-A3B-Instruct-abliterated),
-reduced from 64 experts to 32 experts. The pruned system is mainly used for [code](https://huggingface.co/huihui-ai/Moonlight-16B-A3B-Instruct-abliterated-Pruned/blob/main/coding_problems.py) generation.
 This is a test validation to see if we can prune the model according to professional requirements and still maintain acceptable performance. The model size has been reduced by about half, and no distortion has occurred.

 This is a pruned version of the [huihui-ai/Moonlight-16B-A3B-Instruct-abliterated](https://huggingface.co/huihui-ai/Moonlight-16B-A3B-Instruct-abliterated),
+reduced from 64 experts to 32 experts. The pruned model is mainly used for [code](https://huggingface.co/huihui-ai/Moonlight-16B-A3B-Instruct-abliterated-Pruned/blob/main/coding_problems.py) generation.
 This is a test validation to see if we can prune the model according to professional requirements and still maintain acceptable performance. The model size has been reduced by about half, and no distortion has occurred.