8-bit GPTQ Quantization of huihui-ai/Qwen2.5-32B-Instruct-abliterated

This is an uncensored version of Qwen2.5-32B-Instruct created with abliteration (see this article to know more about it).

Downloads last month
9
Safetensors
Model size
9.67B params
Tensor type
FP16
·
I32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for akhbar/Qwen2.5-32B-Instruct-abliterated-8bit-128g-actorder_True-GPTQ

Base model

Qwen/Qwen2.5-32B
Quantized
(5)
this model