---
license: apache-2.0
pipeline_tag: text-generation
tags:
- 5-bit
- exl2
- quantization
language:
- en
library_name: transformers
base_model:
- huihui-ai/QwQ-32B-abliterated
---

This is a 5.0bpw/h8 quantized version of huihui-ai/QwQ-32B-abliterated using exllamav2 with this [PR](https://github.com/turboderp-org/exllamav2/pull/712) applied.