Hugging Face's logo

ReadyArt
/
QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
4-bit precision
exl2
Model card Files Community
1

EXL2 Quants by FrenzyBiscuit.

This model is 4.0 BPW EXL2.

Downloads last month
346
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.

Model tree for ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Base model

trashpanda-org/QwQ-32B-Snowdrop-v0
Quantized
(10)
this model

Collection including ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8