ReadyArt
/

QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8 / README.md

FrenzyBiscuit's picture

Update README.md

e5cd18c verified 10 days ago

|

177 Bytes

	---
	base_model:
	- trashpanda-org/QwQ-32B-Snowdrop-v0
	library_name: transformers
	base_model_relation: quantized

	---

	EXL2 Quants by FrenzyBiscuit.

	This model is 4.0 BPW EXL2.