Hugging Face's logo

ggml-org
/
Qwen3-4B-GGUF

GGUF
conversational
Model card Files Community

Qwen3-4B

Original model: https://huggingface.co/Qwen/Qwen3-4B

Downloads last month
141
GGUF
Model size
4.02B params
Architecture
qwen3
Hardware compatibility
Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Qwen3-4B-GGUF

Base model

Qwen/Qwen3-4B-Base
Finetuned
Qwen/Qwen3-4B
Quantized
(45)
this model

Collection including ggml-org/Qwen3-4B-GGUF