ggml-org
/

Qwen3-8B-GGUF

Model card Files Files and versions Community

Qwen3-8B

Original model: https://huggingface.co/Qwen/Qwen3-8B

Downloads last month: 122

GGUF

Model size

8.19B params

Architecture

qwen3

Hardware compatibility

Log In to view the estimation

4-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Qwen3-8B-GGUF

Base model

Qwen/Qwen3-8B-Base

Finetuned

Quantized

(52)

this model

Collection including ggml-org/Qwen3-8B-GGUF

Qwen 3

8 items • Updated about 23 hours ago • 2