Qwen3-0.6B-AWQ

zero_piont: true
bits: 4
version: GEMM
dataset: wikitext + Orion-zhen/gsm8k-r1-qwen-32b
num_examples: 256

The very first Qwen3-0.6B-AWQ on HuggingFace. I'm not sure if you really need a quantization of such a small model.

Safetensors

Model size

215M params

Tensor type

I32

BF16

FP16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Orion-zhen/Qwen3-0.6B-AWQ

Base model

Finetuned

Quantized

(45)

this model