graelo
/

DeepSeek-R1-Distill-Qwen-32B-AWQ

4-bit precision

Model card Files Files and versions

Quantized from deepseek-ai/DeepSeek-R1-Distill-Qwen-32B down to 4 bits, GEMM.

Downloads last month: 16

Safetensors

Model size

5.73B params

Tensor type

I32

·

BF16

·

FP16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for graelo/DeepSeek-R1-Distill-Qwen-32B-AWQ

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Quantized

(128)

this model