unsloth

/

DeepSeek-R1-GGUF

like 1.06k

Follow

Unsloth AI 5.53k

Even 131G is unlikely for a regular graphics card.
Is there any plan to release a dynamic quantitative version of the distillation model?

Curious how much vRAM is needed after 70 B's distillation model is dynamically quantized