unsloth
/

DeepSeek-V3-0324-GGUF-UD

Text Generation

Model card Files Files and versions

shimmyshimmer commited on 5 days ago

Commit

f21f609

·

verified ·

1 Parent(s): af5bdda

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -36,7 +36,7 @@ tags:
 Our DeepSeek-V3-0324 GGUFs allow you to run the model in llama.cpp, LMStudio, Open WebUI and other inference frameworks.
-Includes 1-4-bit Dynamic versions, which yields better accuracy and results than standard quantization.
 | **MoE Bits**       | **Type**   | **Disk Size** | **Link**                                                                                                                                     | **Details**                                 |
 |--------------------|------------|----------------|----------------------------------------------------------------------------------------------------------------------------------------------|---------------------------------------------|

 Our DeepSeek-V3-0324 GGUFs allow you to run the model in llama.cpp, LMStudio, Open WebUI and other inference frameworks.
+Includes 1-4-bit Dynamic v2.0 versions:
 | **MoE Bits**       | **Type**   | **Disk Size** | **Link**                                                                                                                                     | **Details**                                 |
 |--------------------|------------|----------------|----------------------------------------------------------------------------------------------------------------------------------------------|---------------------------------------------|