Update README.md
Browse files
README.md
CHANGED
@@ -118,7 +118,7 @@ license_name: llama4
|
|
118 |
<p style="margin-bottom: 0;">
|
119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
120 |
</p>
|
121 |
-
|
122 |
|MoE Bits|Type|Disk Size|HF Link|Accuracy|
|
123 |
|:-|:-|:-|:-|:-|
|
124 |
|1.78bit|IQ1\_S|**122GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_S)|Ok|
|
@@ -128,6 +128,8 @@ license_name: llama4
|
|
128 |
|3.5-bit|Q3\_K\_XL|**193GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q3_K_XL)|Great|
|
129 |
|4.5-bit|Q4\_K\_XL|**243GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q4_K_XL)|Best|
|
130 |
|
|
|
|
|
131 |
**Chat template/prompt format:**
|
132 |
```
|
133 |
<|header_start|>user<|header_end|>\n\nWhat is 1+1?<|eot|><|header_start|>assistant<|header_end|>\n\n
|
|
|
118 |
<p style="margin-bottom: 0;">
|
119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
120 |
</p>
|
121 |
+
|
122 |
|MoE Bits|Type|Disk Size|HF Link|Accuracy|
|
123 |
|:-|:-|:-|:-|:-|
|
124 |
|1.78bit|IQ1\_S|**122GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_S)|Ok|
|
|
|
128 |
|3.5-bit|Q3\_K\_XL|**193GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q3_K_XL)|Great|
|
129 |
|4.5-bit|Q4\_K\_XL|**243GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q4_K_XL)|Best|
|
130 |
|
131 |
+
Currently text only is supported.
|
132 |
+
|
133 |
**Chat template/prompt format:**
|
134 |
```
|
135 |
<|header_start|>user<|header_end|>\n\nWhat is 1+1?<|eot|><|header_start|>assistant<|header_end|>\n\n
|