unsloth
/

Llama-4-Maverick-17B-128E-Instruct-GGUF

Image-Text-to-Text

Model card Files Files and versions

shimmyshimmer commited on 21 days ago

Commit

8692d75

·

verified ·

1 Parent(s): bda7b9d

Update README.md

Files changed (1) hide show

README.md +6 -6

README.md CHANGED Viewed

@@ -121,12 +121,12 @@ license_name: llama4
 |MoE Bits|Type|Disk Size|HF Link|Accuracy|
 |:-|:-|:-|:-|:-|
-|1.78bit|IQ1\_S|**110GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_S)|Ok|
-|1.93bit|IQ1\_M|**120GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_M)|Fair|
-|2.42-bit|IQ2\_XXS|**160B**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ2_XXS)|Better|
-|2.71-bit|Q2\_K\_XL|**190B**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q2_K_XL)|Suggested|
-|3.5-bit|Q3\_K\_XL|**240GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q3_K_XL)|Great|
-|4.5-bit|Q4\_K\_XL|**300GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q4_K_XL)|Best|
 **Chat template/prompt format:**
 ```

 |MoE Bits|Type|Disk Size|HF Link|Accuracy|
 |:-|:-|:-|:-|:-|
+|1.78bit|IQ1\_S|**122GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_S)|Ok|
+|1.93bit|IQ1\_M|**128GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_M)|Fair|
+|2.42-bit|IQ2\_XXS|**140GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ2_XXS)|Better|
+|2.71-bit|Q2\_K\_XL|**151B**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q2_K_XL)|Suggested|
+|3.5-bit|Q3\_K\_XL|**193GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q3_K_XL)|Great|
+|4.5-bit|Q4\_K\_XL|**243GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q4_K_XL)|Best|
 **Chat template/prompt format:**
 ```