nm-testing
/

pixtral-12b-FP8-dynamic

Image-Text-to-Text

compressed-tensors

Model card Files Files and versions Community

mgoin commited on 24 days ago

Commit

6627e5c

·

verified ·

1 Parent(s): 7dca866

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -226,7 +226,7 @@
     "head_dim": 128,
     "intermediate_size": 14336,
     "is_composition": true,
-    "max_position_embeddings": 1024000,
     "model_type": "mistral",
     "num_hidden_layers": 40,
     "num_key_value_heads": 8,

     "head_dim": 128,
     "intermediate_size": 14336,
     "is_composition": true,
+    "max_position_embeddings": 131072,
     "model_type": "mistral",
     "num_hidden_layers": 40,
     "num_key_value_heads": 8,