Quantized 4bit MLX text-only version

NOTE: This is a text-only version of the official https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503 converted to HF format by https://huggingface.co/anthracite-core/Mistral-Small-3.1-24B-Instruct-2503-HF

Downloads last month
291
Safetensors
Model size
3.68B params
Tensor type
FP16
·
U32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-4bit