Hugging Face's logo

Gapeleon
/
Mistral-Small-3.1-24B-Instruct-2503-int4-awq-ov

Text Generation
Transformers
OpenVINO
mistral
conversational
Model card Files Community
Mistral-Small-3.1-24B-Instruct-2503-int4-awq-ov / README.md
Gapeleon's picture
Gapeleon
Create README.md
8b47ac0 verified
preview code
|
raw
history blame contribute delete
270 Bytes
metadata
base_model:
  - mistralai/Mistral-Small-3.1-24B-Instruct-2503
library_name: transformers

OpenVINO quant of mistralai/Mistral-Small-3.1-24B-Instruct-2503

Requires 16GB VRAM eg. Intel Arc A770