Vision not working on ollama - Tried updating templates
#2
by
usamakenway
- opened
Model doesnt understand the image on ollama . Tried original template and some other too.
If it works for someone else, lemme know.
did you add the mmproj file?
adding the mmproj as second FROMor downloading HF via eg. ollama run hf.co/unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF:Q4_K_XLleads to this:
clip_init: failed to load model '/home/user/.ollama/models/blobs/sha256-ca4d5ba2c7659021bf457abb2a3f346e9b83169655ab7ccd570b53dbe692abb2': load_hparams: unknown projector type: pixtral
We just updated the models to now support vision thanks to the latest PR in llama.cpp