Which model is google/siglip-so400m-patch14-384

#3
by YoloBird - opened

Since my server couldn't connect to the huggingface website, I manually downloaded the google/siglip-so400m-patch14-384 model and replaced the "mm_vision_tower" field in config.json with the local address, but there seemed to be some errors

Loading vision tower: /root/autodl-tmp/google/siglip-so400m-patch14-384
You are using a model of type siglip to instantiate a model of type clip_vision_model. This is not supported for all configurations of models and can yield errors.

Could you please let me know what code you are using? We are indeed using the google/siglip-so400m-patch14-384 model. If you are using the model_embed.py script, it might be due to an issue with the code I previously uploaded for loading the model. This issue has now been fixed. Please pull the latest version of the code and try again.

I hope this helps!

zhibinlan changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment