InternVL3-2B-4bit / README.md
prince-canuma's picture
Upload folder using huggingface_hub
e474b39 verified
metadata
license: other
license_name: qwen
license_link: https://huggingface.co/Qwen/Qwen2.5-72B-Instruct/blob/main/LICENSE
pipeline_tag: image-text-to-text
library_name: transformers
base_model:
  - OpenGVLab/InternViT-300M-448px-V2_5
  - Qwen/Qwen2.5-0.5B
base_model_relation: merge
datasets:
  - OpenGVLab/MMPR-v1.2
language:
  - multilingual
tags:
  - internvl
  - custom_code
  - mlx

mlx-community/InternVL3-2B-4bit

This model was converted to MLX format from InternVL3-2B using mlx-vlm version 0.1.22. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/InternVL3-2B-4bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>