This is the 8bit BitsAndBytes quantized version of the https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct

Downloads last month
47
Safetensors
Model size
73.4B params
Tensor type
F32
BF16
I8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Maverick17/Qwen2.5-VL-72B-Instruct-bnb-8bit

Unable to build the model tree, the base model loops to the model itself. Learn more.