Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Qwen
/
Qwen2-VL-72B-Instruct-GPTQ-Int4
like
28
Follow
Qwen
29k
Image-Text-to-Text
Safetensors
English
qwen2_vl
multimodal
conversational
4-bit precision
gptq
arxiv:
2409.12191
arxiv:
2308.12966
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
1
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
Any one can use VLLM or any other engine support dynamic batch to run this with more than 1 GPU?
1
#1 opened 7 months ago by
bash99