Difference from Qwen

by hbbOooO - opened Feb 22

Feb 22

I meet ValueError: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size. BUG when deploying Qwen/Qwen2.5-VL-72B-Instruct-AWQ with vLLM.

This ISSUE show the model you provided can solve this problem.

Thank you for providing the model and helping me successfully solve the problem. I would like to know the differences between your model and the Qwen/Qwen2.5-VL-72B-Instruct-AWQ model?

yoonseob

Feb 25

me too

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment