Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,17 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q5_K_M/QVQ-72B-Preview-Q5_K_M-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q5_K_M/QVQ-72B-Preview-Q5_K_M-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q6_K/QVQ-72B-Preview-Q6_K-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q6_K/QVQ-72B-Preview-Q6_K-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q8_0/QVQ-72B-Preview-Q8_0-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q8_0/QVQ-72B-Preview-Q8_0-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
+QVQ-72B-Preview-Q8_0/QVQ-72B-Preview-Q8_0-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text

QVQ-72B-Preview-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e5e585bb44f8291c105e1e6ee5cfc49b8e79d5b7a7ada1b7d3301f291d14d8f8
+size 29811761248

QVQ-72B-Preview-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c3cbb27cc3fa40a273f3eb73f2fc79d708a72d70bb52f8a2101cb275988a8bb
+size 39505223776

QVQ-72B-Preview-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a2f6e06a8eab6684adcdb57160066eb4cb6b403ac7d1c689914ef20456ff8a05
+size 37698723936

QVQ-72B-Preview-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1bc7baeac7efff34d81a759486e61a22a73d5c165380010002ab635a111298da
+size 34487787616

QVQ-72B-Preview-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c0bdeba15b3996a4aa147be8315efb402477f113cf5d50f9064bf561602d016
+size 41231736928

QVQ-72B-Preview-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f4c63df02622bd0f33f1b78d775e24be572e475790ea77d3fc5c4706ab15525
+size 47415713888

QVQ-72B-Preview-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ffe05feff7e8bd6579b9496e9c877c272bf8a923a6a480700d4462503ca49bed
+size 43889221728

QVQ-72B-Preview-Q5_K_M/QVQ-72B-Preview-Q5_K_M-00001-of-00002.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:91cd66fc7dab814d8c1a899e1f293afdf7b339ce38f8676b185b1de7094d442f
+size 34868195872

QVQ-72B-Preview-Q5_K_M/QVQ-72B-Preview-Q5_K_M-00002-of-00002.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f349beb171a63008a1398d8f95991e392cce75955bf2c5f7de79876ad0613d0d
+size 19579268896

QVQ-72B-Preview-Q6_K/QVQ-72B-Preview-Q6_K-00001-of-00002.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d2efd2fd1bc713c51e08df58a1bda567d89486997381d83cc3c0ea3e63cef92
+size 34880052320

QVQ-72B-Preview-Q6_K/QVQ-72B-Preview-Q6_K-00002-of-00002.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47355ca94fbd3a8d82c8bfdf2cef472bda96616583dd293f1a5cc8a3f3f0da60
+size 29467575520

QVQ-72B-Preview-Q8_0/QVQ-72B-Preview-Q8_0-00001-of-00003.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62daf5e2e1ec23e389bc5b77abb8e82130e79d2b258e21b86afcaa2be68e0f0e
+size 34780006176

QVQ-72B-Preview-Q8_0/QVQ-72B-Preview-Q8_0-00002-of-00003.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1a4df0e4d46fe96f3d11f902aaa6121894024eddf976daced1be064e4ca5052
+size 34764293216

QVQ-72B-Preview-Q8_0/QVQ-72B-Preview-Q8_0-00003-of-00003.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:46737703735737df34ef5a99b9cdbc2db02e087c5ea77ec119905cb73b64b4b1
+size 7718311488

README.md

@@ -0,0 +1,135 @@
+---
+license: other
+license_name: qwen
+license_link: https://huggingface.co/Qwen/QVQ-72B-Preview/blob/main/LICENSE
+language:
+- en
+pipeline_tag: image-text-to-text
+base_model: Qwen/QVQ-72B-Preview
+tags:
+- chat
+- TensorBlock
+- GGUF
+library_name: transformers
+---
+
+
+# QVQ-72B-Preview
+
+## Introduction
+
+**QVQ-72B-Preview** is an experimental research model developed by the Qwen team, focusing on enhancing visual reasoning capabilities.
+
+## Performance
+
+|                | **QVQ-72B-Preview** | o1-2024-12-17 | gpt-4o-2024-05-13 | Claude3.5 Sonnet-20241022 | Qwen2VL-72B |
+|----------------|-----------------|---------------|-------------------|----------------------------|-------------|
+| MMMU(val)      | 70.3            | 77.3          | 69.1              | 70.4                       | 64.5        |
+| MathVista(mini) | 71.4            | 71.0          | 63.8              | 65.3                       | 70.5        |
+| MathVision(full)   | 35.9            | –             | 30.4              | 35.6                       | 25.9        |
+| OlympiadBench  | 20.4            | –             | 25.9              | –                          | 11.2        |
+
+
+**QVQ-72B-Preview** has achieved remarkable performance on various benchmarks. It scored a remarkable 70.3% on the Multimodal Massive Multi-task Understanding (MMMU) benchmark, showcasing QVQ's powerful ability in multidisciplinary understanding and reasoning. Furthermore, the significant improvements on MathVision highlight the model's progress in mathematical reasoning tasks. OlympiadBench also demonstrates the model's enhanced ability to tackle challenging problems.
+
+***But It's Not All Perfect:  Acknowledging the Limitations***
+
+While **QVQ-72B-Preview** exhibits promising performance that surpasses expectations, it’s important to acknowledge several limitations:
+
+1. **Language Mixing and Code-Switching:** The model might occasionally mix different languages or unexpectedly switch between them, potentially affecting the clarity of its responses.
+2. **Recursive Reasoning Loops:**  There's a risk of the model getting caught in recursive reasoning loops, leading to lengthy responses that may not even arrive at a final answer.
+3. **Safety and Ethical Considerations:** Robust safety measures are needed to ensure reliable and safe performance. Users should exercise caution when deploying this model.
+4. **Performance and Benchmark Limitations:** Despite the improvements in visual reasoning, QVQ doesn’t entirely replace the capabilities of Qwen2-VL-72B. During multi-step visual reasoning, the model might gradually lose focus on the image content, leading to hallucinations. Moreover, QVQ doesn’t show significant improvement over Qwen2-VL-72B in basic recognition tasks like identifying people, animals, or plants.
+
+Note: Currently, the model only supports single-round dialogues and image outputs. It does not support video inputs.
+## Quickstart
+
+We offer a toolkit to help you handle various types of visual input more conveniently. This includes base64, URLs, and interleaved images and videos. You can install it using the following command:
+
+```bash
+pip install qwen-vl-utils
+```
+
+Here we show a code snippet to show you how to use the chat model with `transformers` and `qwen_vl_utils`:
+
+```python
+from transformers import Qwen2VLForConditionalGeneration, AutoTokenizer, AutoProcessor
+from qwen_vl_utils import process_vision_info
+
+# default: Load the model on the available device(s)
+model = Qwen2VLForConditionalGeneration.from_pretrained(
+    "Qwen/QVQ-72B-Preview", torch_dtype="auto", device_map="auto"
+)
+
+# default processer
+processor = AutoProcessor.from_pretrained("Qwen/QVQ-72B-Preview")
+
+# The default range for the number of visual tokens per image in the model is 4-16384. You can set min_pixels and max_pixels according to your needs, such as a token count range of 256-1280, to balance speed and memory usage.
+# min_pixels = 256*28*28
+# max_pixels = 1280*28*28
+# processor = AutoProcessor.from_pretrained("Qwen/QVQ-72B-Preview", min_pixels=min_pixels, max_pixels=max_pixels)
+
+messages = [
+    {
+        "role": "system",
+        "content": [
+            {"type": "text", "text": "You are a helpful and harmless assistant. You are Qwen developed by Alibaba. You should think step-by-step."}
+        ],
+    },
+    {
+        "role": "user",
+        "content": [
+            {
+                "type": "image",
+                "image": "https://qianwen-res.oss-cn-beijing.aliyuncs.com/QVQ/demo.png",
+            },
+            {"type": "text", "text": "What value should be filled in the blank space?"},
+        ],
+    }
+]
+
+# Preparation for inference
+text = processor.apply_chat_template(
+    messages, tokenize=False, add_generation_prompt=True
+)
+image_inputs, video_inputs = process_vision_info(messages)
+inputs = processor(
+    text=[text],
+    images=image_inputs,
+    videos=video_inputs,
+    padding=True,
+    return_tensors="pt",
+)
+inputs = inputs.to("cuda")
+
+# Inference: Generation of the output
+generated_ids = model.generate(**inputs, max_new_tokens=8192)
+generated_ids_trimmed = [
+    out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
+]
+output_text = processor.batch_decode(
+    generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
+)
+print(output_text)
+```
+
+## Citation
+
+If you find our work helpful, feel free to give us a cite.
+
+```
+@misc{qvq-72b-preview,
+    title = {QVQ: To See the World with Wisdom},
+    url = {https://qwenlm.github.io/blog/qvq-72b-preview/},
+    author = {Qwen Team},
+    month = {December},
+    year = {2024}
+}
+
+@article{Qwen2VL,
+  title={Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution},
+  author={Wang, Peng and Bai, Shuai and Tan, Sinan and Wang, Shijie and Fan, Zhihao and Bai, Jinze and Chen, Keqin and Liu, Xuejing and Wang, Jialin and Ge, Wenbin and Fan, Yang and Dang, Kai and Du, Mengfei and Ren, Xuancheng and Men, Rui and Liu, Dayiheng and Zhou, Chang and Zhou, Jingren and Lin, Junyang},
+  journal={arXiv preprint arXiv:2409.12191},
+  year={2024}
+}
+```