Update README.md
Browse files
README.md
CHANGED
@@ -70,7 +70,7 @@ print(processor.decode(output[0][2:], skip_special_tokens=True))
|
|
70 |
|
71 |
### Using `vllm` to accelerate inference:
|
72 |
You can also use the vllm to accelerate model inference. We test the checkpoints in this repo with `vllm==0.8.2`.
|
73 |
-
|
74 |
```python
|
75 |
from vllm import LLM
|
76 |
|
|
|
70 |
|
71 |
### Using `vllm` to accelerate inference:
|
72 |
You can also use the vllm to accelerate model inference. We test the checkpoints in this repo with `vllm==0.8.2`.
|
73 |
+
The official script from the vllm project for VLM inference:
|
74 |
```python
|
75 |
from vllm import LLM
|
76 |
|