File size: 524 Bytes
46e4d81
469b7e2
 
 
46e4d81
 
 
 
 
 
 
469b7e2
46e4d81
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
---
language:
- en
pipeline_tag: image-text-to-text
tags:
- vision
- image-text-to-text
- mlx
---

# mlx-community/llava-v1.6-34b-4bit
This model was converted to MLX format from [`llava-hf/llava-v1.6-34b-hf`]() using mlx-vlm version **0.1.0**.
Refer to the [original model card](https://huggingface.co/llava-hf/llava-v1.6-34b-hf) for more details on the model.
## Use with mlx

```bash
pip install -U mlx-vlm
```

```bash
python -m mlx_vlm.generate --model mlx-community/llava-v1.6-34b-4bit --max-tokens 100 --temp 0.0
```