---
license: apache-2.0
base_model:
- google/umt5-xxl
- Able2/umt5-xxl-encode-only
---
umt5-xxl gguf model with encoder only, mainly used as text encoder for image or video generation models. Use with llama.cpp. Used in [HighDoping/Wan2.1](https://github.com/HighDoping/Wan2.1).

Example command:
```bash
llama-embedding -m umt5-xxl-encode-only-Q4_K_M.gguf -p "Penguin" --pooling none --embd-normalize -1 --no-warmup --batch-size 512 --ctx-size 512 --embd-output-format array
```