GGUF Format
#19
by
kalle07
- opened
you know llama.cpp
it can convert models to GGUF useful for all peoples...
can you generate GGUF of your models ?
There may already be gguf conversion of this model on ollama.com/models under the name avr/sfr-embedding-mistral. Looking at the size, the fp16 lines up with the safetensors here.