Description
Quantified mistralai/Mistral-7B-Instruct-v0.2 into F16 and converted to LLaMa CPP (GGUF) format.
About GGUF
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Prompt template: Mistral
<s>[INST] {prompt} [/INST]
- Downloads last month
- 26
Hardware compatibility
Log In
to view the estimation
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Rocwo/Mistral-7B.F16-Instruct-v0.2-GGUF
Base model
mistralai/Mistral-7B-Instruct-v0.2