Quantizations of https://huggingface.co/Sao10K/Fimbulvetr-11B-v2
From original readme
Prompt Formats - Alpaca or Vicuna. Either one works fine. Recommended SillyTavern Presets - Universal Light
Alpaca:
### Instruction:
<Prompt>
### Input:
<Insert Context Here>
### Response:
Vicuna:
System: <Prompt>
User: <Input>
Assistant:
- Downloads last month
- 33
Hardware compatibility
Log In
to view the estimation
1-bit
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support