Midnight-Rose-70B-v2.0.3
ExLlamav2 3.85 bpw quants of https://huggingface.co/sophosympatheia/Midnight-Rose-70B-v2.0.3
- Downloads last month
- 8
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model authors have turned it off explicitly.
Model tree for altomek/Midnight-Rose-70B-v2.0.3-3.85bpw-EXL2
Base model
sophosympatheia/Midnight-Rose-70B-v2.0.3Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard70.650
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard87.500
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard69.640
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard65.270
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard81.220
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard28.350