File size: 458 Bytes
19a6b71 6a72c1f 19a6b71 bf33a2c 19a6b71 6a72c1f 19a6b71 6a72c1f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---
## Metrics
|PPL| arc_easy |arc_challenge| piqa | winogrande |hellaswag|mmlu|
|--:|------------|-------------|------------|------------|---------|----|
|0.1|26.56 ± 0.91|21.25 ± 1.20 |52.77 ± 1.16|49.96 ± 1.41|- |- |
Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)
- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1 |