| base_model: TinyLlama/TinyLlama_v1.1 | |
| language: en | |
| license: mit | |
| ## Metrics | |
| |PPL| arc_easy |arc_challenge| piqa | winogrande |hellaswag|mmlu| | |
| |--:|------------|-------------|------------|------------|---------|----| | |
| |0.1|26.56 ± 0.91|21.25 ± 1.20 |52.77 ± 1.16|49.96 ± 1.41|- |- | | |
| Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631) | |
| - **License:** mit | |
| - **Finetuned from:** TinyLlama/TinyLlama_v1.1 |