metadata
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
Metrics
| PPL | arc_easy | arc_challenge | piqa | winogrande | hellaswag | mmlu |
|---|---|---|---|---|---|---|
| 0.1 | 26.56 ± 0.91 | 21.25 ± 1.20 | 52.77 ± 1.16 | 49.96 ± 1.41 | - | - |
Training method based on BitDistiller Paper
- License: mit
- Finetuned from: TinyLlama/TinyLlama_v1.1