---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---

## Metrics

|PPL|  arc_easy  |arc_challenge|    piqa    | winogrande |hellaswag|mmlu|
|--:|------------|-------------|------------|------------|---------|----|
|0.1|26.56 ± 0.91|21.25 ± 1.20 |52.77 ± 1.16|49.96 ± 1.41|-        |-   |


Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)

- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1