|
|
--- |
|
|
library_name: transformers |
|
|
tags: [] |
|
|
--- |
|
|
|
|
|
# Kirundi-English MT5 Translator with LoRA |
|
|
|
|
|
This is a LoRA-fine-tuned version of mT5-small for Kirundi-English translation. |
|
|
|
|
|
## Model Details |
|
|
- Base Model: google/mt5-small |
|
|
- LoRA rank: 8 |
|
|
- LoRA alpha: 32 |
|
|
- Target modules: q, v |
|
|
- Training Data: {len(tokenized_dataset["train"])} examples |
|
|
- Validation Data: {len(tokenized_dataset["test"])} examples |
|
|
|
|
|
## Training Parameters |
|
|
- Learning Rate: 2e-5 |
|
|
- Batch Size: 8 |
|
|
- Epochs: 3 |
|
|
- Weight Decay: 0.01 |
|
|
|
|
|
## Current Metrics |
|
|
- BLEU Score: 0.000054 |
|
|
|
