This model trains T5-V1_1-base on the Qazaq dataset of Oscar. Note that the original configuration is slightly change (dropout is set to 0).

The official run_t5_mlm_flax.py is copied into the repository and is run using the hyperparameters as defined in run_t5.sh.

Downloads last month
8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train Kyrmasch/normal-model