Create README.md

README.md

@@ -0,0 +1 @@
+Here is represented tinybert model for German language. The model was created by destilling of bert base model in the way described in https://arxiv.org/abs/1909.10351 (TinyBERT: Distilling BERT for Natural Language Understanding)