Update README.md
Browse files
README.md
CHANGED
@@ -40,16 +40,15 @@ python3 run_cmrc.py --pretrained_model_path models/cluecorpussmall_roberta_base_
|
|
40 |
--train_path extractive_qa.json \
|
41 |
--dev_path datasets/cmrc2018/dev.json \
|
42 |
--output_model_path models/extractive_qa_model.bin \
|
43 |
-
--learning_rate 3e-5 --
|
44 |
-
--embedding word_pos_seg --encoder transformer --mask fully_visible
|
45 |
```
|
46 |
|
47 |
Finally, we convert the fine-tuned model into Huggingface's format:
|
48 |
|
49 |
```
|
50 |
python3 scripts/convert_bert_extractive_qa_from_uer_to_huggingface.py --input_model_path extractive_qa_model.bin \
|
51 |
-
|
52 |
-
|
53 |
```
|
54 |
|
55 |
### BibTeX entry and citation info
|
|
|
40 |
--train_path extractive_qa.json \
|
41 |
--dev_path datasets/cmrc2018/dev.json \
|
42 |
--output_model_path models/extractive_qa_model.bin \
|
43 |
+
--learning_rate 3e-5 --epochs_num 3 --batch_size 32 --seq_length 512
|
|
|
44 |
```
|
45 |
|
46 |
Finally, we convert the fine-tuned model into Huggingface's format:
|
47 |
|
48 |
```
|
49 |
python3 scripts/convert_bert_extractive_qa_from_uer_to_huggingface.py --input_model_path extractive_qa_model.bin \
|
50 |
+
--output_model_path pytorch_model.bin \
|
51 |
+
--layers_num 12
|
52 |
```
|
53 |
|
54 |
### BibTeX entry and citation info
|