Skip to content

Commit

Permalink
update English readme
Browse files Browse the repository at this point in the history
  • Loading branch information
ymcui committed Jun 21, 2019
1 parent e4f6931 commit ded9192
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README_EN.md
Original file line number Diff line number Diff line change
Expand Up @@ -137,7 +137,7 @@ A: We use the simplist models in the downstream tasks. For example, in the class
A: Congratulations!

**Q: How long did it take to train such a model?** </br>
A: The training was done on Google Cloud TPU v3 with 128HBM, and it roughly takes 1.5 days. Note that, in the pre-training stage, we use `LAMB Optimizer`[TensorFlow Implementation](https://github.com/ymcui/LAMB_Optimizer_TF) which is optimized for the larger batch. In fine-tuning downstream task, we use normal `AdamWeightDecayOptimizer` as default.
A: The training was done on Google Cloud TPU v3 with 128HBM, and it roughly takes 1.5 days. Note that, in the pre-training stage, we use [`LAMB Optimizer`](https://github.com/ymcui/LAMB_Optimizer_TF) which is optimized for the larger batch. In fine-tuning downstream task, we use normal `AdamWeightDecayOptimizer` as default.

**Q: Who is ERNIE?** </br>
A: The [ERNIE](https://github.com/PaddlePaddle/LARK/tree/develop/ERNIE) in this repository refer to the model released by Baidu, but not the one that published by Tsinghua University which was also called [ERNIE](https://github.com/thunlp/ERNIE).
Expand Down

0 comments on commit ded9192

Please sign in to comment.