Name		Name	Last commit message	Last commit date
parent directory ..
embedding_similarity		embedding_similarity
layer_normalization		layer_normalization
layers		layers
multi_head_attention		multi_head_attention
pointwise_feedforward		pointwise_feedforward
position_embedding		position_embedding
self_attention		self_attention
transformer		transformer
README.md		README.md
__init__.py		__init__.py
architecture.png		architecture.png
bert.py		bert.py
loader.py		loader.py
main.py		main.py
tokenizer.py		tokenizer.py

README.md

BERT

TensorFlow 2.0 implementation of Google's BERT (Bidirectional Transformer) language model.

Acknowledgement

Based on CyberZHG's Keras BERT implementation.