bert_experimental

Contains code and supplementary materials for a series of Medium articles about the BERT model.

pretraining: https://towardsdatascience.com/pre-training-bert-from-scratch-with-cloud-tpu-6e2f71028379

feature_extraction: https://medium.com/@gaphex/building-a-search-engine-with-bert-and-tensorflow-c6fdc0186c8a

finetuning: https://medium.com/@gaphex/fine-tuning-bert-with-keras-and-tf-module-ed24ea91cff2

representation: https://towardsdatascience.com/improving-sentence-embeddings-with-bert-and-representation-learning-dfba6b444f6b