Chris McCormick    About    Tutorials    Archive

BERT Word Embeddings Tutorial

In this post, I take an in-depth look at word embeddings produced by Google’s BERT and show you how to get started with BERT by producing your own word embeddings.

The Inner Workings of word2vec

I’m proud to announce that I’ve published my first eBook, The Inner Workings of word2vec. It includes all of the material in the popular word2vec tutorial on my blog, and goes deeper with additional topics like CBOW and Hierarchical Softmax. I’ve also created example code to go along with the book that exposes the algorithm details and let’s you see them in action.