BERT Explained: A Complete Guide with Theory and Tutorial

Unless you have been out of touch with the Deep Learning world, chances are that you have heard about BERT —  it has been the talk of the town for the last one year. At the end of 2018 researchers at Google AI Language open-sourced a new technique for Natural Language Processing (NLP) called BERT...

Deep Learning Series, P3: Understanding Recurrent Neural Networks

1. Why RNNs?Your smartphone predicting your next word when you are typing, Alexa understanding what you are saying or tasks like making stock market predictions, understanding movie plots, composing music, language translation and human learning: can you tell what is the common theme in this list? These are examples where sequence of information is crucial.For...

Deep Learning Series, P2: Understanding Convolutional Neural Networks

Neural Networks come in many flavors and varieties. Convolutional Neural Networks (ConvNets or CNN) are one of the most well known and important types of Neural Networks. They are mainly used in the context of Computer Vision tasks like smart tagging of your pictures, turning your old black and white family photos into colored images...

Deep Learning Series, P1: Basics of Neural Networks and Understanding Gradient Descent

This post consists of the following two sections: Section 1: Basics of Neural Networks Section 2: Understanding Backward Propagation and Gradient Descent Section 1 Introduction For decades researchers have been trying to deconstruct the inner workings of our incredible and fascinating brains, hoping to learn to infuse a brain-like intelligence into machines. For example, when...