NLP guide towards neural networks

Beginning the journey. This is just intro to refresh. Intended for beginners.

** Statistical Language models

differences source:scalr.ai

* * Neural Language models (NLM)

Size matters. The best models were the largest models, specifically number of memory units.Regularization matters. Use of regularization like dropout on input connections improves results.CNN vs Embedding. Character-level Convolutional Neural Network (CNN) models can be used on the front-end instead of word embedding, achieving similar and sometimes better results.Ensembles matter. Combining the prediction from multiple models can offer large improvements in model performance. 

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store