NLP DATA wrangling previous cont.

we have lemmatized the word but you may have asked isn’t that difficult working with such cases where you yourself have to set the tag.

if you thought same you are in right place otherwise try reasoning and start assking why to sharpen our mind throw your phone from your hand its a waste.

9>> Rise of solution

The sentence needs to be converted into POS(parts of speech tags)

Code

nltk.pos_tags(tokens)

[(‘The’, ‘DT’), (‘brown’, ‘’JJ)] DT is like derivative, JJ adjective

This tags needs to be converted into Wordnet POS tags

10 > WordNEt

wordnet

map accordingly and use now lemmatization

11 Stop words Removal

example I me we you our

With this you have cleaned your data for more info check other stories.

I have attached a colab file for you reference that includes stemming, lemattizing and removal of stop words.

https://colab.research.google.com/drive/1gx5xy1fTZYs1YSybKfwoUVmRBUf--3yp#scrollTo=IZxnwuqrVIZx

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store