Practical Natural Language Processing
From Theory to Industrial Applications
Jaganadh G
http://jaganadhg.in
jaganadhg@gmail.com
IIIT-MK
Thiruvananthapuram
6th
April 2013
Jaganadh G Practical Natural Language Processing
About me !!
Working as Data Scientist to a Fortune 500 Company
Working in Natural Language Processing, Machine
Learning, Data Mining etc...
Passionate about Free and Open source :-)
When gets free time teaches Python, Speaks about FOSS
and blogs at
http://jaganadhg.in
I am a computational linguist / Linguist and Indologist,
Book reviewer
Software Engineer by Profession
Jaganadh G Practical Natural Language Processing
Past to Future
Jaganadh G Practical Natural Language Processing
Question ??
Have you ever used any Natural Language Processing based
tools/services?
Jaganadh G Practical Natural Language Processing
Question ??
Have you ever used any Natural Language Processing based
tools/services?
Jaganadh G Practical Natural Language Processing
Question ??
Have you ever used any Natural Language Processing based
tools/services?
Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ?
Aim : To build intelligent systems that can interact with
human beings as like human beings
Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ?
Aim : To build intelligent systems that can interact with
human beings as like human beings
Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ?
Aim : To build intelligent systems that can interact with
human beings as like human beings
A sub-field of Artificial Intelligence (AI)
Jaganadh G Practical Natural Language Processing
What is Natural Language Processing (NLP) ?
Aim : To build intelligent systems that can interact with
human beings as like human beings
A sub-field of Artificial Intelligence (AI)
Inter-disciplinary subject (Language + Linguistics +
Statistics + Computer Science + .. )
Natural Language
Refers to the language spoken by people, e.g.
English,Japanese, Tamil, Malayalam as opposed to artificial
languages, like C++, Java, etc.
Jaganadh G Practical Natural Language Processing
Definition
Natural Language Processing
Natural Language Processing is a theoretically motivated range
of computational techniques for analyzing and representing
naturally occurring texts/speech at one or more levels of
linguistic analysis for the purpose of achieving human-like
language processing for a range of tasks or applications.
NLP was considered as an academic discipline before
some 10 to 20 years.
Now concepts from NLP is applied in variety of
Computing Platforms and Services
Jaganadh G Practical Natural Language Processing
Practical NLP ?
Problem
Picture Courtesy: http://twitpic.com/1y21qm/full
Jaganadh G Practical Natural Language Processing
Practical NLP ?
Problem
Before going to some theory can we have some funny
practical problems to solve ?
Picture Courtesy: http://twitpic.com/1y21qm/full
Jaganadh G Practical Natural Language Processing
Practical NLP ?
Problem
Before going to some theory can we have some funny
practical problems to solve ?
Picture Courtesy: http://twitpic.com/1y21qm/full
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Tweets related to enquirers
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Tweets related to enquirers
They requires following things to be automated
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Tweets related to enquirers
They requires following things to be automated
Identify tweet category
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Tweets related to enquirers
They requires following things to be automated
Identify tweet category
Process home-delivery request
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Tweets related to enquirers
They requires following things to be automated
Identify tweet category
Process home-delivery request
Evaluate quality related tweets
Jaganadh G Practical Natural Language Processing
Practical NLP
Problem
Tweet-a-Toddy receives thousands of tweets per day
Tweets requesting home delivery
Tweets about quality of products
Tweets related to enquirers
They requires following things to be automated
Identify tweet category
Process home-delivery request
Evaluate quality related tweets
How?
How to find a solution for Tweet-a-Toddy
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Text Classification
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Text Classification
Entity Identification
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Text Classification
Entity Identification
Information Extraction
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Text Classification
Entity Identification
Information Extraction
Sentiment Analysis
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Text Classification
Entity Identification
Information Extraction
Sentiment Analysis
Parsing, gammer ...
Jaganadh G Practical Natural Language Processing
Solution
??
Any Solutions
Some thoughts
Text Classification
Entity Identification
Information Extraction
Sentiment Analysis
Parsing, gammer ...
Regex (Regular Expressions)
Jaganadh G Practical Natural Language Processing
Another Practical Question
Everybody might have used spell checker available in word
processing systems like OpenOffice.org or Microsoft Word Any
guess on how to develop a spell checker system ?
Solutions
Jaganadh G Practical Natural Language Processing
Another Practical Question
Everybody might have used spell checker available in word
processing systems like OpenOffice.org or Microsoft Word Any
guess on how to develop a spell checker system ?
Solutions
Word List
Jaganadh G Practical Natural Language Processing
Another Practical Question
Everybody might have used spell checker available in word
processing systems like OpenOffice.org or Microsoft Word Any
guess on how to develop a spell checker system ?
Solutions
Word List
Structure of words
Jaganadh G Practical Natural Language Processing
Another Practical Question
Everybody might have used spell checker available in word
processing systems like OpenOffice.org or Microsoft Word Any
guess on how to develop a spell checker system ?
Solutions
Word List
Structure of words
Dynamic Programming (Edit Distance)
Jaganadh G Practical Natural Language Processing
Another Practical Question ...
Context Sensitive Spell-checking
Identifying and suggesting spelling of words based on context
How ??
Jaganadh G Practical Natural Language Processing
Another Practical Question ...
Context Sensitive Spell-checking
Identifying and suggesting spelling of words based on context
How ??
Solutions
Jaganadh G Practical Natural Language Processing
Another Practical Question ...
Context Sensitive Spell-checking
Identifying and suggesting spelling of words based on context
How ??
Solutions
Statistical Models
Jaganadh G Practical Natural Language Processing
Another Practical Question ...
Context Sensitive Spell-checking
Identifying and suggesting spelling of words based on context
How ??
Solutions
Statistical Models
Word category based suggestions
Jaganadh G Practical Natural Language Processing
Can Machines Translate ??
Answer !!!
Jaganadh G Practical Natural Language Processing
Why NLP ?
Because ”Information is Power !!!”
Jaganadh G Practical Natural Language Processing
Why NLP ?
Because ”Information is Power !!!”
Picture Courtesy: http://soundsgood.in/wikipediafat print book/
Jaganadh G Practical Natural Language Processing
Why NLP ?
Because ”Information is Power !!!”
Every day wast amount of text and speech data is being
produced
Picture Courtesy: http://soundsgood.in/wikipediafat print book/
Jaganadh G Practical Natural Language Processing
Why NLP ?
Because ”Information is Power !!!”
Every day wast amount of text and speech data is being
produced
Internet == at least 40 Million pages
Picture Courtesy: http://soundsgood.in/wikipediafat print book/
Jaganadh G Practical Natural Language Processing
Why NLP ?
Because ”Information is Power !!!”
Every day wast amount of text and speech data is being
produced
Internet == at least 40 Million pages
Picture Courtesy: http://soundsgood.in/wikipediafat print book/
Jaganadh G Practical Natural Language Processing
History
Jaganadh G Practical Natural Language Processing
History
Second World War !!!
Jaganadh G Practical Natural Language Processing
History
Second World War !!!
Machine Translation
Jaganadh G Practical Natural Language Processing
History
Second World War !!!
Machine Translation
Now :
Jaganadh G Practical Natural Language Processing
History
Second World War !!!
Machine Translation
Now :
Most promising imperfect technology
Jaganadh G Practical Natural Language Processing
History
Second World War !!!
Machine Translation
Now :
Most promising imperfect technology
Moves from Lab to Industry to Layman
Jaganadh G Practical Natural Language Processing
NLP Really Hard to Achieve?
NLP delas with human languages
Human Language is dynamic and mysterious !!!
Jaganadh G Practical Natural Language Processing
NLP Really Hard to Achieve?
NLP delas with human languages
Human Language is dynamic and mysterious !!!
Communication in Human Language
Jaganadh G Practical Natural Language Processing
NLP Really Hard to Achieve?
Levels of Knowledge encoding in Language Data
Jaganadh G Practical Natural Language Processing
Tasks in NLP
Broad Areas
Jaganadh G Practical Natural Language Processing
Tasks in NLP
Broad Areas
Text Processing
Jaganadh G Practical Natural Language Processing
Tasks in NLP
Broad Areas
Text Processing
Speech Processing
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Morphological Synthesis
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Morphological Synthesis
Part of Speech Tagging
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Morphological Synthesis
Part of Speech Tagging
Stemming
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Morphological Synthesis
Part of Speech Tagging
Stemming
Lemmatization
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Morphological Synthesis
Part of Speech Tagging
Stemming
Lemmatization
Sentence Level Analysis - Syntactical Parsing
Jaganadh G Practical Natural Language Processing
Major tasks in Text Processing
Word Level Analysis
Morphological Synthesis
Part of Speech Tagging
Stemming
Lemmatization
Sentence Level Analysis - Syntactical Parsing
Discourse Analysis - Semantic Processing
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Morphological analysis can be explained as: the process of
analyzing words to identify its constituents
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Morphological analysis can be explained as: the process of
analyzing words to identify its constituents
Computational Analysis of Morphology
Morphological Analysis
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Morphological analysis can be explained as: the process of
analyzing words to identify its constituents
Computational Analysis of Morphology
Morphological Analysis
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Morphological analysis can be explained as: the process of
analyzing words to identify its constituents
Computational Analysis of Morphology
Morphological Analysis
Morphological Generation
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Morphological analysis can be explained as: the process of
analyzing words to identify its constituents
Computational Analysis of Morphology
Morphological Analysis
Morphological Generation
Stemming
Jaganadh G Practical Natural Language Processing
Morphology
The branch of linguistics that studies word structures.
To a computer program a word is : ???
Morphological analysis can be explained as: the process of
analyzing words to identify its constituents
Computational Analysis of Morphology
Morphological Analysis
Morphological Generation
Stemming
Lemmatization
Jaganadh G Practical Natural Language Processing
Practical Question from Morphology
Approximate number of word forms that can be derived from
the word
”maram”
Jaganadh G Practical Natural Language Processing
Parts of Speech Tagging
POS tagging is the process of marking up the words in a text
(corpus) as corresponding to a particular part of speech, based
on both its definition, as well as its context.
Ram goes to school.
Ram/NNP goes/VBZ to/TO school/NN ./.
Jaganadh G Practical Natural Language Processing
Parts of Speech Tagging
POS tagging is the process of marking up the words in a text
(corpus) as corresponding to a particular part of speech, based
on both its definition, as well as its context.
Ram goes to school.
Ram/NNP goes/VBZ to/TO school/NN ./.
Words are ambiguous !!!!
e.g. book, cricket, bank
Jaganadh G Practical Natural Language Processing
Syntactical Parsing
Parsing
In computer science and linguistics, parsing, or, more formally,
syntactic analysis, is the process of analyzing a text, made of a
sequence of tokens (for example, words), to determine its
grammatical structure with respect to a given (more or less)
formal grammar.
Jaganadh G Practical Natural Language Processing
Syntactical Parsing
Parsing
In computer science and linguistics, parsing, or, more formally,
syntactic analysis, is the process of analyzing a text, made of a
sequence of tokens (for example, words), to determine its
grammatical structure with respect to a given (more or less)
formal grammar.
Sentences are ambiguous !!!!
Jaganadh G Practical Natural Language Processing
Semantics
Study of meaning ans its structure
Jaganadh G Practical Natural Language Processing
Semantics
Study of meaning ans its structure
Word meaning is ambiguous !!!!
E.g. marriage
Jaganadh G Practical Natural Language Processing
Where can I apply this techniques?
Machine Translation Systems
Jaganadh G Practical Natural Language Processing
Where can I apply this techniques?
Machine Translation Systems
Search Engine
Jaganadh G Practical Natural Language Processing
Where can I apply this techniques?
Machine Translation Systems
Search Engine
Spell-checker
Jaganadh G Practical Natural Language Processing
Where can I apply this techniques?
Machine Translation Systems
Search Engine
Spell-checker
Grammar Checker
Jaganadh G Practical Natural Language Processing
Where can I apply this techniques?
Machine Translation Systems
Search Engine
Spell-checker
Grammar Checker
..........
Jaganadh G Practical Natural Language Processing
Other Interesting Tasks
Named Entity Identification
Jaganadh G Practical Natural Language Processing
Other Interesting Tasks
Named Entity Identification
Information Extraction
Jaganadh G Practical Natural Language Processing
Other Interesting Tasks
Named Entity Identification
Information Extraction
Information Retrieval
Jaganadh G Practical Natural Language Processing
Other Interesting Tasks
Named Entity Identification
Information Extraction
Information Retrieval
Text Classification and Clustering
Jaganadh G Practical Natural Language Processing
Speech Processing
Two Major Areas
Text to Speech
Speech Recognition
Jaganadh G Practical Natural Language Processing
Speech Processing
Two Major Areas
Text to Speech
Speech Recognition
Practical Applications
IVR
Technology for Visually Challenged People
Mobile Phones
Speech Enabled Web
Vehicle Mounted GPS Navigator
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Custom Search Systems
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Custom Search Systems
Information Extraction
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Custom Search Systems
Information Extraction
Entity Identification
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Custom Search Systems
Information Extraction
Entity Identification
Text Summarization
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Custom Search Systems
Information Extraction
Entity Identification
Text Summarization
Speech Systems
Jaganadh G Practical Natural Language Processing
Commerical NLP Applications
What Industry Looks
Components of Word Processors
Machine Translation Systems
Custom Search Systems
Information Extraction
Entity Identification
Text Summarization
Speech Systems
Question Answering Systems
Jaganadh G Practical Natural Language Processing
Future of NLP
Future!!!
Semantics oriented technologies
Jaganadh G Practical Natural Language Processing
NLP in other domains
Bio-Medical
Legal
Forensic Science
Advertisement
Education
Politics
E-governance
Business Development
Marketing
and where ever we use language !!!
Jaganadh G Practical Natural Language Processing
Natural Language Processing in India
Academic Institutions
IIT Kanpur, Kharagpur, Bombay
IIIT hydrabad
IISc Bangalore
AU-KBC Chennai
Amritha University Ettimadai, Coimbatore
IIITMK, Trivandrum
Central University, Hydrabad
JNU, Delhi
Tamil University, Thanjore
Jaganadh G Practical Natural Language Processing
Natural Language Processing in India
Industry
Microsoft
Yahoo!
AOL
365Media Pvt. Ltd.
Inside View
Thaazza
AIAIO Labs
Jaganadh G Practical Natural Language Processing
Questions ??
Jaganadh G Practical Natural Language Processing
References
Daniel Jurafsky,James H. Martin, SPEECH and
LANGUAGE PROCESSING, 2nd
Edition.
U.S. Tiwary, Tanveer Siddiqui , Natural Language
Processing and Information Retrieval
Jaganadh G Practical Natural Language Processing
Finally
Jaganadh G Practical Natural Language Processing
Questions ??
Jaganadh G Practical Natural Language Processing
References
Daniel Jurafsky,James H. Martin, SPEECH and
LANGUAGE PROCESSING, 2nd
Edition.
U.S. Tiwary, Tanveer Siddiqui , Natural Language
Processing and Information Retrieval
Jaganadh G Practical Natural Language Processing
Finally
Jaganadh G Practical Natural Language Processing

More Related Content

PDF
What they think about my brand/product ?!?!? An Introduction to Sentiment Ana...
PDF
Practical Natural Language Processing From Theory to Industrial Applications
PDF
Practical Natural Language Processing
PDF
Tools andTechnologies for Large Scale Data Mining
PDF
Natural Language Processing
PDF
Natural Language Processing seminar review
PPTX
Natural Language processing
PPTX
Introduction to Natural Language Processing
What they think about my brand/product ?!?!? An Introduction to Sentiment Ana...
Practical Natural Language Processing From Theory to Industrial Applications
Practical Natural Language Processing
Tools andTechnologies for Large Scale Data Mining
Natural Language Processing
Natural Language Processing seminar review
Natural Language processing
Introduction to Natural Language Processing

What's hot (7)

PDF
Cls8 decarbonet
PDF
Can Social Media Analysis Improve Collective Awareness of Climate Change?
PDF
Tools for (Almost) Real-Time Social Media Analysis
PDF
Scaling Quality on Quora Using Machine Learning
PPT
Opinion Mining Tutorial (Sentiment Analysis)
PDF
Social media analytics as a service: tools from GATE
PPT
TwitIE: An Open-Source Information Extraction Pipeline for Microblog Text
Cls8 decarbonet
Can Social Media Analysis Improve Collective Awareness of Climate Change?
Tools for (Almost) Real-Time Social Media Analysis
Scaling Quality on Quora Using Machine Learning
Opinion Mining Tutorial (Sentiment Analysis)
Social media analytics as a service: tools from GATE
TwitIE: An Open-Source Information Extraction Pipeline for Microblog Text
Ad

Similar to Practical Natural Language Processing (20)

PDF
Natural Language Processing in Artificial Intelligence - Codeup #5 - PayU
PDF
Practical Machine Learning
PDF
ChatGPT in academic settings H2.de
PPTX
1679551002natural language processing ppt
PPTX
NLP Introduction for engineering stuedents.pptx
PPTX
Foundations of Generative AI - Lesson 01 - Introduction to Generative AI.pptx
PDF
Pycon India 2018 Natural Language Processing Workshop
PDF
Natural Language Processing (NLP) Certification | IABAC
PDF
AI生成工具的新衝擊 - MS Bing & Google Bard 能否挑戰ChatGPT-4領導地位
PPT
Assistive Technology Reading and Writing Tools
PPTX
Using AI for Learning.pptx
PDF
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...
PPTX
Action on Google
PPTX
PowerPoint presentation (PPT) on the concept of Natural Language Processing (...
PDF
Role of Natural Language Processing in AI - Overview
PPTX
Ontology development in protégé-آنتولوژی در پروتوغه
PDF
SpeakGlobal: The language software company
PDF
NLP Msc Computer science S2 Kerala University
PDF
Cole Napper: Are you ready for generative AI in people analytics?
PPT
Artificial Intelligence
Natural Language Processing in Artificial Intelligence - Codeup #5 - PayU
Practical Machine Learning
ChatGPT in academic settings H2.de
1679551002natural language processing ppt
NLP Introduction for engineering stuedents.pptx
Foundations of Generative AI - Lesson 01 - Introduction to Generative AI.pptx
Pycon India 2018 Natural Language Processing Workshop
Natural Language Processing (NLP) Certification | IABAC
AI生成工具的新衝擊 - MS Bing & Google Bard 能否挑戰ChatGPT-4領導地位
Assistive Technology Reading and Writing Tools
Using AI for Learning.pptx
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...
Action on Google
PowerPoint presentation (PPT) on the concept of Natural Language Processing (...
Role of Natural Language Processing in AI - Overview
Ontology development in protégé-آنتولوژی در پروتوغه
SpeakGlobal: The language software company
NLP Msc Computer science S2 Kerala University
Cole Napper: Are you ready for generative AI in people analytics?
Artificial Intelligence
Ad

More from Jaganadh Gopinadhan (18)

PDF
Introduction to Sentiment Analysis
PDF
Elements of Text Mining Part - I
PDF
Natural Language Processing with Per
PPT
Indian Language Spellchecker Development for OpenOffice.org
PPT
Sanskrit and Computational Linguistic
PDF
Script to Sentiment : on future of Language TechnologyMysore latest
ODT
A tutorial on Machine Translation
PDF
Linguistic localization framework for Ooo
PDF
Ilucbe python v1.2
PDF
Social Media Analytics
PDF
Success Factor
PDF
ntroduction to GNU/Linux Linux Installation and Basic Commands
PDF
Let’s Learn Python An introduction to Python
PDF
Introduction to Free and Open Source Software
PDF
Opinion Mining and Sentiment Analysis Issues and Challenges
PDF
Mahout Tutorial FOSSMEET NITC
PDF
Will Foss get me a Job?
Introduction to Sentiment Analysis
Elements of Text Mining Part - I
Natural Language Processing with Per
Indian Language Spellchecker Development for OpenOffice.org
Sanskrit and Computational Linguistic
Script to Sentiment : on future of Language TechnologyMysore latest
A tutorial on Machine Translation
Linguistic localization framework for Ooo
Ilucbe python v1.2
Social Media Analytics
Success Factor
ntroduction to GNU/Linux Linux Installation and Basic Commands
Let’s Learn Python An introduction to Python
Introduction to Free and Open Source Software
Opinion Mining and Sentiment Analysis Issues and Challenges
Mahout Tutorial FOSSMEET NITC
Will Foss get me a Job?

Recently uploaded (20)

PDF
The influence of sentiment analysis in enhancing early warning system model f...
PDF
Enhancing plagiarism detection using data pre-processing and machine learning...
DOCX
Basics of Cloud Computing - Cloud Ecosystem
PPTX
Final SEM Unit 1 for mit wpu at pune .pptx
PDF
Getting started with AI Agents and Multi-Agent Systems
PPT
Module 1.ppt Iot fundamentals and Architecture
PDF
Five Habits of High-Impact Board Members
PDF
A contest of sentiment analysis: k-nearest neighbor versus neural network
PDF
A proposed approach for plagiarism detection in Myanmar Unicode text
PDF
CloudStack 4.21: First Look Webinar slides
PDF
sbt 2.0: go big (Scala Days 2025 edition)
PDF
Taming the Chaos: How to Turn Unstructured Data into Decisions
PPT
Geologic Time for studying geology for geologist
PPTX
Custom Battery Pack Design Considerations for Performance and Safety
PDF
STKI Israel Market Study 2025 version august
PDF
OpenACC and Open Hackathons Monthly Highlights July 2025
PDF
Statistics on Ai - sourced from AIPRM.pdf
PDF
Improvisation in detection of pomegranate leaf disease using transfer learni...
PDF
Consumable AI The What, Why & How for Small Teams.pdf
PPTX
Training Program for knowledge in solar cell and solar industry
The influence of sentiment analysis in enhancing early warning system model f...
Enhancing plagiarism detection using data pre-processing and machine learning...
Basics of Cloud Computing - Cloud Ecosystem
Final SEM Unit 1 for mit wpu at pune .pptx
Getting started with AI Agents and Multi-Agent Systems
Module 1.ppt Iot fundamentals and Architecture
Five Habits of High-Impact Board Members
A contest of sentiment analysis: k-nearest neighbor versus neural network
A proposed approach for plagiarism detection in Myanmar Unicode text
CloudStack 4.21: First Look Webinar slides
sbt 2.0: go big (Scala Days 2025 edition)
Taming the Chaos: How to Turn Unstructured Data into Decisions
Geologic Time for studying geology for geologist
Custom Battery Pack Design Considerations for Performance and Safety
STKI Israel Market Study 2025 version august
OpenACC and Open Hackathons Monthly Highlights July 2025
Statistics on Ai - sourced from AIPRM.pdf
Improvisation in detection of pomegranate leaf disease using transfer learni...
Consumable AI The What, Why & How for Small Teams.pdf
Training Program for knowledge in solar cell and solar industry

Practical Natural Language Processing

  • 1. Practical Natural Language Processing From Theory to Industrial Applications Jaganadh G http://jaganadhg.in [email protected] IIIT-MK Thiruvananthapuram 6th April 2013 Jaganadh G Practical Natural Language Processing
  • 2. About me !! Working as Data Scientist to a Fortune 500 Company Working in Natural Language Processing, Machine Learning, Data Mining etc... Passionate about Free and Open source :-) When gets free time teaches Python, Speaks about FOSS and blogs at http://jaganadhg.in I am a computational linguist / Linguist and Indologist, Book reviewer Software Engineer by Profession Jaganadh G Practical Natural Language Processing
  • 3. Past to Future Jaganadh G Practical Natural Language Processing
  • 4. Question ?? Have you ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
  • 5. Question ?? Have you ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
  • 6. Question ?? Have you ever used any Natural Language Processing based tools/services? Jaganadh G Practical Natural Language Processing
  • 7. What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings Jaganadh G Practical Natural Language Processing
  • 8. What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings Jaganadh G Practical Natural Language Processing
  • 9. What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings A sub-field of Artificial Intelligence (AI) Jaganadh G Practical Natural Language Processing
  • 10. What is Natural Language Processing (NLP) ? Aim : To build intelligent systems that can interact with human beings as like human beings A sub-field of Artificial Intelligence (AI) Inter-disciplinary subject (Language + Linguistics + Statistics + Computer Science + .. ) Natural Language Refers to the language spoken by people, e.g. English,Japanese, Tamil, Malayalam as opposed to artificial languages, like C++, Java, etc. Jaganadh G Practical Natural Language Processing
  • 11. Definition Natural Language Processing Natural Language Processing is a theoretically motivated range of computational techniques for analyzing and representing naturally occurring texts/speech at one or more levels of linguistic analysis for the purpose of achieving human-like language processing for a range of tasks or applications. NLP was considered as an academic discipline before some 10 to 20 years. Now concepts from NLP is applied in variety of Computing Platforms and Services Jaganadh G Practical Natural Language Processing
  • 12. Practical NLP ? Problem Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
  • 13. Practical NLP ? Problem Before going to some theory can we have some funny practical problems to solve ? Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
  • 14. Practical NLP ? Problem Before going to some theory can we have some funny practical problems to solve ? Picture Courtesy: http://twitpic.com/1y21qm/full Jaganadh G Practical Natural Language Processing
  • 15. Practical NLP Problem Jaganadh G Practical Natural Language Processing
  • 16. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Jaganadh G Practical Natural Language Processing
  • 17. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Jaganadh G Practical Natural Language Processing
  • 18. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Jaganadh G Practical Natural Language Processing
  • 19. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers Jaganadh G Practical Natural Language Processing
  • 20. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Jaganadh G Practical Natural Language Processing
  • 21. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Jaganadh G Practical Natural Language Processing
  • 22. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Jaganadh G Practical Natural Language Processing
  • 23. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Evaluate quality related tweets Jaganadh G Practical Natural Language Processing
  • 24. Practical NLP Problem Tweet-a-Toddy receives thousands of tweets per day Tweets requesting home delivery Tweets about quality of products Tweets related to enquirers They requires following things to be automated Identify tweet category Process home-delivery request Evaluate quality related tweets How? How to find a solution for Tweet-a-Toddy Jaganadh G Practical Natural Language Processing
  • 25. Solution ?? Any Solutions Jaganadh G Practical Natural Language Processing
  • 26. Solution ?? Any Solutions Some thoughts Jaganadh G Practical Natural Language Processing
  • 27. Solution ?? Any Solutions Some thoughts Text Classification Jaganadh G Practical Natural Language Processing
  • 28. Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Jaganadh G Practical Natural Language Processing
  • 29. Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Jaganadh G Practical Natural Language Processing
  • 30. Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Jaganadh G Practical Natural Language Processing
  • 31. Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Parsing, gammer ... Jaganadh G Practical Natural Language Processing
  • 32. Solution ?? Any Solutions Some thoughts Text Classification Entity Identification Information Extraction Sentiment Analysis Parsing, gammer ... Regex (Regular Expressions) Jaganadh G Practical Natural Language Processing
  • 33. Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Jaganadh G Practical Natural Language Processing
  • 34. Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Jaganadh G Practical Natural Language Processing
  • 35. Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Structure of words Jaganadh G Practical Natural Language Processing
  • 36. Another Practical Question Everybody might have used spell checker available in word processing systems like OpenOffice.org or Microsoft Word Any guess on how to develop a spell checker system ? Solutions Word List Structure of words Dynamic Programming (Edit Distance) Jaganadh G Practical Natural Language Processing
  • 37. Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Jaganadh G Practical Natural Language Processing
  • 38. Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Jaganadh G Practical Natural Language Processing
  • 39. Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Statistical Models Jaganadh G Practical Natural Language Processing
  • 40. Another Practical Question ... Context Sensitive Spell-checking Identifying and suggesting spelling of words based on context How ?? Solutions Statistical Models Word category based suggestions Jaganadh G Practical Natural Language Processing
  • 41. Can Machines Translate ?? Answer !!! Jaganadh G Practical Natural Language Processing
  • 42. Why NLP ? Because ”Information is Power !!!” Jaganadh G Practical Natural Language Processing
  • 43. Why NLP ? Because ”Information is Power !!!” Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 44. Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 45. Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Internet == at least 40 Million pages Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 46. Why NLP ? Because ”Information is Power !!!” Every day wast amount of text and speech data is being produced Internet == at least 40 Million pages Picture Courtesy: http://soundsgood.in/wikipediafat print book/ Jaganadh G Practical Natural Language Processing
  • 47. History Jaganadh G Practical Natural Language Processing
  • 48. History Second World War !!! Jaganadh G Practical Natural Language Processing
  • 49. History Second World War !!! Machine Translation Jaganadh G Practical Natural Language Processing
  • 50. History Second World War !!! Machine Translation Now : Jaganadh G Practical Natural Language Processing
  • 51. History Second World War !!! Machine Translation Now : Most promising imperfect technology Jaganadh G Practical Natural Language Processing
  • 52. History Second World War !!! Machine Translation Now : Most promising imperfect technology Moves from Lab to Industry to Layman Jaganadh G Practical Natural Language Processing
  • 53. NLP Really Hard to Achieve? NLP delas with human languages Human Language is dynamic and mysterious !!! Jaganadh G Practical Natural Language Processing
  • 54. NLP Really Hard to Achieve? NLP delas with human languages Human Language is dynamic and mysterious !!! Communication in Human Language Jaganadh G Practical Natural Language Processing
  • 55. NLP Really Hard to Achieve? Levels of Knowledge encoding in Language Data Jaganadh G Practical Natural Language Processing
  • 56. Tasks in NLP Broad Areas Jaganadh G Practical Natural Language Processing
  • 57. Tasks in NLP Broad Areas Text Processing Jaganadh G Practical Natural Language Processing
  • 58. Tasks in NLP Broad Areas Text Processing Speech Processing Jaganadh G Practical Natural Language Processing
  • 59. Major tasks in Text Processing Jaganadh G Practical Natural Language Processing
  • 60. Major tasks in Text Processing Word Level Analysis Jaganadh G Practical Natural Language Processing
  • 61. Major tasks in Text Processing Word Level Analysis Morphological Synthesis Jaganadh G Practical Natural Language Processing
  • 62. Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Jaganadh G Practical Natural Language Processing
  • 63. Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Jaganadh G Practical Natural Language Processing
  • 64. Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Jaganadh G Practical Natural Language Processing
  • 65. Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Sentence Level Analysis - Syntactical Parsing Jaganadh G Practical Natural Language Processing
  • 66. Major tasks in Text Processing Word Level Analysis Morphological Synthesis Part of Speech Tagging Stemming Lemmatization Sentence Level Analysis - Syntactical Parsing Discourse Analysis - Semantic Processing Jaganadh G Practical Natural Language Processing
  • 67. Morphology The branch of linguistics that studies word structures. Jaganadh G Practical Natural Language Processing
  • 68. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Jaganadh G Practical Natural Language Processing
  • 69. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Jaganadh G Practical Natural Language Processing
  • 70. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Jaganadh G Practical Natural Language Processing
  • 71. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Jaganadh G Practical Natural Language Processing
  • 72. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Jaganadh G Practical Natural Language Processing
  • 73. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Stemming Jaganadh G Practical Natural Language Processing
  • 74. Morphology The branch of linguistics that studies word structures. To a computer program a word is : ??? Morphological analysis can be explained as: the process of analyzing words to identify its constituents Computational Analysis of Morphology Morphological Analysis Morphological Generation Stemming Lemmatization Jaganadh G Practical Natural Language Processing
  • 75. Practical Question from Morphology Approximate number of word forms that can be derived from the word ”maram” Jaganadh G Practical Natural Language Processing
  • 76. Parts of Speech Tagging POS tagging is the process of marking up the words in a text (corpus) as corresponding to a particular part of speech, based on both its definition, as well as its context. Ram goes to school. Ram/NNP goes/VBZ to/TO school/NN ./. Jaganadh G Practical Natural Language Processing
  • 77. Parts of Speech Tagging POS tagging is the process of marking up the words in a text (corpus) as corresponding to a particular part of speech, based on both its definition, as well as its context. Ram goes to school. Ram/NNP goes/VBZ to/TO school/NN ./. Words are ambiguous !!!! e.g. book, cricket, bank Jaganadh G Practical Natural Language Processing
  • 78. Syntactical Parsing Parsing In computer science and linguistics, parsing, or, more formally, syntactic analysis, is the process of analyzing a text, made of a sequence of tokens (for example, words), to determine its grammatical structure with respect to a given (more or less) formal grammar. Jaganadh G Practical Natural Language Processing
  • 79. Syntactical Parsing Parsing In computer science and linguistics, parsing, or, more formally, syntactic analysis, is the process of analyzing a text, made of a sequence of tokens (for example, words), to determine its grammatical structure with respect to a given (more or less) formal grammar. Sentences are ambiguous !!!! Jaganadh G Practical Natural Language Processing
  • 80. Semantics Study of meaning ans its structure Jaganadh G Practical Natural Language Processing
  • 81. Semantics Study of meaning ans its structure Word meaning is ambiguous !!!! E.g. marriage Jaganadh G Practical Natural Language Processing
  • 82. Where can I apply this techniques? Machine Translation Systems Jaganadh G Practical Natural Language Processing
  • 83. Where can I apply this techniques? Machine Translation Systems Search Engine Jaganadh G Practical Natural Language Processing
  • 84. Where can I apply this techniques? Machine Translation Systems Search Engine Spell-checker Jaganadh G Practical Natural Language Processing
  • 85. Where can I apply this techniques? Machine Translation Systems Search Engine Spell-checker Grammar Checker Jaganadh G Practical Natural Language Processing
  • 86. Where can I apply this techniques? Machine Translation Systems Search Engine Spell-checker Grammar Checker .......... Jaganadh G Practical Natural Language Processing
  • 87. Other Interesting Tasks Named Entity Identification Jaganadh G Practical Natural Language Processing
  • 88. Other Interesting Tasks Named Entity Identification Information Extraction Jaganadh G Practical Natural Language Processing
  • 89. Other Interesting Tasks Named Entity Identification Information Extraction Information Retrieval Jaganadh G Practical Natural Language Processing
  • 90. Other Interesting Tasks Named Entity Identification Information Extraction Information Retrieval Text Classification and Clustering Jaganadh G Practical Natural Language Processing
  • 91. Speech Processing Two Major Areas Text to Speech Speech Recognition Jaganadh G Practical Natural Language Processing
  • 92. Speech Processing Two Major Areas Text to Speech Speech Recognition Practical Applications IVR Technology for Visually Challenged People Mobile Phones Speech Enabled Web Vehicle Mounted GPS Navigator Jaganadh G Practical Natural Language Processing
  • 93. Commerical NLP Applications What Industry Looks Jaganadh G Practical Natural Language Processing
  • 94. Commerical NLP Applications What Industry Looks Components of Word Processors Jaganadh G Practical Natural Language Processing
  • 95. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Jaganadh G Practical Natural Language Processing
  • 96. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Jaganadh G Practical Natural Language Processing
  • 97. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Jaganadh G Practical Natural Language Processing
  • 98. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Jaganadh G Practical Natural Language Processing
  • 99. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Jaganadh G Practical Natural Language Processing
  • 100. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Speech Systems Jaganadh G Practical Natural Language Processing
  • 101. Commerical NLP Applications What Industry Looks Components of Word Processors Machine Translation Systems Custom Search Systems Information Extraction Entity Identification Text Summarization Speech Systems Question Answering Systems Jaganadh G Practical Natural Language Processing
  • 102. Future of NLP Future!!! Semantics oriented technologies Jaganadh G Practical Natural Language Processing
  • 103. NLP in other domains Bio-Medical Legal Forensic Science Advertisement Education Politics E-governance Business Development Marketing and where ever we use language !!! Jaganadh G Practical Natural Language Processing
  • 104. Natural Language Processing in India Academic Institutions IIT Kanpur, Kharagpur, Bombay IIIT hydrabad IISc Bangalore AU-KBC Chennai Amritha University Ettimadai, Coimbatore IIITMK, Trivandrum Central University, Hydrabad JNU, Delhi Tamil University, Thanjore Jaganadh G Practical Natural Language Processing
  • 105. Natural Language Processing in India Industry Microsoft Yahoo! AOL 365Media Pvt. Ltd. Inside View Thaazza AIAIO Labs Jaganadh G Practical Natural Language Processing
  • 106. Questions ?? Jaganadh G Practical Natural Language Processing
  • 107. References Daniel Jurafsky,James H. Martin, SPEECH and LANGUAGE PROCESSING, 2nd Edition. U.S. Tiwary, Tanveer Siddiqui , Natural Language Processing and Information Retrieval Jaganadh G Practical Natural Language Processing
  • 108. Finally Jaganadh G Practical Natural Language Processing
  • 109. Questions ?? Jaganadh G Practical Natural Language Processing
  • 110. References Daniel Jurafsky,James H. Martin, SPEECH and LANGUAGE PROCESSING, 2nd Edition. U.S. Tiwary, Tanveer Siddiqui , Natural Language Processing and Information Retrieval Jaganadh G Practical Natural Language Processing
  • 111. Finally Jaganadh G Practical Natural Language Processing