Hadi Pres, 21-12-24-1
Hadi Pres, 21-12-24-1
• Prepared by
• Shuceyb sh. Yusuf Hassan
• Jamal Abdulahi Raage
Natural Language Processing (
NLP) in AI
1. Text Input - NLP systems begin with text input, which can
come from various sources like documents, social media, or
spoken language converted to text.
2. Text Preprocessing -
• Tokenization: Breaking the text into smaller units, such as
words or sentences. -
• Normalization: Converting text to a standard format,
including lowercasing, removing punctuation, and correcting
spelling. -
• Stopword Removal: Eliminating common words (e.g., "and",
"the") that may not add significant meaning.
Continue….
3. Linguistic Analysis -
• Part-of-Speech Tagging: Identifying the grammatical
categories (nouns, verbs, adjectives) of words.
• Named Entity Recognition (NER): Identifying and
classifying key entities in the text, such as names,
dates, and locations.
• Dependency Parsing: Analyzing the grammatical
structure to understand how words relate to each
other.
Continue….