Computer Science · Natural Language Processing
What is the primary purpose of Tokenization in Natural Language Processing (NLP)?
Verified Solution4 OptionsUpdated: October 2026👁️1 View
Share:
- 1To extract punctuation marks from text
- 2To convert text string into lowercase
- 3To break text stream into smaller meaningful units called tokens✓
- 4To perform grammatical parsing of sentences
Correct answer
To break text stream into smaller meaningful units called tokens
Download Single Question PDF
Save this question and verified answer as a clean study sheet with live clickable link.
👥
Share with Friends & Study Groups
Challenge your peer aspirants on WhatsApp or Telegram to solve this question!
Online Test Series
Start Free Mock Test →Preparing for Computer Science?
Practice full-length mock tests with real exam timers, instant score analysis, and all-India ranking.
Chapter Practice
Practice Natural Language Processing MCQs →Want more practice questions on Natural Language Processing?
Solve complete topic-wise tests with detailed solutions on GkGet.
Related Practice Questions
Recommended practice questions in Computer Science · Natural Language Processing