Computer Science · Artificial Intelligence
In Natural Language Processing (NLP), what does 'tokenization' refer to?
Verified Solution4 OptionsUpdated: October 2026👁️1 View
Share:
- 1Splitting text into individual words, characters, or subwords✓
- 2Compressing large language model files
- 3Providing digital tokens to run robotic processes
- 4Encrypting user passwords into safe hashes
Correct answer
Splitting text into individual words, characters, or subwords
Download Single Question PDF
Save this question and verified answer as a clean study sheet with live clickable link.
👥
Share with Friends & Study Groups
Challenge your peer aspirants on WhatsApp or Telegram to solve this question!
Online Test Series
Start Free Mock Test →Preparing for Computer Science?
Practice full-length mock tests with real exam timers, instant score analysis, and all-India ranking.
Chapter Practice
Practice Artificial Intelligence MCQs →Want more practice questions on Artificial Intelligence?
Solve complete topic-wise tests with detailed solutions on GkGet.
Related Practice Questions
Recommended practice questions in Computer Science · Artificial Intelligence