Question 1: Single choice
easyAI-checkedWhat does tokenization do?
NLP Fundamentals
37 questions · 37 reviewed · Read the notes (4 min)
Timed test
20 questions · 20 min · score and explanations at the end
Q 1 / 37Score 0 / 0
37 questions · 37 reviewed · Read the notes (4 min)
20 questions · 20 min · score and explanations at the end
What does tokenization do?