Skip to content
ml-recall

#merges

6 questions from Tokenization

Timed test

6 questions · 6 min · score and explanations at the end

Take a test
Q 1 / 6Score 0 / 0

Question 1: Short answer

easyAI-checkedTokenization

A byte-level BPE tokenizer starts from the 256 possible byte values as its symbols and stops when the vocabulary holds 32,000 symbols. Each merge adds the merged pair as one new symbol and removes nothing. How many merges does it perform?

a whole number