Question 1: Single choice
mediumAI-checkedTokenizationEnglish has about possible character 6-grams, and fastText represents every word by the sum of the vectors of its 3- to 6-grams. How does fastText keep its table of n-gram vectors bounded?
2 questions from Tokenization, RAG & Agents
2 questions · 2 min · score and explanations at the end
English has about possible character 6-grams, and fastText represents every word by the sum of the vectors of its 3- to 6-grams. How does fastText keep its table of n-gram vectors bounded?