Vocabulary (V)
The set of words the model knows about.
The set of words the model knows about. Typically the top 100,000 to
The set of tokens (words, subwords, or characters) the model knows
The set of words the model knows about.
The set of words the model knows about. Typically the top 100,000 to
The set of tokens (words, subwords, or characters) the model knows