Tokenization
The process of converting input (text, images, audio) into discrete tokens.
The process of converting input (text, images, audio) into discrete tokens. Gemini tokenizes all modalities identically into a unified vocabulary.
The process of converting input (text, images, audio) into discrete tokens.
The process of converting input (text, images, audio) into discrete tokens. Gemini tokenizes all modalities identically into a unified vocabulary.