Token Position

The index of a token in the sequence (0 to n-1). Position encoding (e.g., RoPE) depends on token position. In Ring Attention, tracking global positions across GPUs is important for causal masking and position embeddings.