In-Context Recall

The ability to retrieve specific facts from long context. Transformers excel (via attention) at pointing to exact token positions. Mamba struggles because its fixed-size state can't store all token embeddings; information compresses and is lost.