State Transition Matrix (A)
An n×n matrix governing how the hidden state x evolves over time.
An n×n matrix governing how the hidden state x evolves over time. In Mamba, A has eigenvalues close to -1 (after discretisation, the eigenvalues of Ā are between 0 and 1). The eigenvalues control the "memory length"—larger eigenvalues mean slower decay.