Structured State Space (S4)
A prior SSM architecture (Gu et al., 2021) that imposes structure on the A matrix (e.g., diagonal, plus rank-1 update) for efficiency.
A prior SSM architecture (Gu et al., 2021) that imposes structure on the A matrix (e.g., diagonal, plus rank-1 update) for efficiency. Mamba improves on S4 by making B, C, Δ input-dependent (selective).