d_model (model dimension)

The dimension of all input and output vectors in the Transformer. The original paper uses d_model = 512. All residual connections must match this dimension. Larger d_model = more expressive representations = more parameters = more compute.