Parameters

The learnable weights in a neural network model. Mistral 7B has 7 billion parameters, while LLaMA 2 13B has 13 billion. More parameters generally allow higher capacity, but also require more memory and compute. Mistral proved that clever architecture can reduce parameter count while maintaining quality.