Parameters
The learnable weights in a neural network model.
The learnable weights in a neural network model. Mistral 7B has 7 billion parameters, while LLaMA 2 13B has 13 billion. More parameters generally allow higher capacity, but also require more memory and compute. Mistral proved that clever architecture can reduce parameter count while maintaining quality.
Another word for weights.