Generalization

The ability of a model to perform well on new, unseen data (test set). Loss is one measure of generalization. The scaling laws study how generalization improves with more parameters and data.