Bias-Variance Tradeoff

The fundamental tension in machine learning between a model that is too simple, producing high bias and underfitting the data, and one that is too complex, producing high variance and overfitting it. Finding the right balance is central to building models that generalize well to new data.
See also: overfitting, underfitting, regularization.