Gradient Descent

The core optimization algorithm used to train most machine learning models. It iteratively adjusts model parameters in the direction that reduces the loss function, using the gradient to determine which direction is downhill. Over many steps, the model converges toward better performance.
See also: gradient, backpropagation, loss function.