Iteration

A single update step during model training, typically involving one mini-batch of data. Many iterations make up an epoch, and many epochs make up a full training run. The term is also used more loosely to describe cycles of experimentation and improvement in model development.
See also: epoch, gradient descent, training.