Learning Rate

A hyperparameter that controls how large a step the model takes when updating its weights during training. Too high and the model overshoots and fails to converge; too low and training is slow or gets stuck. Setting the right learning rate is one of the most consequential decisions in model training, and most modern training pipelines use schedulers that adjust it dynamically over time.