Bayesian Optimization

A strategy for efficiently finding the optimal settings for an expensive function, such as a model's hyperparameters, by building a probabilistic model of that function and using it to decide where to evaluate next. It is much more efficient than exhaustive search and is widely used in automated machine learning and neural architecture search.
See also: hyperparameter, bayesian network.