Parallel cost-aware optimization of multidimensional black-box functions

Scientific problems are often concerned with optimization of control variables of complex systems, for instance hyperparameters of machine learning models. A popular solution for such intractable environments is Bayesian optimization. However, many implementations disregard dynamic evaluation costs associated with the optimization procedure....