PH
P.A. Hautelman
info
Please Note
<p>This page displays the records of the person named above and is not linked to a unique person identifier. This record may need to be merged to a profile.</p>
1 records found
1
An empirical analysis of entropy search in batch bayesian optimisation
A comprehensive study of function shape, batch size, noise level, and dimensionality impact on information-theoretic methods
Bayesian optimisation is a rapidly growing area of research that aims to identify the optimum of the black-box function, as it strategically directs the optimisation process towards promising regions. This paper provides an overview of the theoretical background used by the Entropy Search algorithms under study, mainly Predictive Entropy Search, Max-Value Entropy Search, and Joint Entropy Search. Furthermore, we empirically analyse the performance and sensitivity of the algorithms in different environment settings. In particular, we discuss the impact of function shape, batch size, noise level, and the number of input dimensions on the final simple regret metric. The results show the weak spots of the information-theoretic methods. However, the algorithms perform better for batch optimisation, demonstrating the advantage when considering the information on the maximum function value.
...
Bayesian optimisation is a rapidly growing area of research that aims to identify the optimum of the black-box function, as it strategically directs the optimisation process towards promising regions. This paper provides an overview of the theoretical background used by the Entropy Search algorithms under study, mainly Predictive Entropy Search, Max-Value Entropy Search, and Joint Entropy Search. Furthermore, we empirically analyse the performance and sensitivity of the algorithms in different environment settings. In particular, we discuss the impact of function shape, batch size, noise level, and the number of input dimensions on the final simple regret metric. The results show the weak spots of the information-theoretic methods. However, the algorithms perform better for batch optimisation, demonstrating the advantage when considering the information on the maximum function value.