Tightening regret bounds for scalable transfer optimization with gaussian process surrogates

A Gupta, R Lim, CC Ooi, YS Ong - 2022 IEEE Symposium …, 2022 - ieeexplore.ieee.org
2022 IEEE Symposium Series on Computational Intelligence (SSCI), 2022ieeexplore.ieee.org
Recent theoretical results have shown that instilling knowledge transfer into black-box
optimization with Gaussian process surrogates, aka transfer Bayesian optimization, tightens
cumulative regret bounds compared to the no-transfer case. Faster convergence under strict
function evaluation budgets-often in the order of a hundred or fewer function evaluations-is
thus expected, overcoming the cold start problem of conventional Bayesian optimization
algorithms. In this short paper, we prove that the regret bounds can be further tightened …
Recent theoretical results have shown that instilling knowledge transfer into black-box optimization with Gaussian process surrogates, aka transfer Bayesian optimization, tightens cumulative regret bounds compared to the no-transfer case. Faster convergence under strict function evaluation budgets - often in the order of a hundred or fewer function evaluations - is thus expected, overcoming the cold start problem of conventional Bayesian optimization algorithms. In this short paper, we prove that the regret bounds can be further tightened when extending the method to multi-source settings (where each source may depict distinct source-target correlation), while also achieving internal algorithmic complexity that's only linear in the number of sources. Experimental results, on both synthetic test functions as well as a practical case study, verify our theoretical claim of performance gain.
ieeexplore.ieee.org
この検索の最上位の結果を表示しています。 検索結果をすべて見る