English
Related papers

Related papers: ZeroShotOpt: Towards Zero-Shot Pretrained Models f…

200 papers

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box functions. However, in settings with very few function evaluations, a successful application of BO may require transferring information from…

Machine Learning · Computer Science 2024-09-10 Aryan Deshwal , Sait Cakmak , Yuhou Xia , David Eriksson

We focus on collaborative and federated black-box optimization (BBOpt), where agents optimize their heterogeneous black-box functions through collaborative sequential experimentation. From a Bayesian optimization perspective, we address the…

Machine Learning · Computer Science 2025-08-25 Raed Al Kontar

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Bayesian Optimization (BO) is a popular approach to optimizing expensive-to-evaluate black-box functions. Despite the success of BO, its performance may decrease exponentially as the dimensionality increases. A common framework to tackle…

Machine Learning · Computer Science 2024-12-24 Quoc-Anh Hoang Nguyen , The Hung Tran

Bayesian optimization is an effective method for solving expensive black-box optimization problems. Most existing methods use Gaussian processes (GP) as the surrogate model for approximating the black-box objective function, it is…

Machine Learning · Computer Science 2025-12-23 Wei Peng , Jianchen Hu , Kang Liu , Qiaozhu Zhai

Bayesian Optimization (BO) is an efficient tool for optimizing black-box functions, but its theoretical guarantees typically hold in the asymptotic regime. In many critical real-world applications such as drug discovery or materials design,…

Machine Learning · Computer Science 2025-11-04 Diantong Li , Kyunghyun Cho , Chong Liu

The goal of object-centric representation learning is to decompose visual scenes into a structured representation that isolates the entities. Recent successes have shown that object-centric representation learning can be scaled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Aniket Didolkar , Andrii Zadaianchuk , Anirudh Goyal , Mike Mozer , Yoshua Bengio , Georg Martius , Maximilian Seitzer

Bayesian Optimization (BO) is an effective approach for global optimization of black-box functions when function evaluations are expensive. Most prior works use Gaussian processes to model the black-box function, however, the use of kernels…

Machine Learning · Computer Science 2023-09-25 Dat Phan-Trong , Hung Tran-The , Sunil Gupta

Bayesian Optimization is a popular approach for optimizing expensive black-box functions. Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential…

Machine Learning · Statistics 2025-02-05 Haoxian Chen , Henry Lam

Bayesian Optimisation (BO) refers to a suite of techniques for global optimisation of expensive black box functions, which use introspective Bayesian models of the function to efficiently search for the optimum. While BO has been applied…

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

The remarkable success of diffusion and flow-matching models has ignited a surge of works on adapting them at test time for controlled generation tasks. Examples range from image editing to restoration, compression and personalization.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Or Ronai , Vladimir Kulikov , Tomer Michaeli

Model selection is an integral problem of model based optimization techniques such as Bayesian optimization (BO). Current approaches often treat model selection as an estimation problem, to be periodically updated with observations coming…

Machine Learning · Computer Science 2023-08-02 Manisha Senadeera , Santu Rana , Sunil Gupta , Svetha Venkatesh

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Bayesian optimization (BO) is a framework for global optimization of expensive-to-evaluate objective functions. Classical BO methods assume that the objective function is a black box. However, internal information about objective function…

Machine Learning · Computer Science 2022-01-04 Raul Astudillo , Peter I. Frazier

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

Machine Learning · Statistics 2017-11-03 Luigi Acerbi , Wei Ji Ma

Many important problems in science and engineering, such as drug design, involve optimizing an expensive black-box objective function over a complex, high-dimensional, and structured input space. Although machine learning techniques have…

Machine Learning · Computer Science 2020-10-27 Austin Tripp , Erik Daxberger , José Miguel Hernández-Lobato

Zero-shot imitation learning algorithms hold the promise of reproducing unseen behavior from as little as a single demonstration at test time. Existing practical approaches view the expert demonstration as a sequence of goals, enabling…

Machine Learning · Computer Science 2025-06-13 Thomas Rupf , Marco Bagatella , Nico Gürtler , Jonas Frey , Georg Martius

Many problems in science and engineering involve optimizing an expensive black-box function over a high-dimensional space. For such black-box optimization (BBO) problems, we typically assume a small budget for online function evaluations,…

Machine Learning · Computer Science 2023-08-22 Siddarth Krishnamoorthy , Satvik Mehul Mashkaria , Aditya Grover

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

Machine Learning · Computer Science 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić