English
Related papers

Related papers: Constrained Bayesian Optimization Under Partial Ob…

200 papers

Nonparametric Bayesian models are used routinely as flexible and powerful models of complex data. Many times, a statistician may have additional informative beliefs about data distribution of interest, e.g., its mean or subset components,…

Methodology · Statistics 2022-11-08 Bingjing Tang , Vinayak Rao

This paper proposes a robust approximation method for solving chance constrained optimization (CCO) of polynomials. Assume the CCO is defined with an individual chance constraint that is affine in the decision variables. We construct a…

Optimization and Control · Mathematics 2024-08-27 Bo Rao , Liu Yang , Suhan Zhong , Guangming Zhou

In the statistical problem of denoising, Bayes and empirical Bayes methods can "overshrink" their output relative to the latent variables of interest. This work is focused on constrained denoising problems which mitigate such phenomena. At…

Methodology · Statistics 2025-07-01 Adam Quinn Jaffe , Nikolaos Ignatiadis , Bodhisattva Sen

Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a…

Artificial Intelligence · Computer Science 2011-06-02 M. Hauskrecht

Recent years have seen increased interest in combining drug agents and/or schedules. Several methods for Phase I combination-escalation trials are proposed, among which, the partial ordering continual reassessment method (POCRM) gained…

Methodology · Statistics 2024-09-17 Weishi Chen , Pavel Mozgunov

Bayesian optimization has become a popular method for high-throughput computing, like the design of computer experiments or hyperparameter tuning of expensive models, where sample efficiency is mandatory. In these applications, distributed…

Machine Learning · Computer Science 2019-07-08 Javier Garcia-Barcos , Ruben Martinez-Cantin

Reinforcement learning in sparse-reward navigation environments with expensive and limited interactions is challenging and poses a need for effective exploration. Motivated by complex navigation tasks that require real-world training (when…

Optimization and Control · Mathematics 2023-10-13 Yijia Wang , Matthias Poloczek , Daniel R. Jiang

This paper presents a method called sampling-computation-optimization (SCO) to design batch Bayesian optimization. SCO does not construct new high-dimensional acquisition functions but samples from the existing one-site acquisition function…

Optimization and Control · Mathematics 2022-02-22 Kai Jia , Xiaojun Duan , Zhengming Wang , Liang Yan

Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same…

Optimization and Control · Mathematics 2020-06-16 Johannes Wiebe , Inês Cecílio , Jonathan Dunlop , Ruth Misener

We propose a novel Bayesian Optimization approach for black-box functions with an environmental variable whose value determines the tradeoff between evaluation cost and the fidelity of the evaluations. Further, we use a novel approach to…

Machine Learning · Statistics 2018-05-16 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

Machine Learning · Statistics 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

Optimizing an expensive-to-query function is a common task in science and engineering, where it is beneficial to keep the number of queries to a minimum. A popular strategy is Bayesian optimization (BO), which leverages probabilistic models…

Machine Learning · Computer Science 2019-07-05 Willie Neiswanger , Kirthevasan Kandasamy , Barnabas Poczos , Jeff Schneider , Eric Xing

Bayesian optimization is a sample-efficient method for black-box global optimization. How- ever, the performance of a Bayesian optimization method very much depends on its exploration strategy, i.e. the choice of acquisition function, and…

Machine Learning · Statistics 2015-03-06 Bobak Shahriari , Ziyu Wang , Matthew W. Hoffman , Alexandre Bouchard-Côté , Nando de Freitas

Bayesian optimization (BO) is a popular global optimization scheme for sample-efficient optimization in domains with expensive function evaluations. The existing BO techniques are capable of finding a single global optimum solution.…

Optimization and Control · Mathematics 2023-08-08 Yongsheng Mei , Tian Lan , Mahdi Imani , Suresh Subramaniam

We develop the theory and practice of an approach to modelling and probabilistic inference in causal networks that is suitable when application-specific or analysis-specific constraints should inform such inference or when little or no data…

Artificial Intelligence · Computer Science 2017-05-16 Paul Beaumont , Michael Huth

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box functions. However, in settings with very few function evaluations, a successful application of BO may require transferring information from…

Machine Learning · Computer Science 2024-09-10 Aryan Deshwal , Sait Cakmak , Yuhou Xia , David Eriksson

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

Bayesian optimization has recently emerged as a popular and efficient tool for global optimization and hyperparameter tuning. Currently, the established Bayesian optimization practice requires a user-defined bounding box which is assumed to…

Machine Learning · Statistics 2015-08-18 Bobak Shahriari , Alexandre Bouchard-Côté , Nando de Freitas

Bayesian optimization (BO) is a class of sample-efficient global optimization methods, where a probabilistic model conditioned on previous observations is used to determine future evaluations via the optimization of an acquisition function.…

Machine Learning · Computer Science 2020-06-22 Eric Hans Lee , David Eriksson , Bolong Cheng , Michael McCourt , David Bindel

Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such…

Machine Learning · Computer Science 2023-11-07 Lin Yang , Junlong Lyu , Wenlong Lyu , Zhitang Chen