English
Related papers

Related papers: A comparison of mixed-variables Bayesian optimizat…

200 papers

In the present paper we describe new heuristic technique, which can be applied to the optimization of pseudo-Boolean functions including Black-Box functions. This technique is based on a simple procedure which consists in transition from…

Neural and Evolutionary Computing · Computer Science 2019-08-05 Alexander A. Semenov

Mixture models are widely used in Bayesian statistics and machine learning, in particular in computational biology, natural language processing and many other fields. Variational inference, a technique for approximating intractable…

Statistics Theory · Mathematics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

We present a tutorial on Bayesian optimization, a method of finding the maximum of expensive cost functions. Bayesian optimization employs the Bayesian technique of setting a prior over the objective function and combining it with evidence…

Machine Learning · Computer Science 2010-12-14 Eric Brochu , Vlad M. Cora , Nando de Freitas

Bayesian optimization is an effective method for solving expensive black-box optimization problems. Most existing methods use Gaussian processes (GP) as the surrogate model for approximating the black-box objective function, it is…

Machine Learning · Computer Science 2025-12-23 Wei Peng , Jianchen Hu , Kang Liu , Qiaozhu Zhai

We present an alternating augmented Lagrangian method for convex optimization problems where the cost function is the sum of two terms, one that is separable in the variable blocks, and a second that is separable in the difference between…

Machine Learning · Statistics 2012-03-09 Bo Wahlberg , Stephen Boyd , Mariette Annergren , Yang Wang

Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same…

Optimization and Control · Mathematics 2020-06-16 Johannes Wiebe , Inês Cecílio , Jonathan Dunlop , Ruth Misener

This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the…

Optimization and Control · Mathematics 2023-10-18 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

We propose a unified framework to address a family of classical mixed-integer optimization problems with logically constrained decision variables, including network design, facility location, unit commitment, sparse portfolio selection,…

Optimization and Control · Mathematics 2021-10-19 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Accelerator physics relies on numerical algorithms to solve optimization problems in online accelerator control and tasks such as experimental design and model calibration in simulations. The effectiveness of optimization algorithms in…

We developed a parallel Bayesian optimization algorithm for large eddy simulations. These simulations challenge optimization methods because they take hours or days to compute, and their objective function contains noise as turbulent…

Fluid Dynamics · Physics 2014-11-04 Chaitanya Talnikar , Patrick Blonigan , Julien Bodart , Qiqi Wang

Implicit variables of an optimization problem are used to model variationally challenging feasibility conditions in a tractable way while not entering the objective function. Hence, it is a standard approach to treat implicit variables as…

Optimization and Control · Mathematics 2025-10-01 Patrick Mehlitz

We introduce a new incremental preference elicitation procedure able to deal with noisy responses of a Decision Maker (DM). The originality of the contribution is to propose a Bayesian approach for determining a preferred solution in a…

Artificial Intelligence · Computer Science 2020-07-30 Nadjet Bourdache , Patrice Perny , Olivier Spanjaard

Multi-objective optimization problems whose objectives have different evaluation costs are commonly seen in the real world. Such problems are now known as multi-objective optimization problems with heterogeneous objectives (HE-MOPs). So…

Neural and Evolutionary Computing · Computer Science 2022-08-26 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

In cluster analysis interest lies in probabilistically capturing partitions of individuals, items or observations into groups, such that those belonging to the same group share similar attributes or relational profiles. Bayesian posterior…

Methodology · Statistics 2017-03-23 Riccardo Rastelli , Nial Friel

Applying Bayesian optimization in problems wherein the search space is unknown is challenging. To address this problem, we propose a systematic volume expansion strategy for the Bayesian optimization. We devise a strategy to guarantee that…

Machine Learning · Statistics 2019-10-30 Huong Ha , Santu Rana , Sunil Gupta , Thanh Nguyen , Hung Tran-The , Svetha Venkatesh

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

Machine Learning · Computer Science 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

Machine Learning · Computer Science 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

We apply classical and Bayesian lasso regularizations to a family of models with the presence of mixture and process variables. We analyse the performance of these estimates with respect to ordinary least squares estimators by a simulation…

Recently, lower-level constrained bilevel optimization has attracted increasing attention. However, existing methods mostly focus on either deterministic cases or problems with linear constraints. The main challenge in stochastic cases with…

Optimization and Control · Mathematics 2025-10-13 Hantao Nie , Jiaxiang Li , Zaiwen Wen

Inference in the presence of outliers is an important field of research as outliers are ubiquitous and may arise across a variety of problems and domains. Bayesian optimization is method that heavily relies on probabilistic inference. This…

Machine Learning · Computer Science 2017-12-14 Ruben Martinez-Cantin , Kevin Tee , Michael McCourt