English
Related papers

Related papers: Trust Region Constrained Bayesian Optimization wit…

200 papers

We consider unconstrained multi-criteria optimization problems with finite sum objective functions. The proposed algorithm belongs to a non-monotone trust region framework where additional sampling approach is used to govern the sample size…

Optimization and Control · Mathematics 2026-03-13 Nataša Krklec Jerinkić , Luka Rutešić , Ilaria Trombini

Bayesian optimization is a popular method for solving the problem of global optimization of an expensive-to-evaluate black-box function. It relies on a probabilistic surrogate model of the objective function, upon which an acquisition…

Machine Learning · Statistics 2022-06-22 Jungtaek Kim , Seungjin Choi , Minsu Cho

Convex and nonconvex finite-sum minimization arises in many scientific computing and machine learning applications. Recently, first-order and second-order methods where objective functions, gradients and Hessians are approximated by…

Optimization and Control · Mathematics 2020-05-12 Stefania Bellavia , Natasa Krejic , Benedetta Morini

This paper investigates energy-minimization finite-element approaches for the computation of nematic liquid crystal equilibrium configurations. We compare the performance of these methods when the necessary unit-length constraint is…

Numerical Analysis · Mathematics 2014-12-31 J. H. Adler , D. B. Emerson , S. P. MacLachlan , T. A. Manteuffel

This paper introduces a model-free real-time optimization (RTO) framework based on unconstrained Bayesian optimization with embedded constraint control. The main contribution lies in demonstrating how this approach simplifies the black-box…

Optimization and Control · Mathematics 2024-02-29 Dinesh Krishnamoorthy

Trust Region Bayesian Optimization (TuRBO) is an effective strategy for alleviating the curse of dimensionality in high-dimensional black-box optimization. However, inappropriate lengthscale design can cause the local Gaussian process (GP)…

Machine Learning · Statistics 2026-04-28 Wei-Ting Tang , Joel A. Paulson

For minimizing a strongly convex objective function subject to linear inequality constraints, we consider a penalty approach that allows one to utilize stochastic methods for problems with a large number of constraints and/or objective…

Optimization and Control · Mathematics 2022-02-16 Meng Li , Paul Grigas , Alper Atamturk

In many applications, ranging from logistics to engineering, a designer is faced with a sequence of optimization tasks for which the objectives are in the form of black-box functions that are costly to evaluate. Furthermore, higher-fidelity…

Machine Learning · Computer Science 2025-01-09 Yunchuan Zhang , Sangwoo Park , Osvaldo Simeone

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

Categorical structural optimization under aleatoric uncertainty is challenging because each design variable must be selected from a finite catalog of admissible instances, while each candidate design may require expensive stochastic…

Machine Learning · Computer Science 2026-04-29 Zhangyong Liang , Huanhuan Gao

Binary trust-region steepest descent (BTR) and combinatorial integral approximation (CIA) are two recently investigated approaches for the solution of optimization problems with distributed binary-/discrete-valued variables (control…

Optimization and Control · Mathematics 2024-02-14 Paul Manns , Mirko Hahn , Christian Kirches , Sven Leyffer , Sebastian Sager

Within the framework of complex system design, it is often necessary to solve mixed variable optimization problems, in which the objective and constraint functions can depend simultaneously on continuous and discrete variables.…

Optimization and Control · Mathematics 2020-03-10 Julien Pelamatti , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

Closed-loop performance of sequential decision making algorithms, such as model predictive control, depends strongly on the choice of controller parameters. Bayesian optimization allows learning of parameters from closed-loop experiments,…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Sebastian Hirt , Lukas Theiner , Rolf Findeisen

Building surrogate models is one common approach when we attempt to learn unknown black-box functions. Bayesian optimization provides a framework which allows us to build surrogate models based on sequential samples drawn from the function…

Machine Learning · Computer Science 2021-09-17 Hengrui Luo , James W. Demmel , Younghyun Cho , Xiaoye S. Li , Yang Liu

Worst-case complexity guarantees for nonconvex optimization algorithms have been a topic of growing interest. Multiple frameworks that achieve the best known complexity bounds among a broad class of first- and second-order strategies have…

Optimization and Control · Mathematics 2020-11-23 Frank E. Curtis , Daniel P. Robinson , Clément Royer , Stephen J. Wright

This study proposes a new constraint handling technique for assisting metaheuristic optimization algorithms to solve constrained optimization problems more effectively and efficiently. Given any two solutions of any constrained optimization…

Optimization and Control · Mathematics 2023-10-23 Ting Huang , Qiang Zhang , Witold Pedrycz , Shanlin Yang

At present, high-dimensional global optimization problems with time-series models have received much attention from engineering fields. Since it was proposed, Bayesian optimization has quickly become a popular and promising approach for…

Machine Learning · Computer Science 2021-08-06 Yuyang Chen , Kaiming Bi , Chih-Hang J. Wu , David Ben-Arieh , Ashesh Sinha

Bayesian optimization is a promising methodology for analog circuit synthesis. However, the sequential nature of the Bayesian optimization framework significantly limits its ability to fully utilize real-world computational resources. In…

Machine Learning · Computer Science 2021-06-30 Shuhan Zhang , Fan Yang , Changhao Yan , Dian Zhou , Xuan Zeng

Optimization is becoming increasingly common in scientific and engineering domains. Oftentimes, these problems involve various levels of stochasticity or uncertainty in generating proposed solutions. Therefore, optimization in these…

Machine Learning · Statistics 2020-06-05 Peter D. Tonner , Daniel V. Samarov , A. Gilad Kusne

We develop constrained Bayesian estimation methods for small area problems: those requiring smoothness with respect to similarity across areas, such as geographic proximity or clustering by covariates; and benchmarking constraints,…

Methodology · Statistics 2014-10-28 Rebecca C. Steorts