English
Related papers

Related papers: On the Efficient Gerschgorin Inclusion Usage in th…

200 papers

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

Optimization and Control · Mathematics 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

Constrained clustering leverages limited domain knowledge to improve clustering performance and interpretability, but incorporating pairwise must-link and cannot-link constraints is an NP-hard challenge, making global optimization…

Machine Learning · Computer Science 2025-10-28 Pedro Chumpitaz-Flores , My Duong , Cristobal Heredia , Kaixun Hua

In this paper, a new sequential surrogate-based optimization (SSBO) algorithm is developed, which aims to improve the global search ability and local search efficiency for the global optimization of expensive black-box models. The proposed…

Machine Learning · Statistics 2018-11-30 Chunlin Gong , Xu Li , Hua Su , Jinlei Guo , Liangxian Gu

In this paper, Lipschitz univariate constrained global optimization problems where both the objective function and constraints can be multiextremal are considered. The constrained problem is reduced to a discontinuous unconstrained problem…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Domenico Famularo , Paolo Pugliese

We propose a method for verifying that a given feasible point for a polynomial optimization problem is globally optimal. The approach relies on the Lasserre hierarchy and the result of Lasserre regarding the importance of the convexity of…

Optimization and Control · Mathematics 2021-01-05 Sikun Xu , Ruoyi Ma , Daniel K. Molzahn , Hassan Hijazi , Cédric Josz

Binary optimization is a fundamental area in computational science, with wide-ranging applications from logistics to cryptography, where the tasks are often formulated as Quadratic or Polynomial Unconstrained Binary Optimization problems…

Quantum Physics · Physics 2024-12-20 Jean Cazalis , Tirth Shah , Yahui Chai , Karl Jansen , Stefan Kühn

Bayesian Optimization (BO) has been widely applied to optimize expensive black-box functions while retaining sample efficiency. However, scaling BO to high-dimensional spaces remains challenging. Existing literature proposes performing…

Machine Learning · Computer Science 2025-08-27 Quanlin Chen , Yiyu Chen , Jing Huo , Tianyu Ding , Yang Gao , Yuetong Chen

Bayesian optimization is a sample-efficient method for finding a global optimum of an expensive-to-evaluate black-box function. A global solution is found by accumulating a pair of query point and its function value, repeating these two…

Machine Learning · Statistics 2020-06-17 Jungtaek Kim , Seungjin Choi

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

Machine Learning · Statistics 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

This work demonstrates the utility of gradients for the global optimization of certain differentiable functions with many suboptimal local minima. To this end, a principle for generating search directions from non-local quadratic…

Optimization and Control · Mathematics 2023-08-21 Nils Müller

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

Bayesian optimization (BO ) is an effective method for optimizing expensive-to-evaluate black-box functions. While high-dimensional problems can be particularly challenging, due to the multitude of parameter choices and the potentially high…

Machine Learning · Computer Science 2025-04-09 Erik Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

This paper derives various Hessians associated with Birkhoff-theoretic methods for trajectory optimization. According to a theorem proved in this paper, approximately 80% of the eigenvalues are contained in the narrow interval [-2, 4] for…

Optimization and Control · Mathematics 2025-11-19 I. M. Ross

A novel gradient stepsize is derived at the motivation of equipping the Barzilai-Borwein (BB) method with two dimensional quadratic termination property. A remarkable feature of the novel stepsize is that its computation only depends on the…

Optimization and Control · Mathematics 2021-01-12 Yakui Huang , Yu-Hong Dai , Xin-Wei Liu

Bayesian optimization is an effective method for optimizing expensive-to-evaluate black-box functions. High-dimensional problems are particularly challenging as the surrogate model of the objective suffers from the curse of dimensionality,…

Machine Learning · Computer Science 2023-10-06 Erik Orm Hellsten , Carl Hvarfner , Leonard Papenmeier , Luigi Nardi

This work concerns the global minimization of a prescribed eigenvalue or a weighted sum of prescribed eigenvalues of a Hermitian matrix-valued function depending on its parameters analytically in a box. We describe how the analytical…

Numerical Analysis · Mathematics 2016-05-11 Emre Mengi , Emre Alper Yildirim , Mustafa Kilic

The paper is devoted to the existence of global optimal solutions for a general class of nonsmooth problems of constrained vector optimization without boundedness assumptions on constraint sets. The main attention is paid to the two major…

Optimization and Control · Mathematics 2018-05-02 Do Sang Kim , Boris S. Mordukhovich , Tien-Son Pham , Nguyen Van Tuyen

Gaussian processes~(Kriging) are interpolating data-driven models that are frequently applied in various disciplines. Often, Gaussian processes are trained on datasets and are subsequently embedded as surrogate models in optimization…

Optimization and Control · Mathematics 2024-01-17 Artur M. Schweidtmann , Dominik Bongartz , Daniel Grothe , Tim Kerkenhoff , Xiaopeng Lin , Jaromil Najman , Alexander Mitsos

Many approaches for addressing Global Optimization problems typically rely on relaxations of nonlinear constraints over specific mathematical primitives. This is restricting in applications with constraints that are black-box, implicit or…

Optimization and Control · Mathematics 2025-01-03 Dimitris Bertsimas , Georgios Margaritis

Topology optimization of frame structures under free-vibration eigenvalue constraints constitutes a challenging nonconvex polynomial optimization problem with disconnected feasible sets. In this article, we first formulate it as a…

Optimization and Control · Mathematics 2025-09-08 Marek Tyburec , Michal Kočvara , Marouan Handa , Jan Zeman