English
Related papers

Related papers: A Simple Novel Global Optimization Algorithm and I…

200 papers

Global optimization of black-box functions from noisy samples is a fundamental challenge in machine learning and scientific computing. Traditional methods such as Bayesian Optimization often converge to local minima on multi-modal…

Machine Learning · Computer Science 2026-04-07 Qusay Muzaffar , David Levin , Michael Werman

Finding global optima in high-dimensional optimization problems is extremely challenging since the number of function evaluations required to sufficiently explore the search space increases exponentially with its dimensionality.…

Machine Learning · Computer Science 2022-11-04 Julian F. Schumann , Alejandro M. Aragón

We study the problem of minimizing a convex function on a nonempty, finite subset of the integer lattice when the function cannot be evaluated at noninteger points. We propose a new underestimator that does not require access to…

Optimization and Control · Mathematics 2021-08-19 Jeffrey Larson , Sven Leyffer , Prashant Palkar , Stefan M. Wild

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

This paper introduces a numerical method to enclose the global minimum of a nonlinear function subject to simple bounds on the variables. Using interval analysis, coupled with the computational power and architecture of graphics processing…

Numerical Analysis · Mathematics 2026-04-15 Guanglu Zhang , Qihang Shan , Jonathan Cagan

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

Optimization and Control · Mathematics 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant

We consider the global minimization of smooth functions based solely on function evaluations. Algorithms that achieve the optimal number of function evaluations for a given precision level typically rely on explicitly constructing an…

Optimization and Control · Mathematics 2020-12-23 Alessandro Rudi , Ulysse Marteau-Ferey , Francis Bach

In this paper, we analyze some theoretical properties of the problem of minimizing a quadratic function with a cubic regularization term, arising in many methods for unconstrained and constrained optimization that have been proposed in the…

Optimization and Control · Mathematics 2018-09-05 Andrea Cristofari , Tayebeh Dehghan Niri , Stefano Lucidi

This paper considers global optimization with a black-box unknown objective function that can be non-convex and non-differentiable. Such a difficult optimization problem arises in many real-world applications, such as parameter tuning in…

Optimization and Control · Mathematics 2016-07-19 Kenji Kawaguchi , Yu Maruyama , Xiaoyu Zheng

In this paper, a sequential search method for finding the global minimum of an objective function is presented, The descent gradient search is repeated until the global minimum is obtained. The global minimum is located by a process of…

Optimization and Control · Mathematics 2024-02-06 Mohamed Tifroute , Anouar Lahmdani , Hassane Bouzahir

A new algorithm for one-dimensional minimization is described in detail and the results of some tests on practical cases are reported and illustrated. The method requires only punctual computation of the function, and is suitable to be…

Optimization and Control · Mathematics 2017-08-24 Glauco Masotti

In practice, objective functions of real-time control systems can have multiple local minimums or can dramatically change over the function space, making them hard to optimize. To efficiently optimize such systems, in this paper, we develop…

Optimization and Control · Mathematics 2022-01-26 Haowei Wang , Songhao Wang , Qun Meng , Szu Hui Ng

Global optimization problems whose objective function is expensive to evaluate can be solved effectively by recursively fitting a surrogate function to function samples and minimizing an acquisition function to generate new samples. The…

Machine Learning · Computer Science 2020-01-10 Alberto Bemporad

Efficient global optimization is the problem of minimizing an unknown function f, using as few evaluations f(x) as possible. It can be considered as a continuum-armed bandit problem, with noiseless data and simple regret. Expected…

Machine Learning · Statistics 2013-02-19 Adam D. Bull

Numerous applications require algorithms that can align partially overlapping point sets while maintaining invariance to geometric transformations (e.g., similarity, affine, rigid). This paper introduces a novel global optimization method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wei Lian , Zhesen Cui , Fei Ma , Hang Pan , Wangmeng Zuo , Jianmei Zhang

We consider the global minimization of a particular type of minimum structured optimization problems wherein the variables must belong to some basic set, the feasible domain is described by the intersection of a large number of functional…

Optimization and Control · Mathematics 2024-12-09 Guillaume Van Dessel , François Glineur

We propose a new globalization strategy that can be used in unconstrained optimization algorithms to support rapid convergence from remote starting points. Our approach is based on using multiple points at each iteration to build a…

Optimization and Control · Mathematics 2017-05-16 Figen Öztoprak , Ş. İlker Birbil

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

We consider the problem of estimating a good maximizer of a black-box function given noisy examples. To solve such problems, we propose to fit a new type of function which we call a global optimization network (GON), defined as any…

Machine Learning · Statistics 2022-02-04 Sen Zhao , Erez Louidor , Olexander Mangylov , Maya Gupta

We study the limit computability of finding a global optimum of a continuous function. We give a short proof to show that the problem of checking whether a point is a global minimum is not limit computable. Thereby showing the same for the…

Optimization and Control · Mathematics 2019-09-09 K. Lakshmanan
‹ Prev 1 2 3 10 Next ›