English
Related papers

Related papers: Acceleration of univariate global optimization alg…

200 papers

A global optimization problem is studied where the objective function $f(x)$ is a multidimensional black-box function and its gradient $f'(x)$ satisfies the Lipschitz condition over a hyperinterval with an unknown Lipschitz constant $K$.…

Optimization and Control · Mathematics 2013-07-17 Dmitri E. Kvasov , Yaroslav D. Sergeyev

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

We introduce in this paper an optimal first-order method that allows an easy and cheap evaluation of the local Lipschitz constant of the objective's gradient. This constant must ideally be chosen at every iteration as small as possible,…

Optimization and Control · Mathematics 2012-07-18 Michel Baes , Michael Buergisser

In the paper, the global optimization problem of a multidimensional "black-box" function satisfying the Lipschitz condition over a hyperinterval with an unknown Lipschitz constant is considered. A new efficient algorithm for solving this…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Dmitri E. Kvasov

We present two first-order, sequential optimization algorithms to solve constrained optimization problems. We consider a black-box setting with a priori unknown, non-convex objective and constraint functions that have Lipschitz continuous…

Optimization and Control · Mathematics 2020-11-19 Abraham P. Vinod , Arie Israel , Ufuk Topcu

The goal of the paper is to design sequential strategies which lead to efficient optimization of an unknown function under the only assumption that it has a finite Lipschitz constant. We first identify sufficient conditions for the…

Machine Learning · Statistics 2017-06-19 Cédric Malherbe , Nicolas Vayatis

Lipschitz one-dimensional constrained global optimization (GO) problems where both the objective function and constraints can be multiextremal and non-differentiable are considered in this paper. Problems, where the constraints are verified…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev , Dmitri E. Kvasov , Falah M. H. Khalaf

In this paper, Lipschitz univariate constrained global optimization problems where both the objective function and constraints can be multiextremal are considered. The constrained problem is reduced to a discontinuous unconstrained problem…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Domenico Famularo , Paolo Pugliese

In this paper, global optimization (GO) Lipschitz problems are considered where the multi-dimensional multiextremal objective function is determined over a hyperinterval. An efficient one-dimensional GO method using local tuning on the…

Optimization and Control · Mathematics 2011-03-21 Dmitri E. Kvasov , Clara Pizzuti , Yaroslav D. Sergeyev

In this paper, the global optimization problem $\min_{y\in S} F(y)$ with $S$ being a hyperinterval in $\Re^N$ and $F(y)$ satisfying the Lipschitz condition with an unknown Lipschitz constant is considered. It is supposed that the function…

Optimization and Control · Mathematics 2015-09-14 Daniela Lera , Yaroslav D. Sergeyev

Multidimensional optimization problems where the objective function and the constraints are multiextremal non-differentiable Lipschitz functions (with unknown Lipschitz constants) and the feasible region is a finite collection of robust…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Paolo Pugliese , Domenico Famularo

This work presents a universal accelerated first-order primal-dual method for affinely constrained convex optimization problems. It can handle both Lipschitz and H\"{o}lder gradients but does not need to know the smoothness level of the…

Optimization and Control · Mathematics 2022-11-09 Hao Luo

In many practical decision-making problems it happens that functions involved in optimization process are black-box with unknown analytical representations and hard to evaluate. In this paper, a global optimization problem is considered…

Optimization and Control · Mathematics 2015-09-16 Yaroslav D. Sergeyev , Dmitri E. Kvasov

We propose an accelerated meta-algorithm, which allows to obtain accelerated methods for convex unconstrained minimization in different settings. As an application of the general scheme we propose nearly optimal methods for minimizing…

The necessity to find the global optimum of multiextremal functions arises in many applied problems where finding local solutions is insufficient. One of the desirable properties of global optimization methods is \emph{strong homogeneity}…

Optimization and Control · Mathematics 2018-01-17 Yaroslav D. Sergeyev , Dmitri E. Kvasov , Marat S. Mukhametzhanov

We propose a new framework to design and analyze accelerated methods that solve general monotone equation (ME) problems $F(x)=0$. Traditional approaches include generalized steepest descent methods and inexact Newton-type methods. If $F$ is…

Optimization and Control · Mathematics 2024-07-22 Tianyi Lin , Michael. I. Jordan

Iteration complexities for optimizing smooth functions with first-order algorithms are typically stated in terms of a global Lipschitz constant of the gradient, and near-optimal results are then achieved using fixed step sizes. But many…

Optimization and Control · Mathematics 2026-05-19 Curtis Fox , Aaron Mishkin , Sharan Vaswani , Mark Schmidt

In this paper, a new theory is developed for first-order stochastic convex optimization, showing that the global convergence rate is sufficiently quantified by a local growth rate of the objective function in a neighborhood of the optimal…

Optimization and Control · Mathematics 2020-05-07 Yi Xu , Qihang Lin , Tianbao Yang

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

This study presents an effective global optimization technique designed for multivariate functions that are H\"older continuous. Unlike traditional methods that construct lower bounding proxy functions, this algorithm employs a…

Machine Learning · Computer Science 2023-03-28 Kaan Gokcesu , Hakan Gokcesu
‹ Prev 1 2 3 10 Next ›