English
Related papers

Related papers: Index Branch-and-Bound Algorithm for Global Optimi…

200 papers

In this paper, global optimization (GO) Lipschitz problems are considered where the multi-dimensional multiextremal objective function is determined over a hyperinterval. An efficient one-dimensional GO method using local tuning on the…

Optimization and Control · Mathematics 2011-03-21 Dmitri E. Kvasov , Clara Pizzuti , Yaroslav D. Sergeyev

A global optimization problem is studied where the objective function $f(x)$ is a multidimensional black-box function and its gradient $f'(x)$ satisfies the Lipschitz condition over a hyperinterval with an unknown Lipschitz constant $K$.…

Optimization and Control · Mathematics 2013-07-17 Dmitri E. Kvasov , Yaroslav D. Sergeyev

We propose two algorithms for solving global optimization problems on a hyperrectangle with an objective function satisfying the Vanderbei condition (this function is also called an $\varepsilon$-Lipschitz continuous function). The…

Optimization and Control · Mathematics 2024-02-20 Natalya Arutyunova , Aidar Dulliev , Vladislav Zabotin

We present a novel method for mixed-integer optimization problems with multivariate and Lipschitz continuous nonlinearities. In particular, we do not assume that the nonlinear constraints are explicitly given but that we can only evaluate…

Optimization and Control · Mathematics 2023-03-22 Julia Grübel , Richard Krug , Martin Schmidt , Winnifried Wollner

For most optimisation methods an essential assumption is the vector space structure of the feasible set. This condition is not fulfilled if we consider optimisation problems over the sphere. We present an algorithm for solving a special…

Computation · Statistics 2018-02-27 Gabriele Eichfelder , Thomas Hotz , Johannes Wieditz

We investigate robust optimization problems defined for maximizing convex functions. For finite uncertainty set, we develop a geometric branch-and-bound algorithmic approach to solve this problem. The geometric branch-and-bound algorithm…

Optimization and Control · Mathematics 2019-11-21 Fengqiao Luo , Sanjay Mehrotra

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

This paper describes an approximate method for global optimization of polynomial programming problems with bounded variables. The method uses a reformulation and linearization technique to transform the original polynomial optimization…

Optimization and Control · Mathematics 2012-05-30 Joseph W. Norman

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

A new pattern search method for bound constrained optimization is introduced. The proposed algorithm employs the coordinate directions, in a suitable way, with a nonmonotone line search for accepting the new iterate, without using…

Optimization and Control · Mathematics 2018-06-25 Johanna A. Frau , Elvio A. Pilotta

A multiscale optimization framework for problems over a space of Lipschitz continuous functions is developed. The method solves a coarse-grid discretization followed by linear interpolation to warm-start project gradient descent on…

Numerical Analysis · Mathematics 2026-03-05 Nicholas J. E. Richardson , Noah Marusenko , Michael P. Friedlander

Branch and bound algorithms have to cope with several additional difficulties in the multi-objective case. Not only the bounding procedure is considerably weaker, but also the handling of upper and lower bound sets requires much more…

Optimization and Control · Mathematics 2023-11-13 Julius Bauß , Michael Stiglmayr

Recently, a new class of non-convex optimization problems motivated by the statistical problem of learning an acyclic directed graphical model from data has attracted significant interest. While existing work uses standard first-order…

Machine Learning · Computer Science 2023-07-03 Chang Deng , Kevin Bello , Bryon Aragam , Pradeep Ravikumar

We derive novel algorithms for optimization problems constrained by partial differential equations describing multiscale particle dynamics, including non-local integral terms representing interactions between particles. In particular, we…

Numerical Analysis · Mathematics 2021-09-09 Mildred Aduamoah , Benjamin D. Goddard , John W. Pearson , Jonna C. Roden

With the advancement of modern applications, an increasing number of composite optimization problems arise whose smooth component does not possess a globally Lipschitz continuous gradient. This setting prevents the direct use of the…

Optimization and Control · Mathematics 2026-05-11 Lei Yang , Jingjing Hu , Tianxiang Liu

We propose a single time-scale stochastic subgradient method for constrained optimization of a composition of several nonsmooth and nonconvex functions. The functions are assumed to be locally Lipschitz and differentiable in a generalized…

Optimization and Control · Mathematics 2020-12-22 Andrzej Ruszczynski

Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain because the feasible set is a non-smooth and non-convex algebraic variety. Existing techniques include projected gradient descent, fixed-rank…

Optimization and Control · Mathematics 2024-06-21 Quentin Rebjock , Nicolas Boumal

In this work, we propose a computationally efficient algorithm for the problem of global optimization in univariate loss functions. For the performance evaluation, we study the cumulative regret of the algorithm instead of the simple regret…

Machine Learning · Computer Science 2022-01-19 Kaan Gokcesu , Hakan Gokcesu

We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…

Optimization and Control · Mathematics 2026-03-31 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu