English
Related papers

Related papers: An augmented filled function for global nonlinear …

200 papers

In this paper, we study the problem of finding the global minima of a given function. Specifically, we consider complicated functions with numerous local minima, as is often the case for real-world data mining losses. We do so by applying a…

Neural and Evolutionary Computing · Computer Science 2025-11-20 Simon Klüttermann

We propose and analyze asymptotic proximal point (APP) methods to find the global minimizer for a class of nonconvex, nonsmooth, or even discontinuous multiple minima functions. The method is based on an asymptotic representation of…

Optimization and Control · Mathematics 2020-12-23 Xiaopeng Luo , Xin Xu , Herschel A. Rabitz

We prove that the finite-difference based derivative-free descent (FD-DFD) methods have a capability to find the global minima for a class of multiple minima problems. Our main result shows that, for a class of multiple minima objectives…

Optimization and Control · Mathematics 2020-06-26 Xiaopeng Luo , Xin Xu , Daoyi Dong

The aim of global optimization is to find the global optimum of arbitrary classes of functions, possibly highly multimodal ones. In this paper we focus on the subproblem of global optimization for differentiable functions and we propose an…

Neural and Evolutionary Computing · Computer Science 2018-06-18 Louis Faury , Flavian Vasile , Clément Calauzènes , Olivier Fercoq

This paper proposes a novel technique called "successive stochastic smoothing" that optimizes nonsmooth and discontinuous functions while considering various constraints. Our methodology enables local and global optimization, making it a…

Optimization and Control · Mathematics 2023-08-17 Vladimir Norkin , Alois Pichler , Anton Kozyriev

This paper presents and investigates an inexact proximal gradient method for solving composite convex optimization problems characterized by an objective function composed of a sum of a full-domain differentiable convex function and a…

Optimization and Control · Mathematics 2025-04-16 Yunier Bello-Cruz , Max L. N. Gonçalves , Jefferson G. Melo , Cassandra Mohr

We present a practical and powerful new framework for both unconstrained and constrained submodular function optimization based on discrete semidifferentials (sub- and super-differentials). The resulting algorithms, which repeatedly compute…

Data Structures and Algorithms · Computer Science 2013-08-13 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

A gradient-free deterministic method is developed to solve global optimization problems for Lipschitz continuous functions defined in arbitrary path-wise connected compact sets in Euclidean spaces. The method can be regarded as granular…

Optimization and Control · Mathematics 2021-07-15 Tao Qian , Lei Dai , Liming Zhang , Zehua Chen

There is a recent surge of interest in nonconvex reformulations via low-rank factorization for stochastic convex semidefinite optimization problem in the purpose of efficiency and scalability. Compared with the original convex formulations,…

Optimization and Control · Mathematics 2018-02-27 Jinshan Zeng , Ke Ma , Yuan Yao

This paper addresses the study of derivative-free smooth optimization problems, where the gradient information on the objective function is unavailable. Two novel general derivative-free methods are proposed and developed for minimizing…

Optimization and Control · Mathematics 2023-11-29 Pham Duy Khanh , Boris S. Mordukhovich , Dat Ba Tran

Due to the increasing demand for high performance and cost reduction within the framework of complex system design, numerical optimization of computationally costly problems is an increasingly popular topic in most engineering fields. In…

Optimization and Control · Mathematics 2018-06-12 Julien Pelamatti , Loïc Brevault , Mathieu Balesdent , El-Ghazali Talbi , Yannick Guerin

The paper proposes a new algorithm for solving global univariate optimization problems. The algorithm does not require convexity of the target function. For a broad variety of target functions after performing (if necessary) several…

Optimization and Control · Mathematics 2016-01-26 Sergey Nikitin

We study the problem of minimizing a convex function on a nonempty, finite subset of the integer lattice when the function cannot be evaluated at noninteger points. We propose a new underestimator that does not require access to…

Optimization and Control · Mathematics 2021-08-19 Jeffrey Larson , Sven Leyffer , Prashant Palkar , Stefan M. Wild

Contemporary global optimization algorithms are based on local measures of utility, rather than a probability measure over location and value of the optimum. They thus attempt to collect low function values, not to learn about the optimum.…

Machine Learning · Statistics 2011-12-07 Philipp Hennig , Christian J. Schuler

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

This paper establishes a strict mathematical relationship between an arbitrary continuous function on a compact set and its global minima, like the well-known first order optimality condition for convex and differentiable functions. By…

Optimization and Control · Mathematics 2019-05-27 Xiaopeng Luo

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

Optimization and Control · Mathematics 2017-07-18 Ion Matei , John S. Baras

Non-convex optimization problems have multiple local optimal solutions. Non-convex optimization problems are commonly found in numerous applications. One of the methods recently proposed to efficiently explore multiple local optimal…

Optimization and Control · Mathematics 2022-01-31 Mohamed Tarek , Yijiang Huang

We consider solving nonconvex composite optimization problems in which the sum of a smooth function and a nonsmooth function is minimized. Many of convergence analyses of proximal gradient-type methods rely on global descent property…

Optimization and Control · Mathematics 2026-04-09 Shotaro Yagishita , Masaru Ito

In this paper, we analyze some theoretical properties of the problem of minimizing a quadratic function with a cubic regularization term, arising in many methods for unconstrained and constrained optimization that have been proposed in the…

Optimization and Control · Mathematics 2018-09-05 Andrea Cristofari , Tayebeh Dehghan Niri , Stefano Lucidi