English
Related papers

Related papers: Local Optimality Conditions for a Class of Hidden …

200 papers

The main purpose of this research note is to show that the triality theory can always be used to identify both global minimizer and the biggest local maximizer in global optimization. An open problem left on the double-min duality is solved…

Mathematical Physics · Physics 2011-10-04 Daniel Morales-Silva , David Yang Gao

A major obstacle to non-convex optimization is the problem of getting stuck in local minima. We introduce a novel metaheuristic to handle this issue, creating an alternate Hamiltonian that shares minima with the original Hamiltonian only…

Disordered Systems and Neural Networks · Physics 2022-06-29 Anuj Apte , Kunal Marwaha , Arvind Murugan

Constrained Optimum Path (COP) problems appear in many real-life applications, especially on communication networks. Some of these problems have been considered and solved by specific techniques which are usually difficult to extend. In…

Artificial Intelligence · Computer Science 2009-10-08 Quang Dung Pham , Yves Deville , Pascal Van Hentenryck

We study the oracle complexity of nonsmooth nonconvex optimization, with the algorithm assumed to have access only to local function information. It has been shown by Davis, Drusvyatskiy, and Jiang (2023) that for nonsmooth Lipschitz…

Optimization and Control · Mathematics 2024-09-17 Guy Kornowski , Swati Padmanabhan , Ohad Shamir

In the past several years, there have been several representative attitude determination methods developed using derivative-based optimization algorithms. Optimization techniques e.g. gradient-descent algorithm (GDA), Gauss-Newton algorithm…

Systems and Control · Computer Science 2019-10-01 Jin Wu , Zebo Zhou , Min Song

We provide a framework for computing the exact worst-case performance of any algorithm belonging to a broad class of oracle-based first-order methods for composite convex optimization, including those performing explicit, projected,…

Optimization and Control · Mathematics 2019-11-22 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

This article presents a new method for computing guaranteed convex and concave relaxations of nonlinear stochastic optimal control problems with final-time expected-value cost functions. This method is motivated by similar methods for…

Optimization and Control · Mathematics 2017-11-27 Yuanxun Shao , Dillard Robertson , Joseph Kirk Scott

This paper presents a Successive Convexification ($ \texttt{SCvx} $) algorithm to solve a class of non-convex optimal control problems with certain types of state constraints. Sources of non-convexity may include nonlinear dynamics and…

Optimization and Control · Mathematics 2017-10-23 Yuanqi Mao , Daniel Dueri , Michael Szmuk , Behçet Açıkmeşe

Bilevel optimization has witnessed a resurgence of interest, driven by its critical role in trustworthy and efficient AI applications. While many recent works have established convergence to stationary points or local minima, obtaining the…

Optimization and Control · Mathematics 2024-12-25 Quan Xiao , Tianyi Chen

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

Optimization and Control · Mathematics 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

We study a class of polynomial optimization problems with a robust polynomial matrix inequality (PMI) constraint where the uncertainty set itself is defined also by a PMI. These can be viewed as matrix generalizations of semi-infinite…

Optimization and Control · Mathematics 2024-10-10 Feng Guo , Jie Wang

When searching for global optima of nonconvex unconstrained optimization problems, it is desirable that every local minimum be a global minimum. This property of having no spurious local minima is true in various problems of interest…

Optimization and Control · Mathematics 2023-11-16 Cédric Josz , Xiaopeng Li

In this paper, we study some optimization problems in uniformly convex and uniformly smooth Bochner spaces. We consider four cases of the underlying subsets: closed and convex subsets, closed and convex cones, closed subspaces and closed…

Optimization and Control · Mathematics 2023-03-30 Shuting Ai , Jinlu Li

We consider Constrained Online Convex Optimization (COCO) with adversarially chosen constraints. At each round, the learner chooses an action before observing the loss and constraint function for that round. The goal is to achieve small…

Machine Learning · Computer Science 2026-05-21 Dhruv Sarkar , Abhishek Sinha

This work proposes a safety-critical local reactive controller that enables the robot to navigate in unknown and cluttered environments. In particular, the trajectory tracking task is formulated as a constrained polynomial optimization…

Robotics · Computer Science 2023-10-10 Yulin Li , Xindong Tang , Kai Chen , Chunxin Zheng , Haichao Liu , Jun Ma

The trust region subproblem (TRS) is to minimize a possibly nonconvex quadratic function over a Euclidean ball. There are typically two cases for (TRS), the so-called ``easy case'' and ``hard case''. Even in the ``easy case'', the sequence…

Optimization and Control · Mathematics 2022-07-13 Mengmeng Song , Yong Xia , Jinyang Zheng

We address the problem of multiple local optima arising due to non-convex objective functions in cooperative multi-agent optimization problems. To escape such local optima, we propose a systematic approach based on the concept of boosting…

Optimization and Control · Mathematics 2020-07-16 Shirantha Welikala , Christos G. Cassandras

We consider the problem of stochastic convex optimization with exp-concave losses using Empirical Risk Minimization in a convex class. Answering a question raised in several prior works, we provide a $O( d / n + \log( 1 / \delta) / n )$…

Machine Learning · Computer Science 2023-07-06 Nikita Puchkin , Nikita Zhivotovskiy

The optimization problem behind neural networks is highly non-convex. Training with stochastic gradient descent and variants requires careful parameter tuning and provides no guarantee to achieve the global optimum. In contrast we show…

Machine Learning · Computer Science 2016-10-31 Antoine Gautier , Quynh Nguyen , Matthias Hein

Discrete-time robust optimal control problems generally take a min-max structure over continuous variable spaces, which can be difficult to solve in practice. In this paper, we extend the class of such problems that can be solved through a…

Optimization and Control · Mathematics 2024-04-30 Jad Wehbeh , Eric C. Kerrigan