English
Related papers

Related papers: Optimality Conditions for Constrained Minimax Opti…

200 papers

This paper defines a convertible nonconvex function(CN function for short) and a weak (strong) uniform (decomposable, exact) CN function, proves the optimization conditions for their global solutions and proposes algorithms for solving the…

Optimization and Control · Mathematics 2022-02-16 M. Jiang , R. Shen , Z. Q. Meng , C. Y. Dang

The optimal allocation of resources for maximizing influence, spread of information or coverage, has gained attention in the past years, in particular in machine learning and data mining. But in applications, the parameters of the problem…

Machine Learning · Computer Science 2017-06-14 Matthew Staib , Stefanie Jegelka

In this paper, we focus on the nonconvex-strongly-concave minimax optimization problem (MCC), where the inner maximization subproblem contains constraints that couple the primal variable of the outer minimization problem. We prove that by…

Optimization and Control · Mathematics 2024-09-02 Xiaoyin Hu , Kim-Chuan Toh , Shiwei Wang , Nachuan Xiao

We analyze the local convergence of proximal splitting algorithms to solve optimization problems that are convex besides a rank constraint. For this, we show conditions under which the proximal operator of a function involving the rank…

Optimization and Control · Mathematics 2018-11-12 Christian Grussler , Pontus Giselsson

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

Optimization and Control · Mathematics 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

Partial calmness is a celebrated but restrictive property of bilevel optimization problems whose presence opens a way to the derivation of Karush--Kuhn--Tucker-type necessary optimality conditions in order to characterize local minimizers.…

Optimization and Control · Mathematics 2020-06-30 Patrick Mehlitz , Leonid I. Minchenko , Alain B. Zemkoho

Bilevel optimization has witnessed a resurgence of interest, driven by its critical role in trustworthy and efficient AI applications. While many recent works have established convergence to stationary points or local minima, obtaining the…

Optimization and Control · Mathematics 2024-12-25 Quan Xiao , Tianyi Chen

Necessary optimality conditions in Lagrangian form and the sequential minimization framework are extended to mixed-integer nonlinear optimization, without any convexity assumptions. Building upon a recently developed notion of local…

Optimization and Control · Mathematics 2026-04-10 Alberto De Marchi

We present a unified study of first and second order necessary and sufficient optimality conditions for minimax and Chebyshev optimisation problems with cone constraints. First order optimality conditions for such problems can be formulated…

Optimization and Control · Mathematics 2021-02-03 M. V. Dolgopolik

This paper considers decentralized optimization of convex functions with mixed affine equality constraints involving both local and global variables. Constraints on global variables may vary across different nodes in the network, while…

Optimization and Control · Mathematics 2026-02-05 Demyan Yarmoshik , Nhat Trung Nguyen , Alexander Rogozin , Alexander Gasnikov

This work proposes an implementable proximal-type method for a broad class of optimization problems involving nonsmooth and nonconvex objective and constraint functions. In contrast to existing methods that rely on an ad hoc model…

Optimization and Control · Mathematics 2024-09-26 Gregorio M. Sempere , Welington de Oliveira , Johannes O. Royset

Given a non-convex optimization problem, we study conditions under which every Karush-Kuhn-Tucker (KKT) point is a global optimizer. This property is known as KT-invexity and allows to identify the subset of problems where an interior point…

Optimization and Control · Mathematics 2017-07-07 Ksenia Bestuzheva , Hassan Hijazi

The paper introduces several new concepts for solving nonconvex or nonsmooth optimization problems, including convertible nonconvex function, exact convertible nonconvex function and differentiable convertible nonconvex function. It is…

Optimization and Control · Mathematics 2022-01-13 Min Jiang , Rui Shen , Zhiqing Meng , Chuangyin Dang

We address the problem of finding a local solution to a nonconvex-nonconcave minmax optimization using Newton type methods, including interior-point ones. We modify the Hessian matrix of these methods such that, at each step, the modified…

Optimization and Control · Mathematics 2024-02-13 Raphael Chinchilla , Guosong Yang , Joao P. Hespanha

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

In this note, we focus on smooth nonconvex optimization problems that obey: (1) all local minimizers are also global; and (2) around any saddle point or local maximizer, the objective has a negative directional curvature. Concrete…

Optimization and Control · Mathematics 2016-04-26 Ju Sun , Qing Qu , John Wright

In this paper convex optimization techniques are employed for convex optimization problems in infinite dimensional Hilbert spaces. A first order optimality condition is given. Let $f : \mathbb{R}^{n}\rightarrow \mathbb{R}$ and let $x\in…

Functional Analysis · Mathematics 2019-03-26 Benard Okelo

A strategy is proposed for characterizing the worst-case performance of algorithms for solving nonconvex smooth optimization problems. Contemporary analyses characterize worst-case performance by providing, under certain assumptions on an…

Optimization and Control · Mathematics 2018-08-28 Frank E. Curtis , Daniel P. Robinson

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non-convex constraint set introduced by model parameterization.…

Machine Learning · Computer Science 2020-04-21 Yongqiang Cai , Qianxiao Li , Zuowei Shen

In this paper, an optimal consensus problem with local inequality constraints is studied for a network of single-integrator agents. The goal is that a group of single-integrator a gents rendezvous at the optimal point of the sum of local…

Dynamical Systems · Mathematics 2018-03-14 Amir Adibzadeh , Mohsen Zamani , Amir A. Suratgar , Mohammad B. Menhaj