English
Related papers

Related papers: Stability for Constrained Minimax Optimization

200 papers

In this paper, we propose an improved numerical algorithm for solving minimax problems based on nonsmooth optimization, quadratic programming and iterative process. We also provide a rigorous proof of convergence for our algorithm under…

Artificial Intelligence · Computer Science 2025-07-02 Qing Xu , Xiaohua Xuan

This paper takes an initial step to systematically investigate the generalization bounds of algorithms for solving nonconvex-(strongly)-concave (NC-SC/NC-C) stochastic minimax optimization measured by the stationarity of primal functions.…

Optimization and Control · Mathematics 2023-02-08 Siqi Zhang , Yifan Hu , Liang Zhang , Niao He

We establish the stability under the formations of infimum and of convex combinations of subsolutions of convex Hamilton-Jacobi equations, some comparison and existence results for convex and coercive Hamilton-Jacobi equations with the…

Analysis of PDEs · Mathematics 2020-04-21 Hitoshi Ishii

Min-max problems have broad applications in machine learning, including learning with non-decomposable loss and learning with robustness to data distribution. Convex-concave min-max problem is an active topic of research with efficient…

Optimization and Control · Mathematics 2021-05-12 Hassan Rafique , Mingrui Liu , Qihang Lin , Tianbao Yang

We consider in this work the problem of minimizing the von Neumann entropy under the constraints that the density of particles, the current, and the kinetic energy of the system is fixed at each point of space. The unique minimizer is a…

Mathematical Physics · Physics 2019-10-29 Romain Duboscq , Olivier Pinaud

Motivated by recent increased interest in optimization algorithms for non-convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical…

This paper aims at developing two versions of the generalized Newton method to compute not merely arbitrary local minimizers of nonsmooth optimization problems but just those, which possess an important stability property known as tilt…

Optimization and Control · Mathematics 2021-01-01 Boris Mordukhovich , Ebrahim Sarabi

We present an optimization problem emerging from optimal control theory and situated at the intersection of fractional programming and linear max-min programming on polytopes. A na\"ive solution would require solving four nested, possibly…

Optimization and Control · Mathematics 2021-11-19 Jean-Baptiste Bouvier , Melkior Ornik

We consider the simplest optimal control problem with one nonregular mixed inequality constraint, i.e. when its gradient in the control can vanish on the zero surface. Using the Dubovitskii--Milyutin theorem on the approximate separation of…

Optimization and Control · Mathematics 2022-02-04 A. V. Dmitruk , N. P. Osmolovskii

Nowadays, L0 optimization model has shown its superiority when pursuing sparsity in many areas. For this nonconvex problem, most of the algorithms can only converge to one of its critical points. In this paper, we consider a general L0…

Optimization and Control · Mathematics 2019-12-11 Xue Feng , Chunlin Wu

This paper is devoted to the study of second order optimality conditions for strong local minimizers in the frameworks of unconstrained and constrained optimization problems in finite dimensions via subgradient graphical derivative. We…

Optimization and Control · Mathematics 2019-03-15 Nguyen Huy Chieu , Le Van Hien , Tran T. A. Nghia , Ha Anh Tuan

One of the key assumptions in the stability and convergence analysis of variational regularization is the ability of finding global minimizers. However, such an assumption is often not feasible when the regularizer is a black box or…

Optimization and Control · Mathematics 2023-07-05 Daniel Obmann , Markus Haltmeier

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

In this paper, an optimal consensus problem with local inequality constraints is studied for a network of single-integrator agents. The goal is that a group of single-integrator a gents rendezvous at the optimal point of the sum of local…

Dynamical Systems · Mathematics 2018-03-14 Amir Adibzadeh , Mohsen Zamani , Amir A. Suratgar , Mohammad B. Menhaj

In this paper, a robust sequential quadratic programming method for constrained optimization is generalized to problem with an {expectation} objective function {and} deterministic equality and inequality constraints. A stochastic line…

Optimization and Control · Mathematics 2024-10-07 Songqiang Qiu , Vyacheslav Kungurtsev

Approximations of optimization problems arise in computational procedures and sensitivity analysis. The resulting effect on solutions can be significant, with even small approximations of components of a problem translating into large…

Optimization and Control · Mathematics 2022-08-10 Johannes O. Royset

In this paper, we study local well-posedness and orbital stability of standing waves for a singularly perturbed one-dimensional nonlinear Klein-Gordon equation. We first establish local well-posedness of the Cauchy problem by a fixed point…

Analysis of PDEs · Mathematics 2019-11-12 Elek Csobo , François Genoud , Masahito Ohta , Julien Royer

Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an…

Optimization and Control · Mathematics 2022-10-31 Alberto De Marchi

The concept of convex compactness, weaker than the classical notion of compactness, is introduced and discussed. It is shown that a large class of convex subsets of topological vector spaces shares this property and that is can be used in…

Functional Analysis · Mathematics 2010-06-02 Gordan Zitkovic

Constrained quasiconvex optimization problems appear in many fields, such as economics, engineering, and management science. In particular, fractional programming, which models ratio indicators such as the profit/cost ratio as fractional…

Optimization and Control · Mathematics 2019-09-02 Kazuhiro Hishinuma , Hideaki Iiduka