English
Related papers

Related papers: On Well-Structured Convex-Concave Saddle Point Pro…

200 papers

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

A quadratically constrained quadratic program (QCQP) is an optimization problem in which the objective function is a quadratic function and the feasible region is defined by quadratic constraints. Solving non-convex QCQP to global…

Optimization and Control · Mathematics 2018-12-27 Asteroide Santana , Santanu S. Dey

This paper presents rigorous forward error bounds for linear conic optimization problems. The error bounds are formulated in a quite general framework; the underlying vector spaces are not required to be finite-dimensional, and the convex…

Optimization and Control · Mathematics 2007-07-31 Christian Jansson

This paper studies hidden convexity properties associated with constrained optimization problems over the set of rotation matrices $\text{SO}(n)$. Such problems are nonconvex due to the constraint $X \in \text{SO}(n)$. Nonetheless, we show…

Optimization and Control · Mathematics 2024-05-01 Akshay Ramachandran , Kevin Shu , Alex L. Wang

The Calder\'on problem consists in recovering an unknown coefficient of a partial differential equation from boundary measurements of its solution. These measurements give rise to a highly nonlinear forward operator. As a consequence, the…

Analysis of PDEs · Mathematics 2025-07-02 Giovanni S. Alberti , Romain Petit , Simone Sanna

We introduce a manifold-based framework for addressing optimization problems with equality and inequality constraints found in robotics. Our approach transforms the original problem into an unconstrained optimization problem directly on the…

Robotics · Computer Science 2026-05-21 Yetong Zhang , Frank Dellaert

In this paper we study the convex-concave saddle-point problem $\min_x \max_y f(x) + y^T \mathbf{A} x - g(y)$, where $f(x)$ and $g(y)$ are smooth and convex functions. We propose an Accelerated Primal-Dual Gradient Method (APDG) for solving…

Optimization and Control · Mathematics 2022-03-10 Dmitry Kovalev , Alexander Gasnikov , Peter Richtárik

In applications throughout science and engineering one is often faced with the challenge of solving an ill-posed inverse problem, where the number of available measurements is smaller than the dimension of the model to be estimated. However…

Optimization and Control · Mathematics 2012-10-30 Venkat Chandrasekaran , Benjamin Recht , Pablo A. Parrilo , Alan S. Willsky

We consider the problem of minimizing a linear function over an affine section of the cone of positive semidefinite matrices, with the additional constraint that the feasible matrix has prescribed rank. When the rank constraint is active,…

Systems and Control · Computer Science 2016-11-22 Simone Naldi

In this paper, we minimize the self-centered smoothed gap, a recently introduced optimality measure, in order to solve convex-concave saddle point problems. The self-centered smoothed gap can be computed as the sum of a convex, possibly…

Optimization and Control · Mathematics 2025-11-06 Olivier Fercoq

We consider the problem of minimizing a convex function over the intersection of finitely many simple sets which are easy to project onto. This is an important problem arising in various domains such as machine learning. The main difficulty…

Optimization and Control · Mathematics 2017-10-19 Achintya Kundu , Francis Bach , Chiranjib Bhattacharyya

Based on the needs of convergence proofs of preconditioned proximal point methods, we introduce notions of partial strong submonotonicity and partial (metric) subregularity of set-valued maps. We study relationships between these two…

Optimization and Control · Mathematics 2020-03-02 Tuomo Valkonen

Policy evaluation is a crucial step in many reinforcement-learning procedures, which estimates a value function that predicts states' long-term value under a given policy. In this paper, we focus on policy evaluation with linear function…

Machine Learning · Computer Science 2017-06-12 Simon S. Du , Jianshu Chen , Lihong Li , Lin Xiao , Dengyong Zhou

In this paper, we present novel randomized algorithms for solving saddle point problems whose dual feasible region is given by the direct product of many convex sets. Our algorithms can achieve an ${\cal O}(1/N)$ and ${\cal O}(1/N^2)$ rate…

Optimization and Control · Mathematics 2015-11-16 Cong Dang , Guanghui Lan

Gradient-based first-order convex optimization algorithms find widespread applicability in a variety of domains, including machine learning tasks. Motivated by the recent advances in fixed-time stability theory of continuous-time dynamical…

Machine Learning · Computer Science 2023-10-24 Mayank Baranwal , Param Budhraja , Vishal Raj , Ashish R. Hota

This paper addresses constrained smooth saddle-point problems in settings where projection onto the feasible sets is computationally expensive. We bridge the gap between projection-based and projection-free optimization by introducing a…

Optimization and Control · Mathematics 2026-04-02 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

Machine Learning · Statistics 2015-11-24 Zhanxing Zhu , Amos J. Storkey

We consider a class of infinite-dimensional optimization problems in which a distributed vector-valued variable should pointwise almost everywhere take values from a given finite set $\mathcal{M}\subset\mathbb{R}^m$. Such hybrid…

Optimization and Control · Mathematics 2021-11-09 Christian Clason , Carla Tameling , Benedikt Wirth

Operator convex functions defined on the positive half-line play a prominent role in the theory of quantum information, where they are used to define quantum $f$-divergences. Such functions admit integral representations in terms of…

Optimization and Control · Mathematics 2023-05-23 Oisín Faust , Hamza Fawzi

This paper discusses a special kind of convex constrained optimization problem, whose constraints consist of box inequalities and linear equalities. For this problem, in addition to general optimization algorithms such as exact penalty…

Optimization and Control · Mathematics 2020-04-21 Yue Sun