English
Related papers

Related papers: A continuous perspective on the inertial corrected…

200 papers

In this paper, we develop a new asymmetric framework for solving primal-dual problems of Conic Optimization by Interior-Point Methods (IPMs). It allows development of efficient methods for problems, where the dual formulation is simpler…

Optimization and Control · Mathematics 2025-03-14 Yurii Nesterov

In this paper, we propose a novel Dual Inexact Splitting Algorithm (DISA) for distributed convex composite optimization problems, where the local loss function consists of a smooth term and a possibly nonsmooth term composed with a linear…

Optimization and Control · Mathematics 2023-04-25 Luyao Guo , Xinli Shi , Shaofu Yang , Jinde Cao

We propose a general proximal algorithm for the inversion of ill-conditioned matrices. This algorithm is based on a variational characterization of pseudo-inverses. We show that a particular instance of it (with constant regularization…

Numerical Analysis · Mathematics 2009-04-07 Pierre Maréchal , Aude Rondepierre

We consider the proximal-gradient method for minimizing an objective function that is the sum of a smooth function and a non-smooth convex function. A feature that distinguishes our work from most in the literature is that we assume that…

Optimization and Control · Mathematics 2022-11-07 Yutong Dai , Daniel P. Robinson

In this work, we consider a time-varying stochastic saddle point problem in which the objective is revealed sequentially, and the data distribution depends on the decision variables. Problems of this type express the distributional…

Optimization and Control · Mathematics 2022-12-07 Killian Wood , Emiliano Dall'Anese

Imaging tasks are typically tackled using a structured optimization framework. This paper delves into a class of algorithms for difference-of-convex (DC) structured optimization, focusing on minimizing a DC function along with a possibly…

Optimization and Control · Mathematics 2024-09-19 Tsz Ching Chow , Chaoyan Huang , Zhongming Wu , Tieyong Zeng , Angelica I. Aviles-Rivero

Recently, Krukier et al. [Generalized skew-Hermitian triangular splitting iteration methods for saddle-point linear systems, Numer. Linear Algebra Appl. 21 (2014) 152-170] proposed an efficient generalized skew-Hermitian triangular…

Numerical Analysis · Mathematics 2014-02-25 Yan Dou , Ai-Li Yang , Yu-Jiang Wu

We propose a novel continuous-time algorithm for inequality-constrained convex optimization inspired by proportional-integral control. Unlike the popular primal-dual gradient dynamics, our method includes a proportional term to control the…

Optimization and Control · Mathematics 2024-09-12 V. Cerone , S. M. Fosson , S. Pirrera , D. Regruto

We propose and analyze the convergence of a novel stochastic algorithm for solving monotone inclusions that are the sum of a maximal monotone operator and a monotone, Lipschitzian operator. The propose algorithm requires only unbiased…

Optimization and Control · Mathematics 2021-02-18 Nguyen Van Dung , Bang Cong Vu

We propose and analyze an accelerated iterative dual diagonal descent algorithm for the solution of linear inverse problems with general regularization and data-fit functions. In particular, we develop an inertial approach of which we…

Optimization and Control · Mathematics 2023-12-25 Luca Calatroni , Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

This paper presents a robust, distributed algorithm to solve general linear programs. The algorithm design builds on the characterization of the solutions of the linear program as saddle points of a modified Lagrangian function. We show…

Optimization and Control · Mathematics 2014-09-26 Dean Richert , Jorge Cortes

In this work, we consider strongly convex strongly concave (SCSC) saddle point (SP) problems $\min_{x\in\mathbb{R}^{d_x}}\max_{y\in\mathbb{R}^{d_y}}f(x,y)$ where $f$ is $L$-smooth, $f(.,y)$ is $\mu$-strongly convex for every $y$, and…

Optimization and Control · Mathematics 2022-02-22 Bugra Can , Mert Gurbuzbalaban , Necdet Serhat Aybat

We study a general convex optimization problem, which covers various classic problems in different areas and particularly includes many optimal transport related problems arising in recent years. To solve this problem, we revisit the…

Optimization and Control · Mathematics 2022-05-18 Lei Yang , Kim-Chuan Toh

This paper considers the robust phase retrieval problem, which can be cast as a nonsmooth and nonconvex optimization problem. We propose a new inexact proximal linear algorithm with the subproblem being solved inexactly. Our contributions…

Optimization and Control · Mathematics 2024-02-12 Zhong Zheng , Shiqian Ma , Lingzhou Xue

We consider a generic convex optimization problem associated with regularized empirical risk minimization of linear predictors. The problem structure allows us to reformulate it as a convex-concave saddle point problem. We propose a…

Optimization and Control · Mathematics 2015-09-10 Yuchen Zhang , Lin Xiao

We present the first method to directly use a learned continuous Lagrangian to forecast the dynamics of systems governed by partial differential equations, exploiting the inherent conservative structure to achieve stable long-range…

Machine Learning · Computer Science 2026-05-11 Lyra Zhornyak , Eric Forgoston , M. Ani Hsieh

We extend a primal-dual fixed point algorithm (PDFP) proposed in [5] to solve two kinds of separable multi-block minimization problems, arising in signal processing and imaging science. This work shows the flexibility of applying PDFP…

Optimization and Control · Mathematics 2016-02-02 Peijun Chen , Jianguo Huang , Xiaoqun Zhang

We develop two compression based stochastic gradient algorithms to solve a class of non-smooth strongly convex-strongly concave saddle-point problems in a decentralized setting (without a central server). Our first algorithm is a…

Machine Learning · Computer Science 2023-04-17 Chhavi Sharma , Vishnu Narayanan , P. Balamurugan

Perron's saddle-point method gives a way to find the complete asymptotic expansion of certain integrals that depend on a parameter going to infinity. We give two proofs of the key result. The first is a reworking of Perron's original proof,…

Classical Analysis and ODEs · Mathematics 2019-02-13 Cormac O'Sullivan

In this paper we consider the problem of finding the minimizations of the sum of two convex functions and the composition of another convex function with a continuous linear operator. With the idea of coordinate descent, we design a…

Optimization and Control · Mathematics 2016-04-15 Meng Wen , Shigang Yue , Yuchao Tang , Jigen Peng