English
Related papers

Related papers: An Inexact Interior-Point Lagrangian Decomposition…

200 papers

In this paper, we present an efficient semismooth Newton method, named SSNCP, for solving a class of semidefinite programming problems. Our approach is rooted in an equivalent semismooth system derived from the saddle point problem induced…

Optimization and Control · Mathematics 2025-04-24 Zhanwang Deng , Jiang Hu , Kangkang Deng , Zaiwen Wen

Nonlinear inverse problems often trade inexpensive but fragile first-order updates against curvature-aware methods such as Gauss-Newton and Levenberg-Marquardt, which obtain stronger directions by repeatedly solving Jacobian-based…

Machine Learning · Computer Science 2026-05-14 Aaditya L. Kachhadiya

In this paper we present an inexact proximal point method for variational inequality problem on Hadamard manifolds and study its convergence properties. The proposed algorithm is inexact in two sense. First, each proximal subproblem is…

Optimization and Control · Mathematics 2021-03-04 G. C. Bento , O. P. Ferreira , E. A. Papa Quiroz

We consider minimization of the sum of a large number of convex functions, and we propose an incremental aggregated version of the proximal algorithm, which bears similarity to the incremental aggregated gradient and subgradient methods…

Systems and Control · Computer Science 2015-11-05 Dimitri P. Bertsekas

This paper is devoted to the study of an inertial accelerated primal-dual algorithm, which is based on a second-order differential system with time scaling, for solving a non-smooth convex optimization problem with linear equality…

Optimization and Control · Mathematics 2026-04-30 Huan Zhang , Xiangkai Sun , Shengjie Li , Kok Lay Teo

We propose a new primal-dual splitting method for solving composite inclusions involving Lipschitzian, and parallel-sum-type monotone operators. Our approach extends the framework in \cite{Siopt4} to a more general class of monotone…

Optimization and Control · Mathematics 2015-07-28 Quoc Tran-Dinh , Bang Cong Vu

Ill-posed linear inverse problems (ILIP), such as restoration and reconstruction, are a core topic of signal/image processing. A standard approach to deal with ILIP uses a constrained optimization problem, where a regularization function is…

Optimization and Control · Mathematics 2016-11-15 Manya V. Afonso , Jose M. Bioucas-Dias , Mario A. T. Figueiredo

Recently, saddle point problems have received much attention due to their powerful modeling capability for a lot of problems from diverse domains. Applications of these problems occur in many applied areas, such as robust optimization,…

Optimization and Control · Mathematics 2022-02-15 Mohammad Alkousa , Alexander Gasnikov , Pavel Dvurechensky , Abdurakhmon Sadiev , Lama Razouk

We develop a novel primal-dual algorithm to solve a class of nonsmooth and nonlinear compositional convex minimization problems, which covers many existing and brand-new models as special cases. Our approach relies on a combination of a new…

Optimization and Control · Mathematics 2021-04-20 Yuzixuan Zhu , Deyi Liu , Quoc Tran-Dinh

We introduce a notion of self-concordant smoothing for minimizing the sum of two convex functions, one of which is smooth and the other nonsmooth. The key highlight is a natural property of the resulting problem's structure that yields a…

Optimization and Control · Mathematics 2025-12-01 Adeyemi D. Adeoye , Alberto Bemporad

This paper considers stochastic optimization problems with weakly convex objective and constraint functions. We propose Prox-PEP, a proximal method equipped with quadratic subproblems. To handle nonlinear equality constraints, we employ an…

Optimization and Control · Mathematics 2026-05-11 Lixin Tang , Xingyu Wang , Liwei Zhang

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on the knowledge of optimal…

Optimization and Control · Mathematics 2023-11-27 Yurii Nesterov

The Langevin algorithms are frequently used to sample the posterior distributions in Bayesian inference. In many practical problems, however, the posterior distributions often consist of non-differentiable components, posing challenges for…

Numerical Analysis · Mathematics 2023-04-11 Ziruo Cai , Jinglai Li , Xiaoqun Zhang

Consider the minimization of a nonconvex differentiable function over a polyhedron. A popular primal-dual first-order method for this problem is to perform a gradient projection iteration for the augmented Lagrangian function and then…

Optimization and Control · Mathematics 2020-08-05 Jiawei Zhang , Zhi-Quan Luo

We study a Newton-like method for the minimization of an objective function that is the sum of a smooth convex function and an l-1 regularization term. This method, which is sometimes referred to in the literature as a proximal Newton…

Optimization and Control · Mathematics 2013-09-16 Richard H. Byrd , Jorge Nocedal , Figen Oztoprak

We consider a class of difference-of-convex (DC) optimization problems where the objective function is the sum of a smooth function and a possible nonsmooth DC function. The application of proximal DC algorithms to address this problem…

Optimization and Control · Mathematics 2023-08-30 Shummin Nakayama , Yasushi Narushima , Hiroshi Yabe

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen

We propose a primal-dual interior-point method (IPM) with convergence to second-order stationary points (SOSPs) of nonlinear semidefinite optimization problems, abbreviated as NSDPs. As far as we know, the current algorithms for NSDPs only…

Optimization and Control · Mathematics 2023-06-19 Shun Arahata , Takayuki Okuno , Akiko Takeda

Hidden convexity is a powerful idea in optimization: under the right transformations, nonconvex problems that are seemingly intractable can be solved efficiently using convex optimization. We introduce the notion of a Lagrangian dual…

Optimization and Control · Mathematics 2025-11-07 Venkat Chandrasekaran , Timothy Duff , Jose Israel Rodriguez , Kevin Shu

Second-order Newton-type algorithms that leverage the exact Hessian or its approximation are central to solve nonlinear optimization problems. However, their applications in solving large-scale nonconvex problems are hindered by three…

Optimization and Control · Mathematics 2026-04-08 Krishan Kumar , Ashutosh Sharma , Gauransh Dingwani , Nikhil Gupta , Vaishnavi Gupta , Ishan Bajaj