English
Related papers

Related papers: Variable-Wise Diagonal Preconditioning for Primal-…

200 papers

In this paper, we propose a descent method for composite optimization problems with linear operators. Specifically, we first design a structure-exploiting preconditioner tailored to the linear operator so that the resulting preconditioned…

Optimization and Control · Mathematics 2026-03-20 Jian Chen , Xinmin Yang

Primal-Dual Hybrid Gradient (PDHG) and Alternating Direction Method of Multipliers (ADMM) are two widely-used first-order optimization methods. They reduce a difficult problem to simple subproblems, so they are easy to implement and have…

Optimization and Control · Mathematics 2019-09-10 Yanli Liu , Yunbei Xu , Wotao Yin

Many applications using large datasets require efficient methods for minimizing a proximable convex function subject to satisfying a set of linear constraints within a specified tolerance. For this task, we present a proximal projection…

Optimization and Control · Mathematics 2024-12-10 Howard Heaton

We introduce a first order method for solving very large convex cone programs. The method uses an operator splitting method, the alternating directions method of multipliers, to solve the homogeneous self-dual embedding, an equivalent…

Optimization and Control · Mathematics 2016-07-27 Brendan O'Donoghue , Eric Chu , Neal Parikh , Stephen Boyd

We study the Constrained Convex Markov Decision Process (MDP), where the goal is to minimize a convex functional of the visitation measure, subject to a convex constraint. Designing algorithms for a constrained convex MDP faces several…

Machine Learning · Computer Science 2024-02-19 Zihao Li , Boyi Liu , Zhuoran Yang , Zhaoran Wang , Mengdi Wang

Primal-dual algorithm (PDA) is a classic and popular scheme for convex-concave saddle point problems. It is universally acknowledged that the proximal terms in the subproblems about the primal and dual variables are crucial to the…

Optimization and Control · Mathematics 2025-04-24 Shuning Liu , Zexian Liu

Optimal control problems with nonsmooth objectives and nonlinear partial differential equation (PDE) constraints are challenging, mainly because of the underlying nonsmooth and nonconvex structures and the demanding computational cost for…

Optimization and Control · Mathematics 2025-04-25 Yongcun Song , Xiaoming Yuan , Hangrui Yue , Tianyou Zeng

We develop block structure adapted primal-dual algorithms for non-convex non-smooth optimisation problems whose objectives can be written as compositions $G(x)+F(K(x))$ of non-smooth block-separable convex functions $G$ and $F$ with a…

Optimization and Control · Mathematics 2020-09-25 Stanislav Mazurenko , Jyrki Jauhiainen , Tuomo Valkonen

We consider an inertial primal-dual fixed point algorithm (IPDFP) to compute the minimizations of the following Problem (1.1). This is a full splitting approach, in the sense that the nonsmooth functions are processed individually via their…

Optimization and Control · Mathematics 2016-04-20 Meng Wen , Yu-Chao Tang , Jigen Peng

We study first-order methods with preconditioning for solving structured nonlinear convex optimization problems. We propose a new family of preconditioners generated by symmetric polynomials. They provide first-order optimization methods…

Optimization and Control · Mathematics 2023-01-31 Nikita Doikov , Anton Rodomanov

The efficient solution of moderately large-scale linear systems arising from the KKT conditions in optimal control problems (OCPs) is a critical challenge in robotics. With the stagnation of Moore's law, there is growing interest in…

Optimization and Control · Mathematics 2025-05-21 Shaohui Yang , Toshiyuki Ohtsuka , Brian Plancher , Colin N. Jones

We propose a primal-dual parallel proximal splitting method for solving domain decomposition problems for partial differential equations. The problem is formulated via minimization of energy functions on the subdomains with coupling…

Numerical Analysis · Mathematics 2014-10-17 Hédy Attouch , Luis M. Briceño-Arias , Patrick L. Combettes

The coupled Darcy-Stokes problem is widely used for modeling fluid transport in physical systems consisting of a porous part and a free part. In this work we consider preconditioners for monolitic solution algorithms of the coupled…

Numerical Analysis · Mathematics 2020-01-17 Karl Erik Holter , Miroslav Kuchta , Kent-Andre Mardal

We study structured nonsmooth convex finite-sum optimization that appears widely in machine learning applications, including support vector machines and least absolute deviation. For the primal-dual formulation of this problem, we propose a…

Optimization and Control · Mathematics 2021-04-08 Chaobing Song , Stephen J. Wright , Jelena Diakonikolas

The primal-dual splitting algorithm (PDSA) by Chambolle and Pock is efficient for solving structured convex optimization problems. It adopts an extrapolation step and achieves convergence under certain step size condition. Chang and Yang…

Optimization and Control · Mathematics 2025-10-02 Xiaokai Chang , Junfeng Yang , Jianchao Bai , Jianxiong Cao

We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While…

Optimization and Control · Mathematics 2024-06-21 Sajad Zandi , Mehdi Korki

This work introduces and rigorously analyzes a novel operator-splitting finite element scheme for approximating viscosity solutions of a broad class of constrained second-order partial differential equations. By decoupling the primary PDE…

Numerical Analysis · Mathematics 2025-07-01 Po-Yi Wu

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the…

Numerical Analysis · Mathematics 2025-05-14 Nunzio Dimola , Nicola Rares Franco , Paolo Zunino

We consider a general class of nonsmooth optimal control problems with partial differential equation (PDE) constraints, which are very challenging due to its nonsmooth objective functionals and the resulting high-dimensional and…

Optimization and Control · Mathematics 2023-07-26 Yongcun Song , Xiaoming Yuan , Hangrui Yue

We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated…

Optimization and Control · Mathematics 2024-08-28 Yu Gao , Xiaochuan Pan , Chong Chen