中文
相关论文

相关论文: GMRES-Accelerated ADMM for Quadratic Objectives

200 篇论文

The nonconvex and nonsmooth finite-sum optimization problem with linear constraint has attracted much attention in the fields of artificial intelligence, computer, and mathematics, due to its wide applications in machine learning and the…

最优化与控制 · 数学 2023-07-11 Yuxuan Zeng , Zhiguo Wang , Jianchao Bai , Xiaojing Shen

To solve the separable convex optimization problem with linear constraints, Eckstein and Bertsekas introduced the generalized alternating direction method of multipliers (in short, GADMM), which is an efficient and simple acceleration…

最优化与控制 · 数学 2022-11-17 Jianwen Peng , Dexi Liu , Xueqing Zhang , Jen-Chih Yao

We introduce Newton-ADMM, a method for fast conic optimization. The basic idea is to view the residuals of consecutive iterates generated by the alternating direction method of multipliers (ADMM) as a set of fixed point equations, and then…

最优化与控制 · 数学 2017-06-21 Alnur Ali , Eric Wong , J. Zico Kolter

We study the solution of block-structured linear algebra systems arising in optimization by using iterative solution techniques. These systems are the core computational bottleneck of many problems of interest such as parameter estimation,…

最优化与控制 · 数学 2019-09-10 Jose S. Rodriguez , Carl D. Laird , Victor M. Zavala

Recent advances in neural-network architecture allow for seamless integration of convex optimization problems as differentiable layers in an end-to-end trainable neural network. Integrating medium and large scale quadratic programs into a…

最优化与控制 · 数学 2021-12-15 Andrew Butler , Roy Kwon

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

最优化与控制 · 数学 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach…

最优化与控制 · 数学 2016-04-12 William W. Hager , Hongchao Zhang

We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…

最优化与控制 · 数学 2018-06-15 Quoc Tran-Dinh , Yuzixuan Zhu

In this paper, we analyze the convergence of Alternating Direction Method of Multipliers (ADMM) on convex quadratic programs (QPs) with linear equality and bound constraints. The ADMM formulation alternates between an equality constrained…

最优化与控制 · 数学 2015-10-06 Arvind U. Raghunathan , Stefano Di Cairano

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

最优化与控制 · 数学 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

In this paper, we study a class of non-convex optimization problems known as multi-affine quadratic equality constrained problems, which appear in various applications--from generating feasible force trajectories in robotic locomotion and…

最优化与控制 · 数学 2026-03-13 Yutong Chao , Michal Ciebielski , Jalal Etesami , Majid Khadiv

This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly-constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable.…

最优化与控制 · 数学 2023-01-05 Weiwei Kong , Renato D. C. Monteiro

This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The…

最优化与控制 · 数学 2014-03-20 Wei Deng , Ming-Jun Lai , Zhimin Peng , Wotao Yin

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

最优化与控制 · 数学 2024-01-17 Bowen Li , Bin Shi

The generalized alternating direction method of multipliers (ADMM) of Xiao et al. [{\tt Math. Prog. Comput., 2018}] aims at the two-block linearly constrained composite convex programming problem, in which each block is in the form of…

最优化与控制 · 数学 2022-04-05 Hongwu Li , Haibin Zhang , Yunhai Xiao

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

数值分析 · 数学 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

The Alternating Direction Method of Multipliers (ADMM) has now days gained tremendous attentions for solving large-scale machine learning and signal processing problems due to the relative simplicity. However, the two-block structure of the…

最优化与控制 · 数学 2020-03-23 Mingxi Zhu , Kresimir Mihic , Yinyu Ye

In this work, we propose a (linearized) Alternating Direction Method-of-Multipliers (ADMM) algorithm for minimizing a convex function subject to a nonconvex constraint. We focus on the special case where such constraint arises from the…

机器学习 · 计算机科学 2019-07-09 Fabian Latorre Gómez , Armin Eftekhari , Volkan Cevher

The alternating direction method of multipliers (ADMM) proposed by Glowinski and Marrocco is a benchmark algorithm for two-block separable convex optimization problems with linear equality constraints. It has been modified, specified, and…

最优化与控制 · 数学 2021-07-15 Bingsheng He , Shengjie Xu , Xiaoming Yuan

In this paper, we study a general optimization model, which covers a large class of existing models for many applications in imaging sciences. To solve the resulting possibly nonconvex, nonsmooth and non-Lipschitz optimization problem, we…

最优化与控制 · 数学 2016-09-30 Lei Yang , Ting Kei Pong , Xiaojun Chen