English
Related papers

Related papers: A Dual Riemannian ADMM Algorithm for Low-Rank SDPs…

200 papers

We study connections between Dykstra's algorithm for projecting onto an intersection of convex sets, the augmented Lagrangian method of multipliers or ADMM, and block coordinate descent. We prove that coordinate descent for a regularized…

Computation · Statistics 2017-05-16 Ryan J. Tibshirani

The alternating direction method of multipliers (ADMM) has been widely used for solving structured convex optimization problems. In particular, the ADMM can solve convex programs that minimize the sum of $N$ convex functions with $N$-block…

Optimization and Control · Mathematics 2015-05-26 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

In this paper, we propose a unified framework of inexact stochastic Alternating Direction Method of Multipliers (ADMM) for solving nonconvex problems subject to linear constraints, whose objective comprises an average of finite-sum smooth…

Optimization and Control · Mathematics 2024-03-05 Yuxuan Zeng , Jianchao Bai , Shengjia Wang , Zhiguo Wang

In this paper, we propose two algorithms for nonlinear semi-infinite semi-definite programs with infinitely many convex inequality constraints, called SISDP for short. A straightforward approach to the SISDP is to use classical methods for…

Optimization and Control · Mathematics 2018-10-02 Takayuki Okuno , Masao Fukushima

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various convex or nonconvex composite problems that arise in the fields of image & signal processing and machine…

Optimization and Control · Mathematics 2014-12-08 Fenghui Wang , Zongben Xu , Hong-Kun Xu

The alternating minimization (AM) method is a fundamental method for minimizing convex functions whose variable consists of two blocks. How to efficiently solve each subproblems when applying the AM method is the most concerned task. In…

Optimization and Control · Mathematics 2015-01-16 Hui Zhang , Lizhi Cheng

Semidefinite programs (SDP) are important in learning and combinatorial optimization with numerous applications. In pursuit of low-rank solutions and low complexity algorithms, we consider the Burer--Monteiro factorization approach for…

Machine Learning · Statistics 2018-03-02 Srinadh Bhojanapalli , Nicolas Boumal , Prateek Jain , Praneeth Netrapalli

For multi-block alternating direction method of multipliers(ADMM), where the objective function can be decomposed into multiple block components, we show that with block symmetric Gauss-Seidel iteration, the algorithm will converge quickly.…

Optimization and Control · Mathematics 2017-05-24 Jinchao Xu , Kailai Xu , Yinyu Ye

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

This paper develops distributed synchronous and asynchronous algorithms for the large-scale semi-definite programming with diagonal constraints, which has wide applications in combination optimization, image processing and community…

Optimization and Control · Mathematics 2021-04-02 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen

The Alternating Direction Method of Multipliers (ADMM) has gained significant attention across a broad spectrum of machine learning applications. Incorporating the over-relaxation technique shows potential for enhancing the convergence rate…

Optimization and Control · Mathematics 2024-01-02 Jintao Song , Wenqi Lu , Yunwen Lei , Yuchao Tang , Zhenkuan Pan , Jinming Duan

The Burer-Monteiro factorization has become a powerful tool for solving large-scale semidefinite programs (SDPs), enabling recently developed low-rank solvers to tackle problems previously beyond reach. However, existing methods are…

Optimization and Control · Mathematics 2025-07-29 Daniel Brosch , Jan Schwiddessen , Angelika Wiegele

In this paper, we analyze the convergence of Alternating Direction Method of Multipliers (ADMM) on convex quadratic programs (QPs) with linear equality and bound constraints. The ADMM formulation alternates between an equality constrained…

Optimization and Control · Mathematics 2015-10-06 Arvind U. Raghunathan , Stefano Di Cairano

The framework of Integral Quadratic Constraints of Lessard et al. (2014) reduces the computation of upper bounds on the convergence rate of several optimization algorithms to semi-definite programming (SDP). Followup work by Nishihara et…

Machine Learning · Statistics 2018-03-06 Guilherme França , José Bento

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang

An alternate direction method of multipliers (ADMM)-based detectors can achieve good performance in both small and large-scale multiple-input multiple-output (MIMO) systems. However, due to the difficulty of choosing the optimal penalty…

Signal Processing · Electrical Eng. & Systems 2021-03-02 Isayiyas Nigatu Tiba , Quan Zhang , Jing Jiang , Yongchao Wang

We introduce a new algorithm to solve a regularized spatial-spectral image estimation problem. Our approach is based on the linearized alternating directions method of multipliers (LADMM), which is a variation of the popular ADMM algorithm.…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yunsong Liu , Debdut Mandal , Congyu Liao , Kawin Setsompop , Justin P. Haldar

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

In this paper, we study a class of non-convex optimization problems known as multi-affine quadratic equality constrained problems, which appear in various applications--from generating feasible force trajectories in robotic locomotion and…

Optimization and Control · Mathematics 2026-03-13 Yutong Chao , Michal Ciebielski , Jalal Etesami , Majid Khadiv
‹ Prev 1 8 9 10 Next ›