English
Related papers

Related papers: An Alternating Direction Method with Increasing Pe…

200 papers

We analyze the performance of the alternating direction method of multipliers (ADMM) to track, in a decentralized manner, a solution of a stochastic sequence of optimization problems parametrized by a discrete time Markov process. The main…

Optimization and Control · Mathematics 2019-03-18 Marie Maros , Joakim Jalén

In recent years, considerable attention has been devoted to the regularization models due to the presence of high-dimensional data in scientific research. Sparse support vector machine (SVM) are useful tools in high-dimensional data…

Computation · Statistics 2023-12-27 Jiawei Wen

We propose a distributed optimization method for solving a distributed model predictive consensus problem. The goal is to design a distributed controller for a network of dynamical systems to optimize a coupled objective function while…

Optimization and Control · Mathematics 2012-12-07 Tyler H. Summers , John Lygeros

The saddle-point problems (SPPs) with nonlinear coupling operators frequently arise in various control systems, such as dynamic programming optimization, H-infinity control, and Lyapunov stability analysis. However, traditional primal-dual…

Optimization and Control · Mathematics 2025-03-21 Sai Wang , Yi Gong

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

Despite the numerous uses of semidefinite programming (SDP) and its universal solvability via interior point methods (IPMs), it is rarely applied to practical large-scale problems. This mainly owes to the computational cost of IPMs that…

Optimization and Control · Mathematics 2024-03-19 Yifan Ran , Stefan Vlaski , Wei Dai

This paper investigates the cooperative planning and control problem for multiple connected autonomous vehicles (CAVs) in different scenarios. In the existing literature, most of the methods suffer from significant problems in computational…

Multiagent Systems · Computer Science 2021-01-05 Xiaoxue Zhang , Zilong Cheng , Jun Ma , Sunan Huang , Frank L. Lewis , Tong Heng Lee

We consider the solution of linear saddle-point problems, using the alternating direction method-of-multipliers (ADMM) as a preconditioner for the generalized minimum residual method (GMRES). We show, using theoretical bounds and empirical…

Optimization and Control · Mathematics 2016-04-28 Richard Y. Zhang , Jacob K. White

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

Machine Learning · Statistics 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

This paper discusses the adaptive sampling problem in a nonholonomic mobile robotic sensor network for efficiently monitoring a spatial field. It is proposed to employ Gaussian process to model a spatial phenomenon and predict it at…

Robotics · Computer Science 2021-03-23 Viet-Anh Le , Linh Nguyen , Truong X. Nghiem

The alternating direction multiplier method (ADMM) is widely used in computer graphics for solving optimization problems that can be nonsmooth and nonconvex. It converges quickly to an approximate solution, but can take a long time to…

Optimization and Control · Mathematics 2020-06-29 Wenqing Ouyang , Yue Peng , Yuxin Yao , Juyong Zhang , Bailin Deng

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

Optimization and Control · Mathematics 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

In this paper, we propose a novel distributed algorithm for consensus optimization over networks and a robust extension tailored to deal with asynchronous agents and packet losses. Indeed, to robustly achieve dynamic consensus on the…

Optimization and Control · Mathematics 2025-09-04 Guido Carnevale , Nicola Bastianello , Giuseppe Notarstefano , Ruggero Carli

In this paper, we present a semi-proximal alternating direction method of multipliers (ADMM) for solving $3$-block separable convex minimization problems with the second block in the objective being a strongly convex function and one…

Optimization and Control · Mathematics 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

We consider the stochastic composition optimization problem proposed in \cite{wang2017stochastic}, which has applications ranging from estimation to statistical and machine learning. We propose the first ADMM-based algorithm named…

Machine Learning · Computer Science 2017-05-23 Yue Yu , Longbo Huang

In this work, we consider strongly convex strongly concave (SCSC) saddle point (SP) problems $\min_{x\in\mathbb{R}^{d_x}}\max_{y\in\mathbb{R}^{d_y}}f(x,y)$ where $f$ is $L$-smooth, $f(.,y)$ is $\mu$-strongly convex for every $y$, and…

Optimization and Control · Mathematics 2022-02-22 Bugra Can , Mert Gurbuzbalaban , Necdet Serhat Aybat

Based on SGD, previous works have proposed many algorithms that have improved convergence speed and generalization in stochastic optimization, such as SGDm, AdaGrad, Adam, etc. However, their convergence analysis under non-convex conditions…

Machine Learning · Computer Science 2024-02-05 Yichuan Deng , Zhao Song , Chiwun Yang

We introduce a generalization of the linearized Alternating Direction Method of Multipliers to optimize a real-valued function $f$ of multiple arguments with potentially multiple constraints $g_\circ$ on each of them. The function $f$ may…

Optimization and Control · Mathematics 2019-01-28 Fred Moolekamp , Peter Melchior

In this paper, we develop an efficient detector for massive multiple-input multiple-output (MIMO) communication systems via penalty-sharing alternating direction method of multipliers (PS-ADMM). Its main content are as follows: first, we…

Signal Processing · Electrical Eng. & Systems 2020-10-15 Quan Zhang , Yongchao Wang

We propose a new framework -- Square Root Principal Component Pursuit -- for low-rank matrix recovery from observations corrupted with noise and outliers. Inspired by the square root Lasso, this new formulation does not require prior…

Machine Learning · Computer Science 2021-11-01 Junhui Zhang , Jingkai Yan , John Wright