English
Related papers

Related papers: Alternating Direction Method of Multipliers (ADMMs…

200 papers

We present a systematic weight pruning framework of deep neural networks (DNNs) using the alternating direction method of multipliers (ADMM). We first formulate the weight pruning problem of DNNs as a constrained nonconvex optimization…

Machine Learning · Computer Science 2018-04-24 Tianyun Zhang , Shaokai Ye , Yipeng Zhang , Yanzhi Wang , Makan Fardad

Consider a set of networked agents endowed with private cost functions and seeking to find a consensus on the minimizer of the aggregate cost. A new class of random asynchronous distributed optimization methods is introduced. The methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-13 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

In this paper we demonstrate a novel alternating direction method of multipliers (ADMM) algorithm for the solution of the hybrid vehicle energy management problem considering both power split and engine on/off decisions. The solution of a…

Optimization and Control · Mathematics 2019-05-30 Sebastian East , Mark Cannon

The alternating direction method of multipliers (ADMM) were extensively investigated in the past decades for solving separable convex optimization problems. Fewer researchers focused on exploring its convergence properties for the nonconvex…

Numerical Analysis · Mathematics 2019-07-02 Jianchao Bai , Junli Liang , Ke Guo , Yang Jing

In this paper, we present a new control model for optimizing pressure and water quality operations in water distribution networks. Our formulation imposes a set of time-coupling constraints to manage temporal pressure variations, which are…

Optimization and Control · Mathematics 2024-09-24 Bradley Jenks , Aly-Joy Ulusoy , Filippo Pecci , Ivan Stoianov

A widely-distributed radar system is a promising architecture to enhance radar imaging performance. However, most existing algorithms rely on isotropic scattering assumption, which is only satisfied in collocated radar systems. Moreover,…

Signal Processing · Electrical Eng. & Systems 2020-11-10 Ruizhi Hu , Bhavani Shankar Mysore Rama Rao , Ahmed Murtada , Mohammad Alaee-Kerahroodi , Björn Ottersten

In this paper, we aim to provide a comprehensive analysis on the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a certain…

Optimization and Control · Mathematics 2015-08-11 Deren Han , Defeng Sun , Liwei Zhang

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several nonconvex…

Optimization and Control · Mathematics 2016-12-13 Zheng Xu , Soham De , Mario Figueiredo , Christoph Studer , Tom Goldstein

In this paper, we propose a new stochastic alternating direction method of multipliers (ADMM) algorithm, which incrementally approximates the full gradient in the linearized ADMM formulation. Besides having a low per-iteration complexity as…

Machine Learning · Computer Science 2013-08-19 Leon Wenliang Zhong , James T. Kwok

This paper studies the problem of steering large-scale multi-agent stochastic linear systems between Gaussian distributions under probabilistic collision avoidance constraints. We introduce a family of \textit{distributed covariance…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Augustinos D. Saravanos , Isin M. Balci , Arshiya Taj Abdul , Efstathios Bakolas , Evangelos A. Theodorou

This work proposes a method for solving linear stochastic optimal control (SOC) problems using sum of squares and semidefinite programming. Previous work had used polynomial optimization to approximate the value function, requiring a high…

Optimization and Control · Mathematics 2014-09-23 Matanya B. Horowitz , Ivan Papusha , Joel W. Burdick

This paper deals with model predictive control problems for large scale dynamical systems with cyclic symmetry. Based on the properties of block circulant matrices, we introduce a complex-valued coordinate transformation that block…

Optimization and Control · Mathematics 2019-04-09 Idris Kempf , Paul J. Goulart , Stephen Duncan

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

Optimization and Control · Mathematics 2023-11-23 Zisheng Liu , Ting Zhang

In this paper we consider from two different aspects the proximal alternating direction method of multipliers (ADMM) in Hilbert spaces. We first consider the application of the proximal ADMM to solve well-posed linearly constrained…

Optimization and Control · Mathematics 2023-10-11 Qinian Jin

Distributed controller synthesis offers scalable and privacy-preserving control design, but typical state-of-the-art approaches either assume white-box models or resort to centralized synthesis. In this paper, we combine partially known…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Michael C. A. Nestor , Fei Teng

We analyze the convergence rate of the alternating direction method of multipliers (ADMM) for minimizing the sum of two or more nonsmooth convex separable functions subject to linear constraints. Previous analysis of the ADMM typically…

Optimization and Control · Mathematics 2013-03-27 Mingyi Hong , Zhi-Quan Luo

This paper investigates non-myopic path planning of mobile sensors for multi-target tracking. Such problem has posed a high computational complexity issue and/or the necessity of high-level decision making. Existing works tackle these…

Robotics · Computer Science 2019-11-15 Soon-Seo Park , Youngjae Min , Jung-Su Ha , Doo-Hyun Cho , Han-Lim Choi

We present an efficient alternating direction method of multipliers (ADMM) algorithm for segmenting a multivariate non-stationary time series with structural breaks into stationary regions. We draw from recent work where the series is…

Machine Learning · Statistics 2018-06-26 Alex Tank , Emily B. Fox , Ali Shojaie

In this paper, we study a general optimization model, which covers a large class of existing models for many applications in imaging sciences. To solve the resulting possibly nonconvex, nonsmooth and non-Lipschitz optimization problem, we…

Optimization and Control · Mathematics 2016-09-30 Lei Yang , Ting Kei Pong , Xiaojun Chen