English
Related papers

Related papers: A Practical Distributed ADMM Solver for Billion-Sc…

200 papers

We propose a new bundle-based augmented Lagrangian framework for solving constrained convex problems. Unlike the classical (inexact) augmented Lagrangian method (ALM) that has a nested double-loop structure, our framework features a…

Optimization and Control · Mathematics 2025-02-14 Feng-Yi Liao , Yang Zheng

In this paper, we aim to provide a comprehensive analysis on the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a certain…

Optimization and Control · Mathematics 2015-08-11 Deren Han , Defeng Sun , Liwei Zhang

Alternating Direction Method of Multipliers (ADMM) algorithm has been widely adopted for solving the distributed optimization problem (DOP). In this paper, a new distributed parallel ADMM algorithm is proposed, which allows the agents to…

Optimization and Control · Mathematics 2021-11-23 Ziye Liu , Fanghong Guo , Wei Wang , Xiaoqun Wu

Learning to Optimize (L2O) approaches, including algorithm unrolling, plug-and-play methods, and hyperparameter learning, have garnered significant attention and have been successfully applied to the Alternating Direction Method of…

Optimization and Control · Mathematics 2024-09-27 Ling Liang , Cameron Austin , Haizhao Yang

In this paper, we present a novel approach to reconstruct a unique image of an observed scene with widely distributed radar sensors. The problem is posed as a constrained optimization problem in which the global image which represents the…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Ahmed Murtada , Ruizhi Hu , Bhavani Shankar Mysore Rama Rao , Udo Schroeder

This paper addresses the problem of efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double…

Machine Learning · Statistics 2025-03-11 Canyi Chen , Nan Qiao , Liping Zhu

Most methods for Bundle Adjustment (BA) in computer vision are either centralized or operate incrementally. This leads to poor scaling and affects the quality of solution as the number of images grows in large scale structure from motion…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Karthikeyan Natesan Ramamurthy , Chung-Ching Lin , Aleksandr Aravkin , Sharath Pankanti , Raphael Viguier

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

Optimization and Control · Mathematics 2024-01-17 Bowen Li , Bin Shi

The recent deployment of multi-agent networks has enabled the distributed solution of learning problems, where agents cooperate to train a global model without sharing their local, private data. This work specifically targets some prevalent…

Optimization and Control · Mathematics 2024-08-20 Nicola Bastianello , Diego Deplano , Mauro Franceschelli , Karl H. Johansson

This paper aims to solve a distributed learning problem under Byzantine attacks. In the underlying distributed system, a number of unknown but malicious workers (termed as Byzantine workers) can send arbitrary messages to the master and…

Optimization and Control · Mathematics 2021-06-15 Feng Lin , Weiyu Li , Qing Ling

Inexact alternating direction multiplier methods (ADMMs) are developed for solving general separable convex optimization problems with a linear constraint and with an objective that is the sum of smooth and nonsmooth terms. The approach…

Optimization and Control · Mathematics 2016-04-12 William W. Hager , Hongchao Zhang

Convex optimization is a powerful tool for resource allocation and signal processing in wireless networks. As the network density is expected to drastically increase in order to accommodate the exponentially growing mobile data traffic,…

Information Theory · Computer Science 2015-10-28 Yuanming Shi , Jun Zhang , Brendan O'Donoghue , Khaled B. Letaief

The recent deployment of distributed battery units in prosumer premises offer new opportunities for providing aggregated flexibility services to both distribution system operators and balance responsible parties. The optimization problem…

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

Given a set of dissimilarity measurements amongst data points, determining what metric representation is most "consistent" with the input measurements or the metric that best captures the relevant geometric features of the data is a key…

Machine Learning · Computer Science 2022-09-28 Rishi Sonthalia , Anna C. Gilbert

Distributed optimization is often widely attempted and innovated as an attractive and preferred methodology to solve large-scale problems effectively in a localized and coordinated manner. Thus, it is noteworthy that the methodology of…

Optimization and Control · Mathematics 2021-08-30 Xiaoxue Zhang , Jun Ma , Zilong Cheng , Sunan Huang , Clarence W. de Silva , Tong Heng Lee

The Augmented Lagragian Method (ALM) and Alternating Direction Method of Multiplier (ADMM) have been powerful optimization methods for general convex programming subject to linear constraint. We consider the convex problem whose objective…

Optimization and Control · Mathematics 2015-11-18 Canyi Lu , Huan Li , Zhouchen Lin , Shuicheng Yan

In decentralized consensus optimization, a connected network of agents collaboratively minimize the sum of their local objective functions over a common decision variable, where their information exchange is restricted between the…

Optimization and Control · Mathematics 2015-06-16 Wei Shi , Qing Ling , Kun Yuan , Gang Wu , Wotao Yin

The linearly constrained convex composite programming problems whose objective function contains two blocks with each block being the form of nonsmooth+smooth arises frequently in multiple fields of applications. If both of the smooth terms…

Optimization and Control · Mathematics 2021-11-25 Congying Qin , Yunhai Xiao , Peili Li

This paper presents a distributed optimization algorithm tailored for solving optimal control problems arising in multi-building coordination. The buildings coordinated by a grid operator, join a demand response program to balance the…

Optimization and Control · Mathematics 2021-01-14 Junyan Su , Yuning Jiang , Altug Bitlislioglu , Colin N. Jones , Boris Houska