English
Related papers

Related papers: Fine tuning consensus optimization for distributed…

200 papers

In the context of high-dimensional Gaussian linear regression for ordered variables, we study the variable selection procedure via the minimization of the penalized least-squares criterion. We focus on model selection where the penalty…

Statistics Theory · Mathematics 2024-07-01 Perrine Lacroix , Marie-Laure Martin

In this paper, we design an efficient quadrature amplitude modulation (QAM) signal detector for massive multiple-input multiple-output (MIMO) communication systems via the penalty-sharing alternating direction method of multipliers…

Signal Processing · Electrical Eng. & Systems 2021-12-14 Quan Zhang , Jiangtao Wang , Yongchao Wang

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

In this paper, we consider a strongly convex finite-sum minimization problem over a decentralized network and propose a communication-efficient decentralized Newton's method for solving it. We first apply dynamic average consensus (DAC) so…

Optimization and Control · Mathematics 2022-10-04 Huikang Liu , Jiaojiao Zhang , Anthony Man-Cho So , Qing Ling

The data reduction procedure for radio interferometers can be viewed as a combined calibration and imaging problem. We present an algorithm that unifies cross-calibration, self-calibration, and imaging. Being a Bayesian method, that…

Instrumentation and Methods for Astrophysics · Physics 2019-07-23 Philipp Arras , Philipp Frank , Reimar Leike , Rüdiger Westermann , Torsten Enßlin

We apply the Min-Sum message-passing protocol to solve the consensus problem in distributed optimization. We show that while the ordinary Min-Sum algorithm does not converge, a modified version of it known as Splitting yields convergence to…

Optimization and Control · Mathematics 2017-11-06 Patrick Rebeschini , Sekhar Tatikonda

In this paper, we propose an inertial alternating direction method of multipliers for solving a class of non-convex multi-block optimization problems with \emph{nonlinear coupling constraints}. Distinctive features of our proposed method,…

Optimization and Control · Mathematics 2024-02-22 Le Thi Khanh Hien , Dimitri Papadimitriou

Consider a set of networked agents endowed with private cost functions and seeking to find a consensus on the minimizer of the aggregate cost. A new class of random asynchronous distributed optimization methods is introduced. The methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-13 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

Stochastic optimization is a vital field in the realm of mathematical optimization, finding applications in diverse areas ranging from operations research to machine learning. In this paper, we introduce a novel first-order optimization…

Optimization and Control · Mathematics 2024-09-17 Vladimir Solodkin , Savelii Chezhegov , Ruslan Nazikov , Aleksandr Beznosikov , Alexander Gasnikov

In this paper, we review the parallel and distributed optimization algorithms based on the alternating direction method of multipliers (ADMM) for solving "big data" optimization problems in modern communication networks. We first introduce…

Numerical Analysis · Computer Science 2015-04-09 Lanchao Liu , Zhu Han

Distributed optimization algorithms have been studied extensively in the literature; however, underlying most algorithms is a linear consensus scheme, i.e. averaging variables from neighbors via doubly stochastic matrices. We consider…

Optimization and Control · Mathematics 2023-03-14 Hsu Kao , Vijay Subramanian

This paper proposes a new approach for the calibration of material parameters in local elastoplastic constitutive models. The calibration is posed as a constrained optimization problem, where the constitutive model evolution equations for a…

Computational Engineering, Finance, and Science · Computer Science 2025-05-09 Ryan Yan , D. Thomas Seidl , Reese E. Jones , Panayiotis Papadopoulos

To meet the ever growing demand for both high throughput and uniform coverage in future wireless networks, dense network deployment will be ubiquitous, for which co- operation among the access points is critical. Considering the…

Information Theory · Computer Science 2014-05-14 Yuanming Shi , Jun Zhang , Khaled B. Letaief

Network topology is critical for efficient parameter synchronization in distributed learning over networks. However, most existing studies do not account for bandwidth limitations in network topology design. In this paper, we propose a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-09 Yipeng Shen , Zehan Zhu , Yan Huang , Changzhi Yan , Cheng Zhuo , Jinming Xu

For minimizing a strongly convex objective function subject to linear inequality constraints, we consider a penalty approach that allows one to utilize stochastic methods for problems with a large number of constraints and/or objective…

Optimization and Control · Mathematics 2022-02-16 Meng Li , Paul Grigas , Alper Atamturk

In average consensus protocols, nodes in a network perform an iterative weighted average of their estimates and those of their neighbors. The protocol converges to the average of initial estimates of all nodes found in the network. The…

Optimization and Control · Mathematics 2014-07-21 Mahmoud El Chamie , Giovanni Neglia , Konstantin Avrachenkov

In this paper, we propose a communication- and computation-efficient algorithm to solve a convex consensus optimization problem defined over a decentralized network. A remarkable existing algorithm to solve this problem is the alternating…

Optimization and Control · Mathematics 2020-04-09 Weiyu Li , Yaohua Liu , Zhi Tian , Qing Ling

A distributed consensus algorithm for estimating the maximum value of the initial measurements in a sensor network with communication noise is proposed. In the absence of communication noise, max estimation can be done by updating the state…

Systems and Control · Computer Science 2016-02-04 Sai Zhang , Cihan Tepedelenlioglu , Mahesh K. Banavar , Andreas Spanias

Large scale, non-convex optimization problems arising in many complex networks such as the power system call for efficient and scalable distributed optimization algorithms. Existing distributed methods are usually iterative and require…

Optimization and Control · Mathematics 2017-10-26 Junyao Guo , Gabriela Hug , Ozan Tonguz