English
Related papers

Related papers: In-Network Linear Regression with Arbitrarily Spli…

200 papers

In this work we derive the performance achievable by a network of distributed agents that solve, adaptively and in the presence of communication constraints, a regression problem. Agents employ the recently proposed ACTC…

Machine Learning · Computer Science 2025-04-25 Marco Carpentiero , Vincenzo Matta , Ali H. Sayed

We propose an approach for fitting linear regression models that splits the set of covariates into groups. The optimal split of the variables into groups and the regularized estimation of the regression coefficients are performed by…

Methodology · Statistics 2019-12-13 Anthony Christidis , Ruben Zamar , Laks V. S. Lakshmanan , Ezequiel Smucler

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning…

Optimization and Control · Mathematics 2020-06-17 Sulaiman A. Alghunaim , Ming Yan , Ali H. Sayed

Network structure is growing popular for capturing the intrinsic relationship between large-scale variables. In the paper we propose to improve the estimation accuracy for large-dimensional factor model when a network structure between…

Methodology · Statistics 2020-01-30 Long Yu , Yong He , Xinsheng Zhang , Ji Zhu

This paper studies a distributed state estimation problem for both continuous- and discrete-time linear systems. A simply structured distributed estimator (comprising interconnected local estimators) is first described for estimating the…

Systems and Control · Electrical Eng. & Systems 2023-10-30 Lili Wang , Ji Liu , Brian B. O. Anderson , A. Stephen Morse

Handling the problem of scalability is one of the essential issues for multi-agent reinforcement learning (MARL) algorithms to be applied to real-world problems typically involving massively many agents. For this, parameter sharing across…

Multiagent Systems · Computer Science 2023-03-03 Woojun Kim , Youngchul Sung

We apply diffusion strategies to develop a fully-distributed cooperative reinforcement learning algorithm in which agents in a network communicate only with their immediate neighbors to improve predictions about their environment. The…

Multiagent Systems · Computer Science 2014-11-06 Sergio Valcarcel Macua , Jianshu Chen , Santiago Zazo , Ali H. Sayed

We consider distributed multitask learning problems over a network of agents where each agent is interested in estimating its own parameter vector, also called task, and where the tasks at neighboring agents are related according to a set…

Multiagent Systems · Computer Science 2017-10-11 Roula Nassif , Cédric Richard , André Ferrari , Ali H. Sayed

We consider the distributed optimization problem, where a group of agents work together to optimize a common objective by communicating with neighboring agents and performing local computations. For a given algorithm, we use tools from…

Optimization and Control · Mathematics 2020-09-11 Bryan Van Scoy , Laurent Lessard

This paper proposes a new framework for distributed optimization, called distributed aggregative optimization, which allows local objective functions to be dependent not only on their own decision variables, but also on the average of…

Optimization and Control · Mathematics 2020-05-28 Xiuxian Li , Lihua Xie , Yiguang Hong

In this paper, we study robust distributed sub-optimal coordination of linear agents subject to input nonlinearities. Inspired by the robust agreement literature, we formulate a bounded distributed sub-optimal coordination problem, in which…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Takumi Namba

This paper delves into the investigation of a distributed aggregative optimization problem within a network. In this scenario, each agent possesses its own local cost function, which relies not only on the local state variable but also on…

Optimization and Control · Mathematics 2025-04-01 Jiaxu Liu , Song Chen , Shengze Cai , Chao Xu , Jian Chu

We study nonconvex distributed optimization in multi-agent networks with time-varying (nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed minimization of the sum of a smooth (possibly nonconvex and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-02 Paolo Di Lorenzo , Gesualdo Scutari

In this paper, we propose a distributed algorithm, called Directed-Distributed Gradient Descent (D-DGD), to solve multi-agent optimization problems over directed graphs. Existing algorithms mostly deal with similar problems under the…

Optimization and Control · Mathematics 2016-02-02 Chenguang Xi , Qiong Wu , Usman A. Khan

Motivated by the relationship between the eigenvalue spectrum of the Laplacian matrix of a network and the behavior of dynamical processes evolving in it, we propose a distributed iterative algorithm in which a group of $n$ autonomous…

Optimization and Control · Mathematics 2012-09-10 Victor M. Preciado , Michael M. Zavlanos , Ali Jadbabaie

This paper presents a distributed optimization scheme over a network of agents in the presence of cost uncertainties and over switching communication topologies. Inspired by recent advances in distributed convex optimization, we propose a…

Optimization and Control · Mathematics 2016-11-15 Saghar Hosseini , Airlie Chapman , Mehran Mesbahi

When artificial neural networks have demonstrated exceptional practical success in a variety of domains, investigations into their theoretical characteristics, such as their approximation power, statistical properties, and generalization…

Machine Learning · Statistics 2023-10-06 Shijin Gong , Xinyu Zhang

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

Multiagent Systems · Computer Science 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

We consider decentralized optimization problems in which a number of agents collaborate to minimize the average of their local functions by exchanging over an underlying communication graph. Specifically, we place ourselves in an…

Optimization and Control · Mathematics 2023-03-20 Yu-Guan Hsieh , Yassine Laguel , Franck Iutzeler , Jérôme Malick

For a multi-agent system state estimation resting upon noisy measurements constitutes a problem related to several application scenarios. Adopting the standard least-squares approach, in this work we derive both the (centralized) analytic…

Systems and Control · Electrical Eng. & Systems 2022-02-22 Marco Fabris , Giulia Michieletto , Angelo Cenedese