English
Related papers

Related papers: Scalable Decentralized Algorithms for Online Perso…

200 papers

We study the problem of estimating an unknown parameter in a distributed and online manner. Existing work on distributed online learning typically either focuses on asymptotic analysis, or provides bounds on regret. However, these results…

Systems and Control · Electrical Eng. & Systems 2022-09-15 Lei Xin , George Chiu , Shreyas Sundaram

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

Machine Learning · Computer Science 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

In this work, we focus on solving a decentralized consensus problem in a private manner. Specifically, we consider a setting in which a group of nodes, connected through a network, aim at computing the mean of their local values without…

Multiagent Systems · Computer Science 2022-02-22 Mohammad Fereydounian , Aryan Mokhtari , Ramtin Pedarsani , Hamed Hassani

Distributed optimization has a rich history. It has demonstrated its effectiveness in many machine learning applications, etc. In this paper we study a subclass of distributed optimization, namely decentralized optimization in a non-smooth…

Optimization and Control · Mathematics 2023-12-05 Aleksandr Lobanov , Andrew Veprikov , Georgiy Konin , Aleksandr Beznosikov , Alexander Gasnikov , Dmitry Kovalev

Classical consensus-based strategies for federated and decentralized learning are statistically suboptimal in the presence of heterogeneous local data or task distributions. As a result, in recent years, there has been growing interest in…

Machine Learning · Computer Science 2025-10-14 Zirui Wan , Stefan Vlaski

We address real-time sampling and estimation of autoregressive Markovian sources in dynamic yet structurally similar multi-hop wireless networks. Each node caches samples from others and communicates over wireless collision channels, aiming…

Machine Learning · Computer Science 2026-01-27 Xingran Chen , Navid NaderiAlizadeh , Alejandro Ribeiro , Shirin Saeedi Bidokhti

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

Distributed machine learning (ML) is a modern computation paradigm that divides its workload into independent tasks that can be simultaneously achieved by multiple machines (i.e., agents) for better scalability. However, a typical…

Machine Learning · Computer Science 2018-11-14 Trong Nghia Hoang , Quang Minh Hoang , Kian Hsiang Low , Jonathan How

This paper presents novel Gaussian process decentralized data fusion algorithms exploiting the notion of agent-centric support sets for distributed cooperative perception of large-scale environmental phenomena. To overcome the limitations…

Machine Learning · Statistics 2017-11-17 Ruofei Ouyang , Kian Hsiang Low

Mobile agent systems are emerging as a key paradigm for enabling intelligent applications on edge devices and in AIoT ecosystems. However, their scalability is fundamentally constrained by limited on-device computation and fragmented…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Bowei He

Consider a network whose nodes have some initial values, and it is desired to design an algorithm that builds on neighbor to neighbor interactions with the ultimate goal of convergence to the average of all initial node values or to some…

Optimization and Control · Mathematics 2014-09-16 Mahmoud El Chamie , Ji Liu , Tamer Başar

For tasks where the dynamics of multiple agents are physically coupled, e.g., in cooperative manipulation, the coordination between the individual agents becomes crucial, which requires exact knowledge of the interaction dynamics. This…

Robotics · Computer Science 2022-06-29 Pablo Budde gen. Dohmann , Armin Lederer , Marcel Dißemond , Sandra Hirche

This paper develops methods of distributed Bayesian hypothesis tests for fault detection and diagnosis that are based on belief propagation and optimization in graphical models. The main challenges in developing distributed statistical…

Systems and Control · Computer Science 2015-01-20 Kwang-Ki K. Kim

In this paper, a distributed subgradient-based algorithm is proposed for continuous-time multi-agent systems to search a feasible solution to convex inequalities. The algorithm involves each agent achieving a state constrained by its own…

Systems and Control · Computer Science 2017-06-13 Kaihong Lu , Gangshan Jing , Long Wang

This paper presents a scalable Bayesian technique for decentralized state estimation from multiple platforms in dynamic environments. As has long been recognized, centralized architectures impose severe scaling limitations for distributed…

Artificial Intelligence · Computer Science 2012-12-12 Matthew Rosencrantz , Geoffrey Gordon , Sebastian Thrun

The practical utility of agent-based models in decision-making relies on their capacity to accurately replicate populations while seamlessly integrating real-world data streams. Yet, the incorporation of such data poses significant…

Multiagent Systems · Computer Science 2024-04-22 Ayush Chopra , Arnau Quera-Bofarull , Nurullah Giray-Kuru , Michael Wooldridge , Ramesh Raskar

We consider cooperative multi-agent consensus optimization problems over an undirected network of agents, where only those agents connected by an edge can directly communicate. The objective is to minimize the sum of agent-specific…

Optimization and Control · Mathematics 2016-07-12 Necdet Serhat Aybat , Erfan Yazdandoost Hamedani

A distributed discrete-time algorithm is proposed for multi-agent networks to achieve a common least squares solution of a group of linear equations, in which each agent only knows some of the equations and is only able to receive…

Systems and Control · Computer Science 2017-10-02 Xuan Wang , Jingqiu Zhou , Shaoshuai Mou , Martin J. Corless

In this paper, we study the problem of reinforcement learning in multi-agent systems where communication among agents is limited. We develop a decentralized actor-critic learning framework in which each agent performs several local updates…

Machine Learning · Computer Science 2025-10-23 Xiaoxing Ren , Nicola Bastianello , Thomas Parisini , Andreas A. Malikopoulos

We consider a stochastic convex optimization problem that requires minimizing a sum of misspecified agentspecific expectation-valued convex functions over the intersection of a collection of agent-specific convex sets. This misspecification…

Optimization and Control · Mathematics 2015-09-22 Aswin Kannan , Angelia Nedich , Uday V. Shanbhag