English
Related papers

Related papers: Distributed Inference with Sparse and Quantized Co…

200 papers

We consider the problem of classification with a (peer-to-peer) network of heterogeneous and partially informative agents, each receiving local data generated by an underlying true class, and equipped with a classifier that can only…

Machine Learning · Computer Science 2024-10-01 Tong Yao , Shreyas Sundaram

We introduce a distributed, cooperative framework and method for Bayesian estimation and control in decentralized agent networks. Our framework combines joint estimation of time-varying global and local states with information-seeking…

Systems and Control · Computer Science 2015-09-24 Florian Meyer , Henk Wymeersch , Markus Fröhle , Franz Hlawatsch

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

This paper proposes a scalable distributed policy gradient method and proves its convergence to near-optimal solution in multi-agent linear quadratic networked systems. The agents engage within a specified network under local communication…

Multiagent Systems · Computer Science 2024-03-06 Yuzi Yan , Yuan Shen

We study the problem of estimating an unknown parameter in a distributed and online manner. Existing work on distributed online learning typically either focuses on asymptotic analysis, or provides bounds on regret. However, these results…

Systems and Control · Electrical Eng. & Systems 2022-09-15 Lei Xin , George Chiu , Shreyas Sundaram

Diffusion learning is a framework that endows edge devices with advanced intelligence. By processing and analyzing data locally and allowing each agent to communicate with its immediate neighbors, diffusion effectively protects the privacy…

Machine Learning · Computer Science 2025-05-19 Elsa Rizk , Kun Yuan , Ali H. Sayed

The distributed inference framework comprises of a group of spatially distributed nodes which acquire observations about a phenomenon of interest. Due to bandwidth and energy constraints, the nodes often quantize their observations into a…

Cryptography and Security · Computer Science 2015-02-20 Bhavya Kailkhura , V. Sriram Siddhardh Nadendla , Pramod K. Varshney

It is widely perceived that leveraging the success of modern machine learning techniques to mobile devices and wireless networks has the potential of enabling important new services. This, however, poses significant challenges, essentially…

Machine Learning · Computer Science 2023-04-13 Matei Moldoveanu , Abdellatif Zaidi

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This…

Optimization and Control · Mathematics 2023-08-01 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Marc Antonini , Ali H. Sayed

In this paper we present an optimization-based view of distributed parameter estimation and observational social learning in networks. Agents receive a sequence of random, independent and identically distributed (i.i.d.) signals, each of…

Machine Learning · Computer Science 2013-09-11 Shahin Shahrampour , Ali Jadbabaie

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

Machine Learning · Computer Science 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

We consider the problem of solving a distributed optimization problem using a distributed computing platform, where the communication in the network is limited: each node can only communicate with its neighbours and the channel has a…

Systems and Control · Computer Science 2015-04-10 Ye Pu , Melanie N. Zeilinger , Colin N. Jones

We propose a novel, efficient approach for distributed sparse learning in high-dimensions, where observations are randomly partitioned across machines. Computationally, at each round our method only requires the master machine to solve a…

Machine Learning · Statistics 2016-05-26 Jialei Wang , Mladen Kolar , Nathan Srebro , Tong Zhang

We study the distributed average consensus problem in multi-agent systems with directed communication links that are subject to quantized information flow. The goal of distributed average consensus is for the nodes, each associated with…

Systems and Control · Electrical Eng. & Systems 2019-07-26 Apostolos I. Rikos , Christoforos N. Hadjicostis

We study distributed algorithms for solving global optimization problems in which the objective function is the sum of local objective functions of agents and the constraint set is given by the intersection of local constraint sets of…

Optimization and Control · Mathematics 2015-03-14 Ilan Lobel , Asuman Ozdaglar , Diego Feijer

This paper proposes a deep learning framework to design distributed compression strategies in which distributed agents need to compress high-dimensional observations of a source, then send the compressed bits via bandwidth limited links to…

Information Theory · Computer Science 2022-03-10 Foad Sohrabi , Tao Jiang , Wei Yu

We study the problem of cooperative inference where a group of agents interact over a network and seek to estimate a joint parameter that best explains a set of observations. Agents do not know the network topology or the observations of…

Optimization and Control · Mathematics 2017-04-11 Angelia Nedić , Alex Olshevsky , César A. Uribe

In distributed optimization for large-scale learning, a major performance limitation comes from the communications between the different entities. When computations are performed by workers on local data while a coordinator machine…

Optimization and Control · Mathematics 2020-06-26 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick , Massih-Reza Amini

We consider a network of agents that aim to learn some unknown state of the world using private observations and exchange of beliefs. At each time, agents observe private signals generated based on the true unknown state. Each agent might…

Systems and Control · Computer Science 2015-09-16 Mohammad Amin Rahimian , Shahin Shahrampour , Ali Jadbabaie

We formulate the problem of fake news detection using distributed fact-checkers (agents) with unknown reliability. The stream of news/statements is modeled as an independent and identically distributed binary source (to represent true and…

Optimization and Control · Mathematics 2025-03-05 Ashwin Verma , Soheil Mohajer , Behrouz Touri