English
Related papers

Related papers: Estimate Exchange over Network is Good for Distrib…

200 papers

Graph learning is often a necessary step in processing or representing structured data, when the underlying graph is not given explicitly. Graph learning is generally performed centrally with a full knowledge of the graph signals, namely…

Signal Processing · Electrical Eng. & Systems 2021-12-14 Isabela Cunha Maia Nobre , Mireille El Gheche , Pascal Frossard

Sparse signal representations based on linear combinations of learned atoms have been used to obtain state-of-the-art results in several practical signal processing applications. Approximation methods are needed to process high-dimensional…

Machine Learning · Computer Science 2020-02-17 Fredrik Sandin , Sergio Martin-del-Campo

Swarm foraging is a common test case application for multi-robot systems. In this paper we present a novel algorithm for controlling swarm robots with limited communication range and storage capacity to efficiently search for and retrieve…

Robotics · Computer Science 2019-06-18 Simon O. Obute , Mehmet R. Dogar , Jordan H. Boyle

Distributed statistical learning problems arise commonly when dealing with large datasets. In this setup, datasets are partitioned over machines, which compute locally, and communicate short messages. Communication is often the bottleneck.…

Statistics Theory · Mathematics 2022-10-25 Edgar Dobriban , Yue Sheng

Distributed algorithms can be efficiently used for solving economic dispatch problem (EDP) in power systems. To implement a distributed algorithm, a communication network is required, making the algorithm vulnerable to noise which may cause…

Systems and Control · Electrical Eng. & Systems 2021-11-18 Wenwen Wu , Shuai Liu , Shanying Zhu

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

In this paper, we study a distributed privacy-preserving learning problem in social networks with general topology. The agents can communicate with each other over the network, which may result in privacy disclosure, since the…

Social and Information Networks · Computer Science 2023-01-30 Youming Tao , Shuzhen Chen , Feng Li , Dongxiao Yu , Jiguo Yu , Hao Sheng

We study the tradeoff between the statistical error and communication cost of distributed statistical estimation problems in high dimensions. In the distributed sparse Gaussian mean estimation problem, each of the $m$ machines receives $n$…

Machine Learning · Computer Science 2016-05-11 Mark Braverman , Ankit Garg , Tengyu Ma , Huy L. Nguyen , David P. Woodruff

We consider several estimation and learning problems that networked agents face when making decisions given their uncertainty about an unknown variable. Our methods are designed to efficiently deal with heterogeneity in both size and…

Applications · Statistics 2016-11-11 M. Amin Rahimian , Ali Jadbabaie

Routing packets opportunistically is an essential part of multihop ad hoc wireless sensor networks. The existing routing techniques are not adaptive opportunistic. In this paper we have proposed an adaptive opportunistic routing scheme that…

Networking and Internet Architecture · Computer Science 2013-11-01 G. Srinivas Rao , A. V. Ramana

A key issue in the control of distributed discrete systems modeled as Markov decisions processes, is that often the state of the system is not directly observable at any single location in the system. The participants in the control scheme…

Information Theory · Computer Science 2017-05-01 Jie Ren , Solmaz Torabi , John MacLaren Walsh

We propose novel iterative learning control algorithms to track a reference trajectory in resource-constrained control systems. In many applications, there are constraints on the number of control actions, delivered to the actuator from the…

Optimization and Control · Mathematics 2017-09-29 Burak Demirel , Euhanna Ghadimi , Daniel E. Quevedo

Edge signal processing facilitates distributed learning and inference in the client-server model proposed in federated learning. In traditional machine learning, clients (IoT devices) that acquire raw signal samples can aid a data center…

Signal Processing · Electrical Eng. & Systems 2024-10-03 Vijay Anavangot

While distributed training is often viewed as a solution to optimizing linear models on increasingly large datasets, inter-machine communication costs of popular distributed approaches can dominate as data dimensionality increases. Recent…

Machine Learning · Computer Science 2024-06-05 Fred Lu , Ryan R. Curtin , Edward Raff , Francis Ferraro , James Holt

The aim of this paper is to propose distributed strategies for adaptive learning of signals defined over graphs. Assuming the graph signal to be bandlimited, the method enables distributed reconstruction, with guaranteed performance in…

Machine Learning · Computer Science 2017-08-02 P. Di Lorenzo , P. Banelli , S. Barbarossa , S. Sardellitti

Broadcast networks are often used in modern communication systems. A common broadcast network is a single hop shared media system, where a transmitted message is heard by all neighbors, such as some LAN networks. In this work we consider a…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Israel Cidon , Osnat Mokryn

We propose a novel framework for analyzing the dynamics of distribution shift in real-world systems that captures the feedback loop between learning algorithms and the distributions on which they are deployed. Prior work largely models…

Machine Learning · Computer Science 2023-10-31 Lauren Conger , Franca Hoffmann , Eric Mazumdar , Lillian Ratliff

We study the problem of collaboratively estimating the state of an LTI system monitored by a network of sensors, subject to the following important practical considerations: (i) certain sensors might be arbitrarily compromised by an…

Systems and Control · Computer Science 2018-01-29 Aritra Mitra , Shreyas Sundaram

An extension to a recently introduced binary neural network is proposed in order to allow the learning of sparse messages, in large numbers and with high memory efficiency. This new network is justified both in biological and informational…

Neural and Evolutionary Computing · Computer Science 2012-08-21 Behrooz Kamary Aliabadi , Claude Berrou , Vincent Gripon , Xiaoran Jiang

Distributed optimization finds applications in large-scale machine learning, data processing and classification over multi-agent networks. In real-world scenarios, the communication network of agents may encounter latency that may affect…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Mohammadreza Doostmohammadian , Narahari Kasagatta Ramesh , Alireza Aghasi