English
Related papers

Related papers: Ordering for Communication-Efficient Quickest Chan…

200 papers

Node counting on a graph is subject to some fundamental theoretical limitations, yet a solution to such problems is necessary in many applications of graph theory to real-world systems, such as collective robotics and distributed sensor…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Arindam Saha , James A. R. Marshall , Andreagiovanni Reina

In multi-agent systems, strong connectivity of the communication network is often crucial for establishing consensus protocols, which underpin numerous applications in decision-making and distributed optimization. However, this connectivity…

Optimization and Control · Mathematics 2024-11-12 Guilherme Ramos , Diogo Poças , Sérgio Pequito

A $k$-defective clique of an undirected graph $G$ is a subset of its vertices that induces a nearly complete graph with a maximum of $k$ missing edges. The maximum $k$-defective clique problem, which asks for the largest $k$-defective…

Data Structures and Algorithms · Computer Science 2024-07-25 Chunyu Luo , Yi Zhou , Zhengren Wang , Mingyu Xiao

Clustering large datasets is a fundamental problem with a number of applications in machine learning. Data is often collected on different sites and clustering needs to be performed in a distributed manner with low communication. We would…

Data Structures and Algorithms · Computer Science 2017-02-02 Jiecao Chen , He Sun , David P. Woodruff , Qin Zhang

We consider the problem of minimizing the sum of cost functions pertaining to agents over a network whose topology is captured by a directed graph (i.e., asymmetric communication). We cast the problem into the ADMM setting, via a consensus…

Optimization and Control · Mathematics 2023-04-04 Dingran Yi , Nikolaos M. Freris

Implementing Decentralized Gradient Descent (DGD) in wireless systems is challenging due to noise, fading, and limited bandwidth, necessitating topology awareness, transmission scheduling, and the acquisition of channel state information…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Nicolo' Michelusi

The decentralized optimization paradigm assumes that each term of a finite-sum objective is privately stored by the corresponding agent. Agents are only allowed to communicate with their neighbors in the communication graph. We consider the…

Optimization and Control · Mathematics 2023-09-07 Demyan Yarmoshik , Alexander Rogozin , Alexander Gasnikov

In this paper, we propose to solve a regularized distributionally robust learning problem in the decentralized setting, taking into account the data distribution shift. By adding a Kullback-Liebler regularization function to the robust…

Machine Learning · Computer Science 2022-09-13 Chaouki Ben Issaid , Anis Elgabli , Mehdi Bennis

We study the parametric online changepoint detection problem, where the underlying distribution of the streaming data changes from a known distribution to an alternative that is of a known parametric form but with unknown parameters. We…

Statistics Theory · Mathematics 2023-05-22 Liyan Xie , George V. Moustakides , Yao Xie

We study the joint minimization of communication and computation costs in distributed computing, where a master node coordinates $N$ workers to evaluate a function over a library of $n$ files. Assuming that the function is decomposed into…

Information Theory · Computer Science 2026-01-12 Javad Maheri , K. K. Krishnan Namboodiri , Petros Elia

Distributed graph signal processing algorithms require the network nodes to communicate by exchanging messages in order to achieve a common objective. These messages have a finite precision in realistic networks, which may necessitate to…

Signal Processing · Electrical Eng. & Systems 2019-09-30 Isabela Cunha Maia Nobre , Pascal Frossard

We consider the distributed learning problem where a network of $n$ agents seeks to minimize a global function $F$. Agents have access to $F$ through noisy gradients, and they can locally communicate with their neighbors a network. We study…

Machine Learning · Computer Science 2020-11-09 Tiancheng Qin , S. Rasoul Etesami , César A. Uribe

This paper investigates sensor scheduling for state estimation of complex networks over shared transmission channels. For a complex network of dynamical systems, referred to as nodes, a sensor network is adopted to measure and estimate the…

Systems and Control · Electrical Eng. & Systems 2023-01-12 Peihu Duan , Lidong He , Lingying Huang , Guanrong Chen , Ling Shi

Detecting abrupt changes in streaming graph signals is relevant in a variety of applications ranging from energy and water supplies, to environmental monitoring. In this paper, we address this problem when anomalies activate localized…

Signal Processing · Electrical Eng. & Systems 2019-10-16 André Ferrari , Cédric Richard , Louis Verduci

We consider the following problem of decentralized statistical inference: given i.i.d. samples from an unknown distribution, estimate an arbitrary quantile subject to limits on the number of bits exchanged. We analyze a standard…

Information Theory · Computer Science 2007-07-13 Ram Rajagopal , Martin J. Wainwright

Consider a star network where each local node possesses a set of test statistics that exhibit a symmetric distribution around zero when their corresponding null hypothesis is true. This paper investigates statistical inference problems in…

Methodology · Statistics 2023-11-29 Mehrdad Pournaderi , Yu Xiang

Distributed average consensus is the main mechanism in algorithms for decentralized computation. In distributed average consensus algorithm each node has an initial state, and the goal is to compute the average of these initial states in…

Information Theory · Computer Science 2012-01-24 Saber Jafarizadeh , Abbas Jamalipour

In decentralized optimization, $m$ agents form a network and only communicate with their neighbors, which gives advantages in data ownership, privacy, and scalability. At the same time, decentralized stochastic gradient descent…

Optimization and Control · Mathematics 2022-12-13 Haishan Ye , Xiangyu Chang

We study the problem of finding and monitoring fixed-size subgraphs in a continually changing large-scale graph. We present the first approach that (i) performs worst-case optimal computation and communication, (ii) maintains a total memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-13 Khaled Ammar , Frank McSherry , Semih Salihoglu , Manas Joglekar

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian