English
Related papers

Related papers: Network-based consensus averaging with general noi…

200 papers

In this work we study the problem of unconstrained convex-optimization in a fully distributed multi-agent setting which includes asynchronous computation and lossy communication. In particular, we extend a recently proposed algorithm named…

Optimization and Control · Mathematics 2017-07-31 Nicoletta Bof , Ruggero Carli , Giuseppe Notarstefano , Luca Schenato , Damiano Varagnolo

This paper deals with the parametric inference for integrated signals embedded in an additive Gaussian noise and observed at deterministic discrete instants which are not necessarily equidistant. The unknown parameter is multidimensional…

Statistics Theory · Mathematics 2019-03-18 Dominique Dehay , Khalil El Waled , Vincent Monsan

In this paper, we investigate the approximate consensus problem in highly dynamic networks in which topology may change continually and unpredictably. We prove that in both synchronous and partially synchronous systems, approximate…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-11-13 Bernadette Charron-Bost , Matthias Függer , Thomas Nowak

In this paper, we discuss a class of distributed detection algorithms which can be viewed as implementations of Bayes' law in distributed settings. Some of the algorithms are proposed in the literature most recently, and others are first…

Methodology · Statistics 2015-11-10 Qipeng Liu , Jiuhua Zhao , Xiaofan Wang

For the differential privacy under the sub-Gamma noise, we derive the asymptotic properties of a class of network models with binary values with a general link function. In this paper, we release the degree sequences of the binary networks…

Statistics Theory · Mathematics 2023-11-14 Jing Luo , Haoyu Wei , Xiaoyu Lei , Jiaxin Guo

We analyze the problem of estimating a signal from multiple measurements on a $\mbox{group action channel}$ that linearly transforms a signal by a random group action followed by a fixed projection and additive Gaussian noise. This channel…

Information Theory · Computer Science 2018-01-16 Emmanuel Abbe , João M. Pereira , Amit Singer

This paper considers the problem of dynamic average consensus algorithm design for a group of communicating agents. This problem consists of designing a distributed algorithm that enables a group of agents with communication and computation…

Systems and Control · Computer Science 2018-11-27 Solmaz S. Kia , Bryan Van Scoy , Jorge Cortes , Randy A. Freeman , Kevin M. Lynch , Sonia Martinez

A distributed inference scheme which uses bounded transmission functions over a Gaussian multiple access channel is considered. When the sensor measurements are decreasingly reliable as a function of the sensor index, the conditions on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-16 Sivaraman Dasarathan , Cihan Tepedelenlioglu

In this paper, we address the discrete-time average consensus problem in strongly connected directed graphs, where nodes exchange information over unreliable error-prone communication links. We enhance the Robustified Ratio Consensus…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Evagoras Makridis , Themistoklis Charalambous , Christoforos N. Hadjicostis

In this letter, we address the problem of estimating Gaussian noise level from the trained dictionaries in update stage. We first provide rigorous statistical analysis on the eigenvalue distributions of a sample covariance matrix. Then we…

Signal Processing · Electrical Eng. & Systems 2017-12-12 Rui Chen , Changshui Yang , Huizhu Jia , Xiaodong Xie

Relative Fisher information, also known as score matching, is a recently introduced learning method for parameter estimation. Fundamental relations between relative entropy and score matching have been established in the literature for…

Information Theory · Computer Science 2025-04-29 Yirong Shen , Lu Gan , Cong Ling

A quantile is defined as a value below which random draws from a given distribution falls with a given probability. In a centralized setting where the cumulative distribution function (CDF) is unknown, the empirical CDF (ECDF) can be used…

Systems and Control · Computer Science 2018-05-02 Jongmin Lee , Cihan Tepedelenlioglu , Andreas Spanias

We consider the problem of estimating an input signal from noisy measurements in both parallel scalar Gaussian channels and linear mixing systems. The performance of the estimation process is quantified by the $\ell_\infty$ norm error…

Information Theory · Computer Science 2013-04-23 Jin Tan , Dror Baron , Liyi Dai

We consider the problem of signal estimation (denoising) from a statistical mechanical perspective, using a relationship between the minimum mean square error (MMSE), of estimating a signal, and the mutual information between this signal…

Information Theory · Computer Science 2016-11-17 Neri Merhav , Dongning Guo , Shlomo Shamai

This paper studies the fastest distributed consensus averaging problem on branches of an arbitrary connected sensor network. In the previous works full knowledge about the sensor network's connectivity topology was required for determining…

Information Theory · Computer Science 2011-06-06 Saber Jafarizadeh , Abbas Jamalipour

We analyze a stochastic approximation algorithm for decision-dependent problems, wherein the data distribution used by the algorithm evolves along the iterate sequence. The primary examples of such problems appear in performative prediction…

Optimization and Control · Mathematics 2024-05-15 Joshua Cutler , Mateo Díaz , Dmitriy Drusvyatskiy

We study asymptotic performance of distributed detection in large scale connected sensor networks. Contrasting to the canonical parallel network where a single node has access to local decisions from all other nodes, each node can only…

Information Theory · Computer Science 2018-10-16 Shengyu Zhu , Biao Chen

By learning the gradient of smoothed data distributions, diffusion models can iteratively generate samples from complex distributions. The learned score function enables their generalization capabilities, but how the learned score relates…

Machine Learning · Computer Science 2024-12-16 Binxu Wang , John J. Vastola

Expectation Maximization (EM) is the standard method to learn Gaussian mixtures. Yet its classic, centralized form is often infeasible, due to privacy concerns and computational and communication bottlenecks. Prior work dealt with data…

Machine Learning · Computer Science 2022-01-26 Pedro Valdeira , Cláudia Soares , João Xavier

In distributed networks, calculating the maximum element is a fundamental task in data analysis, known as the distributed maximum consensus problem. However, the sensitive nature of the data involved makes privacy protection essential.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Wenrui Yu , Richard Heusdens , Jun Pang , Qiongxiu Li