English
Related papers

Related papers: Theoretical Bounds in Minimax Decentralized Hypoth…

200 papers

In this work we study a special minimax problem where there are linear constraints that couple both the minimization and maximization decision variables. The problem is a generalization of the traditional saddle point problem (which does…

Optimization and Control · Mathematics 2022-11-29 Ioannis Tsaknakis , Mingyi Hong , Shuzhong Zhang

Fundamental limits on the error probabilities of a family of decentralized detection algorithms (eg., the social learning rule proposed by Lalitha et al. over directed graphs are investigated. In decentralized detection, a network of nodes…

Information Theory · Computer Science 2025-02-07 Bruce , Huang , I-Hsiang Wang

This paper reviews recent developments in fundamental limits and optimal algorithms for change point analysis. We focus on minimax optimal rates in change point detection and localisation, in both parametric and nonparametric models. We…

Statistics Theory · Mathematics 2020-11-04 Yi Yu

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

Coding and testing schemes for binary hypothesis testing over noisy networks are proposed and their corresponding type-II error exponents are derived. When communication is over a discrete memoryless channel (DMC), our scheme combines…

Information Theory · Computer Science 2018-06-15 Sadaf Salehkalaibar , Michele Wigger

The classical binary hypothesis testing problem is revisited. We notice that when one of the hypotheses is composite, there is an inherent difficulty in defining an optimality criterion that is both informative and well-justified. For…

Statistics Theory · Mathematics 2021-03-29 Michael Bell , Yuval Kochman

The effect of measurement errors in discriminant analysis is investigated. Given observations $Z=X+\epsilon$, where $\epsilon$ denotes a random noise, the goal is to predict the density of $X$ among two possible candidates $f$ and $g$. We…

Statistics Theory · Mathematics 2015-05-13 Sébastien Loustau , Clément Marteau

Fusing and sharing information from multiple sensors over a network is a challenging task, partly due to the absence of a foundational rule for fusing probability distributions that preserves the independence of sources. To address this, we…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Jeremie Houssineau , Han Cai , Murat Uney , Emmanuel Delande

Ensuring the reliability of automated decision-making based on neural networks will be crucial as Artificial Intelligence systems are deployed more widely in critical situations. This paper proposes a new approach for measuring confidence…

Machine Learning · Computer Science 2025-05-01 Daniel Sikar , Artur d'Avila Garcez , Tillman Weyde

The problem of quickest detection of a change in the mean of a sequence of independent observations is studied. The pre-change distribution is assumed to be stationary, while the post-change distributions are allowed to be non-stationary.…

Signal Processing · Electrical Eng. & Systems 2021-08-26 Yuchen Liang , Venugopal V. Veeravalli

A distributed adaptive algorithm to estimate a time-varying signal, measured by a wireless sensor network, is designed and analyzed. One of the major features of the algorithm is that no central coordination among the nodes needs to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-10-22 Carlo Fischione , Alberto Speranzon , Karl H. Johansson , Alberto Sangiovanni-Vincentelli

Distributed optimization is an important direction of research in modern optimization theory. Its applications include large scale machine learning, distributed signal processing and many others. The paper studies decentralized min-max…

Optimization and Control · Mathematics 2023-09-08 Nhat Trung Nguyen , Alexander Rogozin , Dmitry Metelev , Alexander Gasnikov

The geometrical features of the (non-convex) loss landscape of neural network models are crucial in ensuring successful optimization and, most importantly, the capability to generalize well. While minimizers' flatness consistently…

Disordered Systems and Neural Networks · Physics 2020-07-28 Carlo Baldassi , Riccardo Della Vecchia , Carlo Lucibello , Riccardo Zecchina

Received-energy test for non-coherent decision fusion over a Rayleigh fading multiple access channel (MAC) without diversity was recently shown to be optimum in the case of conditionally mutually independent and identically distributed…

Information Theory · Computer Science 2012-12-20 D. Ciuonzo , G. Romano , P. Salvo Rossi

We consider a network, tasked with solving binary distributed detection, consisting of N sensors, a fusion center (FC), and a feedback channel from the FC to sensors. Each sensor is capable of harvesting energy and is equipped with a finite…

Signal Processing · Electrical Eng. & Systems 2022-10-12 Ghazaleh Ardeshiri , Azadeh Vosoughi

Community structure in networks has been investigated from many viewpoints, usually with the same end result: a community detection algorithm of some kind. Recent research offers methods for combining the results of such algorithms into…

Social and Information Networks · Computer Science 2012-01-10 James P. Ferry , J. Oren Bumgarner

The problem of minimizing convex functionals of probability distributions is solved under the assumption that the density of every distribution is bounded from above and below. A system of sufficient and necessary first-order optimality…

Information Theory · Computer Science 2018-12-05 Michael Fauss , Abdelhak M. Zoubir

Community detection refers to the problem of clustering the nodes of a network into groups. Existing inferential methods for community structure mainly focus on unweighted (binary) networks. Many real-world networks are nonetheless weighted…

Statistics Theory · Mathematics 2022-04-21 Mingao Yuan , Zuofeng Shang

Sampling-based methods, e.g., Deep Ensembles and Bayesian Neural Nets have become promising approaches to improve the quality of uncertainty estimation and robust generalization. However, they suffer from a large model size and high latency…

Machine Learning · Computer Science 2024-05-29 Ha Manh Bui , Anqi Liu

Consider the two related problems of sensor selection and sensor fusion. In the first, given a set of sensors, one wishes to identify a subset of the sensors, which while small in size, captures the essence of the data gathered by the…

Information Theory · Computer Science 2012-01-20 Asaf Cohen , Shlomi Dolav , Guy Leshem