English
Related papers

Related papers: Agreement Implies Accuracy for Substitutable Signa…

200 papers

The explanations of large language models have recently been shown to be sensitive to the randomness used for their training, creating a need to characterize this sensitivity. In this paper, we propose a characterization that questions the…

Computation and Language · Computer Science 2024-03-18 Jeremie Bogaert , Francois-Xavier Standaert

Measurement uncertainty relations are quantitative bounds on the errors in an approximate joint measurement of two observables. They can be seen as a generalization of the error/disturbance tradeoff first discussed heuristically by…

Quantum Physics · Physics 2014-05-01 Paul Busch , Pekka Lahti , Reinhard F Werner

I present several new relations between mutual information (MI) and statistical estimation error for a system that can be regarded simultaneously as a communication channel and as an estimator of an input parameter. I first derive a…

Applications · Statistics 2010-10-08 Sudhakar Prasad

We investigate an existing distributed algorithm for learning sparse signals or data over networks. The algorithm is iterative and exchanges intermediate estimates of a sparse signal over a network. This learning strategy using exchange of…

Machine Learning · Statistics 2017-09-25 Ahmed Zaki , Partha P. Mitra , Lars K. Rasmussen , Saikat Chatterjee

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

Consider a sensor network made of remote nodes connected to a common fusion center. In a recent work Blum and Sadler [1] propose the idea of ordered transmissions -sensors with more informative samples deliver their messages first- and…

Information Theory · Computer Science 2011-03-29 Paolo Braca , Stefano Marano , Vincenzo Matta

We establish the convergence rates and asymptotic distributions of the common break change-point estimators, obtained by least squares and maximum likelihood in panel data models and compare their asymptotic variances. Our model assumptions…

Statistics Theory · Mathematics 2017-08-22 Monika Bhattacharjee , Moulinath Banerjee , George Michailidis

Radio map estimation (RME) is the problem of inferring the value of a certain metric (e.g. signal power) across an area of interest given a collection of measurements. While most works tackle this problem from a purely non-Bayesian…

Signal Processing · Electrical Eng. & Systems 2025-08-11 Tien Ngoc Ha , Daniel Romero

Autonomous agents operating in sequential decision-making tasks under uncertainty can benefit from external action suggestions, which provide valuable guidance but inherently vary in reliability. Existing methods for incorporating such…

Artificial Intelligence · Computer Science 2026-05-26 Dylan M. Asmar , Mykel J. Kochenderfer

We consider a general framework of online learning with expert advice where regret is defined with respect to sequences of experts accepted by a weighted automaton. Our framework covers several problems previously studied, including…

Machine Learning · Computer Science 2017-10-24 Mehryar Mohri , Scott Yang

We study empirical Bayes estimation of the effect sizes of $N$ units from $K$ noisy observations on each unit. We show that it is possible to achieve near-Bayes optimal mean squared error, without any assumptions or knowledge about the…

Methodology · Statistics 2021-08-11 Nikolaos Ignatiadis , Sujayam Saha , Dennis L. Sun , Omkar Muralidharan

To make decisions we are guided by the evidence we collect, as well as the opinions of friends and neighbors. How do we integrate our private beliefs with information we obtain from our social network? To understand the strategies humans…

Physics and Society · Physics 2020-03-04 Bhargav Karamched , Simon Stolarczyk , Zachary Kilpatrick , Krešimir Josić

Heisenberg's uncertainty principle has recently led to general measurement uncertainty relations for quantum systems: incompatible observables can be measured jointly or in sequence only with some unavoidable approximation, which can be…

Quantum Physics · Physics 2017-06-27 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

We consider the problem of distributed estimation, where local processors observe independent samples conditioned on a common random parameter of interest, map the observations to a finite number of bits, and send these bits to a remote…

Information Theory · Computer Science 2015-04-24 Aolin Xu , Maxim Raginsky

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

Computation · Statistics 2021-12-16 Aden Forrow , Ruth E. Baker

In this note, the problem of simultaneous leader-following consensus and parameter estimation is studied for a class of multi-agent systems subject to an uncertain leader system. The leader system is described by a sum of sinusoids with…

Systems and Control · Electrical Eng. & Systems 2020-07-28 Shimin Wang , Xiangyu Meng

Confidence intervals for a binomial parameter or for the ratio of Poisson means are commonly desired in high energy physics (HEP) applications such as measuring a detection efficiency or branching ratio. Due to the discreteness of the data,…

Data Analysis, Statistics and Probability · Physics 2009-12-23 Robert D. Cousins , Kathryn E. Hymes , Jordan Tucker

At the heart of non-parametric spectral estimation, lies the dilemma known as the bias-variance trade-off: low biased estimators tend to have high variance and low variance estimators tend to have high bias. In 1982, Thomson introduced a…

Classical Analysis and ODEs · Mathematics 2016-05-06 Luís Daniel Abreu , José Luis Romero

Online algorithms for detecting changepoints, or abrupt shifts in the behavior of a time series, are often deployed with limited resources, e.g., to edge computing settings such as mobile phones or industrial sensors. In these scenarios it…

Machine Learning · Statistics 2021-07-27 Gregory W. Gundersen , Diana Cai , Chuteng Zhou , Barbara E. Engelhardt , Ryan P. Adams

In this study, I present a theoretical social learning model to investigate how confirmation bias affects opinions when agents exchange information over a social network. Hence, besides exchanging opinions with friends, agents observe a…

Theoretical Economics · Economics 2023-02-27 Marcos R. Fernandes