English
Related papers

Related papers: Optimal Decision Rules for Composite Binary Hypoth…

200 papers

It is well understood that Bayesian decision theory and average case analysis are essentially identical. However, if one is interested in performing uncertainty quantification for a numerical task, it can be argued that standard approaches…

Methodology · Statistics 2020-07-16 Chris. J. Oates , Jon Cockayne , Dennis Prangle , T. J. Sullivan , Mark Girolami

This paper investigates the effect of quantization on the performance of the Neyman-Pearson test. It is assumed that a sensing unit observes samples of a correlated stationary ergodic multivariate process. Each sample is passed through an…

Information Theory · Computer Science 2011-09-05 Joffrey Villard , Pascal Bianchi

The problem of verifying whether a multi-component system has anomalies or not is addressed. Each component can be probed over time in a data-driven manner to obtain noisy observations that indicate whether the selected component is…

Information Theory · Computer Science 2020-05-19 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

We propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to detect deviations from a null hypothesis when the alternative to the null hypothesis is sampled from a…

Applications · Statistics 2020-07-07 Christian Bartels , Johanna Mielke , Ekkehard Glimm

The indirect effect of an exposure on an outcome through an intermediate variable can be identified by a product of two regression coefficients under certain causal and regression modeling assumptions. In this context, the null hypothesis…

Statistics Theory · Mathematics 2025-07-23 Caleb H. Miles , Antoine Chambaz

We propose and study a general method for construction of consistent statistical tests on the basis of possibly indirect, corrupted, or partially available observations. The class of tests devised in the paper contains Neyman's smooth…

Statistics Theory · Mathematics 2017-09-22 Mikhail Langovoy

In this paper we consider the problem of binary hypothesis testing with finite memory systems. Let $X_1,X_2,\ldots$ be a sequence of independent identically distributed Bernoulli random variables, with expectation $p$ under $\mathcal{H}_0$…

Information Theory · Computer Science 2020-05-18 Tomer Berg , Ofer Shayevitz , Or Ordentlich

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

We consider a multi-stage distributed detection scenario, where $n$ sensors and a fusion center (FC) are deployed to accomplish a binary hypothesis test. At each time stage, local sensors generate binary messages, assumed to be spatially…

Signal Processing · Electrical Eng. & Systems 2023-01-04 Guangyang Zeng , Xiaoqiang Ren , Junfeng Wu

In this article, we propose a novel Bayesian multiple testing formulation for model and variable selection in inverse setups, judiciously embedding the idea of inverse reference distributions proposed by Bhattacharya (2013) in a mixture…

Statistics Theory · Mathematics 2020-07-16 Debashis Chatterjee , Sourabh Bhattacharya

Testing of hypotheses is a well studied topic in mathematical statistics. Recently, this issue has also been addressed in the context of Inverse Problems, where the quantity of interest is not directly accessible but only after the…

Statistics Theory · Mathematics 2024-04-09 Remo Kretschmann , Daniel Wachsmuth , Frank Werner

Bayesian optimization is a popular framework for efficiently tackling black-box search problems. As a rule, these algorithms operate by iteratively choosing what to evaluate next until some predefined budget has been exhausted. We…

Machine Learning · Statistics 2024-12-12 James T. Wilson

We consider the problem of hypothesis testing in the situation when the first hypothesis is simple and the second one is local one-sided composite. We describe the choice of the thresholds and the power functions of the Score Function test,…

Statistics Theory · Mathematics 2015-02-26 Serguei Dachian , Yury Kutoyants , Lin Yang

Two active hypothesis testing problems are formulated. In these problems, the agent can perform a fixed number of experiments and then decide on one of the hypotheses. The agent is also allowed to declare its experiments inconclusive if…

Systems and Control · Electrical Eng. & Systems 2019-11-19 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

Computer models, aiming at simulating a complex real system, are often calibrated in the light of data to improve performance. Standard calibration methods assume that the optimal values of calibration parameters are invariant to the model…

Methodology · Statistics 2017-09-01 Georgios Karagiannis , Bledar A. Konomi , Guang Lin

The distributed hypothesis testing problem with full side-information is studied. The trade-off (reliability function) between the two types of error exponents under limited rate is studied in the following way. First, the problem is…

Information Theory · Computer Science 2019-04-24 Nir Weinberger , Yuval Kochman

A unified framework is proposed for tests of unobserved heterogeneity in parametric statistic models based on Neyman's $C(\alpha)$ approach. Such tests are irregular in the sense that the first order derivative of the log likelihood with…

Statistics Theory · Mathematics 2014-10-07 Jiaying Gu

The problem of robust binary hypothesis testing is studied. Under both hypotheses, the data-generating distributions are assumed to belong to uncertainty sets constructed through moments; in particular, the sets contain distributions whose…

Statistics Theory · Mathematics 2024-01-09 Akshayaa Magesh , Zhongchang Sun , Venugopal V. Veeravalli , Shaofeng Zou

Bayesian estimation is increasingly popular for performing model based inference to support policymaking. These data are often collected from surveys under informative sampling designs where subject inclusion probabilities are designed to…

Methodology · Statistics 2018-07-13 Luis G. Leon-Novelo , Terrance D. Savitsky

We consider the problem of binary classification with abstention in the relatively less studied \emph{bounded-rate} setting. We begin by obtaining a characterization of the Bayes optimal classifier for an arbitrary input-label distribution…

Machine Learning · Computer Science 2019-05-24 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi