English
Related papers

Related papers: Statistical Hypothesis Testing for Information Val…

200 papers

Verifying that a statistically significant result is scientifically meaningful is not only good scientific practice, it is a natural way to control the Type I error rate. Here we introduce a novel extension of the p-value - a…

Methodology · Statistics 2018-07-04 Jeffrey D. Blume , Lucy DAgostino McGowan , William D. Dupont , Robert A. Greevy

Uncertainty in the estimation of the causal effect in observational studies is often due to unmeasured confounding, i.e., the presence of unobserved covariates linking treatments and outcomes. Instrumental Variables (IV) are commonly used…

Methodology · Statistics 2019-07-30 M. Usaid Awan , Yameng Liu , Marco Morucci , Sudeepa Roy , Cynthia Rudin , Alexander Volfovsky

Using a model of the environment and a value function, an agent can construct many estimates of a state's value, by unrolling the model for different lengths and bootstrapping with its value function. Our key insight is that one can treat…

Graph-constrained estimation methods encourage similarities among neighboring covariates presented as nodes on a graph, which can result in more accurate estimations, especially in high dimensional settings. Variable selection approaches…

Methodology · Statistics 2018-05-29 Sen Zhao , Ali Shojaie

This paper studies the construction of p-values for nonparametric outlier detection, taking a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a reference data set or are…

Methodology · Statistics 2024-03-12 Stephen Bates , Emmanuel Candès , Lihua Lei , Yaniv Romano , Matteo Sesia

Positive predictive value and negative predictive value are two widely used parameters to assess the clinical usefulness of a medical diagnostic test. When there are two diagnostic tests, it is recommendable to make a comparative assessment…

Methodology · Statistics 2024-05-29 Antonio Martín Andrés , Pedro Femia Marzo

Inference from limited data requires a notion of measure on parameter space, most explicit in the Bayesian framework as a prior. Here we demonstrate that Jeffreys prior, the best-known uninformative choice, introduces enormous bias when…

Other Statistics · Statistics 2023-04-03 Michael C. Abbott , Benjamin B. Machta

Bayesian statistical inference is a powerful tool for model-data comparisons and extractions of physical parameters that are often unknown functions of system variables. Existing Bayesian analyses often rely on explicit parametrizations of…

High Energy Physics - Phenomenology · Physics 2023-08-09 Man Xie , Weiyao Ke , Hanzhong Zhang , Xin-Nian Wang

Choosing a decision threshold is one of the challenging job in any classification tasks. How much the model is accurate, if the deciding boundary is not picked up carefully, its entire performance would go in vain. On the other hand, for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Bharat Bohara

A fundamental task in the analysis of datasets with many variables is screening for associations. This can be cast as a multiple testing task, where the objective is achieving high detection power while controlling type I error. We consider…

Methodology · Statistics 2021-09-01 Nikolaos Ignatiadis , Wolfgang Huber

In this paper, I develop a refinement of stability for matching markets with incomplete information. I introduce Information-Credible Pairwise Stability (ICPS), a solution concept in which deviating pairs can use credible, costly tests to…

Theoretical Economics · Economics 2025-10-28 Kaibalyapati Mishra

In online multiple testing, an a priori unknown number of hypotheses are tested sequentially, i.e. at each time point a test decision for the current hypothesis has to be made using only the data available so far. Although many powerful…

Methodology · Statistics 2025-03-11 Vincent Jankovic , Lasse Fischer , Werner Brannath

The use of machine learning models in decision support systems with high societal impact raised concerns about unfair (disparate) results for different groups of people. When evaluating such unfair decisions, one generally relies on…

Machine Learning · Computer Science 2023-05-12 Guilherme Dean Pelegrina , Miguel Couceiro , Leonardo Tomazeli Duarte

We propose a weak-identification-robust test for linear instrumental variable (IV) regressions with high-dimensional instruments, whose number is allowed to exceed the sample size. In addition, our test is robust to general error…

Econometrics · Economics 2025-07-01 Qu Feng , Sombut Jaidee , Wenjie Wang

Various text analysis techniques exist, which attempt to uncover unstructured information from text. In this work, we explore using statistical dependence measures for textual classification, representing text as word vectors. Student…

Computation and Language · Computer Science 2018-08-01 Samuel Cunningham-Nelson , Mahsa Baktashmotlagh , Wageeh Boles

Food authenticity studies are concerned with determining if food samples have been correctly labeled or not. Discriminant analysis methods are an integral part of the methodology for food authentication. Motivated by food authenticity…

Methodology · Statistics 2010-10-08 Thomas Brendan Murphy , Nema Dean , Adrian E. Raftery

Information theoretic measures (e.g. the Kullback Liebler divergence and Shannon mutual information) have been used for exploring possibly nonlinear multivariate dependencies in high dimension. If these dependencies are assumed to follow a…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Morteza Noshad , Salimeh Yasaei Sekeh , Alfred O. Hero

High-dimensional vector autoregression with measurement error is frequently encountered in a large variety of scientific and business applications. In this article, we study statistical inference of the transition matrix under this model.…

Methodology · Statistics 2020-09-18 Xiang Lyu , Jian Kang , Lexin Li

Parametric inference posits a statistical model that is a specified family of probability distributions. Restricted inference, e.g., restricted likelihood ratio testing, attempts to exploit the structure of a statistical submodel that is a…

Statistics Theory · Mathematics 2019-03-22 Michael W. Trosset , Carey E. Priebe

The Fisher Information matrix is a widely used measure for applications ranging from statistical inference, information geometry, experiment design, to the study of criticality in biological systems. Yet there is no commonly accepted…

Computation · Statistics 2016-02-17 Omri Har Shemesh , Rick Quax , Borja Miñano , Alfons G. Hoekstra , Peter M. A. Sloot