English
Related papers

Related papers: Null/No Information Rate (NIR): a statistical test…

200 papers

How can we assess the reliability of a dataset without access to ground truth? We introduce the problem of reliability scoring for datasets collected from potentially strategic sources. The true data are unobserved, but we see outcomes of…

Machine Learning · Computer Science 2025-10-21 Yiling Chen , Shi Feng , Paul Kattuman , Fang-Yi Yu

A major challenge in studying robustness in deep learning is defining the set of ``meaningless'' perturbations to which a given Neural Network (NN) should be invariant. Most work on robustness implicitly uses a human as the reference model…

Machine Learning · Computer Science 2022-06-27 Vedant Nanda , Till Speicher , Camila Kolling , John P. Dickerson , Krishna P. Gummadi , Adrian Weller

The design of optimal test statistics is a key task in frequentist statistics and for a number of scenarios optimal test statistics such as the profile-likelihood ratio are known. By turning this argument around we can find the profile…

Methodology · Statistics 2022-03-25 Lukas Heinrich

We describe a method for fitting distributions to data which only requires knowledge of the parametric form of either the signal or the background but not both. The unknown distribution is fit using a non-parametric kernel density…

Data Analysis, Statistics and Probability · Physics 2015-06-03 Wolfgang A. Rolke , Angel M. López

The maximal information coefficient (MIC), which measures the amount of dependence between two variables, is able to detect both linear and non-linear associations. However, computational cost grows rapidly as a function of the dataset…

Information Theory · Computer Science 2015-08-18 Ali Mousavi , Richard G. Baraniuk

The Brier score is a widely used metric evaluating overall performance of probabilistic predictions for binary outcomes in clinical research. However, its interpretation can be complex, as it does not align with commonly taught concepts in…

Applications · Statistics 2025-07-08 Linard Hoessly

Cycles, which can be found in many different kinds of networks, make the problems more intractable, especially when dealing with dynamical processes on networks. On the contrary, tree networks in which no cycle exists, are simplifications…

Physics and Society · Physics 2021-04-07 Wenjun Zhang , Wei Li , Weibing Deng

We propose a test of independence of two multivariate random vectors, given a sample from the underlying population. Our approach, which we call MINT, is based on the estimation of mutual information, whose decomposition into joint and…

Methodology · Statistics 2017-11-20 Thomas B. Berrett , Richard J. Samworth

Statistical hypothesis testing is the central method to demarcate scientific theories in both exploratory and inferential analyses. However, whether this method befits such purpose remains a matter of debate. Established approaches to…

Data Analysis, Statistics and Probability · Physics 2024-10-29 Orestis Loukas , Ho-Ryun Chung

Given a set of incomplete observations, we study the nonparametric problem of testing whether data are Missing Completely At Random (MCAR). Our first contribution is to characterise precisely the set of alternatives that can be…

Statistics Theory · Mathematics 2022-05-19 Thomas B Berrett , Richard J Samworth

Cluster analysis is an unsupervised learning strategy that can be employed to identify subgroups of observations in data sets of unknown structure. This strategy is particularly useful for analyzing high-dimensional data such as microarray…

Methodology · Statistics 2016-10-07 Erika S. Helgeson , Eric Bair

Scoring systems are classification models that only require users to add, subtract and multiply a few meaningful numbers to make a prediction. These models are often used because they are practical and interpretable. In this paper, we…

Machine Learning · Statistics 2014-04-14 Berk Ustun , Stefano Tracà , Cynthia Rudin

In this paper, we propose a new model to address the problem of negative interest rates that preserves the analytical tractability of the original Cox-Ingersoll-Ross (CIR) model without introducing a shift to the market interest rates,…

Trading and Market Microstructure · Quantitative Finance 2021-06-08 Marco Di Francesco , Kevin Kamm

Although the halting problem is undecidable, imperfect testers that fail on some instances are possible. Such instances are called hard for the tester. One variant of imperfect testers replies "I don't know" on hard instances, another…

Logic in Computer Science · Computer Science 2014-12-01 Antti Valmari

In this letter, we improve the results in [5] by relaxing the symmetry assumption and also taking the noise term into account. The author examines two discrete-time autonomous linear systems whose motivation comes from a neural network…

Data Analysis, Statistics and Probability · Physics 2016-11-17 Zekeriya Uykan

Non-Intrusive Load Monitoring (NILM) aims to predict the status or consumption of domestic appliances in a household only by knowing the aggregated power load. NILM can be formulated as regression problem or most often as a classification…

Signal Processing · Electrical Eng. & Systems 2023-07-25 Daniel Precioso , David Gómez-Ullate

Missing data occur frequently in empirical studies in health and social sciences, often compromising our ability to make accurate inferences. An outcome is said to be missing not at random (MNAR) if, conditional on the observed variables,…

Methodology · Statistics 2019-01-23 BaoLuo Sun , Lan Liu , Wang Miao , Kathleen Wirth , James Robins , Eric Tchetgen Tchetgen

This paper deals with developing tests for checking whether an unknown system has certain structural properties. The tests that we are aiming at are in terms of noisy input-state-output data obtained from the unknown system. Since, in…

Optimization and Control · Mathematics 2020-10-30 Jaap Eising , Harry Trentelman

Binary classification is a fundamental task in machine learning, with applications spanning various scientific domains. Whether scientists are conducting fundamental research or refining practical applications, they typically assess and…

Machine Learning · Computer Science 2023-10-20 Attila Fazekas , György Kovács

This report provides an overview of the field of Information Retrieval (IR) in healthcare. It does not aim to introduce general concepts and theories of IR but to present and describe specific aspects of Health Information Retrieval (HIR).…

Information Retrieval · Computer Science 2022-05-19 Carla Teixeira Lopes