English
Related papers

Related papers: Efficient Input Uncertainty Quantification for Rat…

200 papers

Standard uncertainty estimation techniques, such as dropout, often struggle to clearly distinguish reliable predictions from unreliable ones. We attribute this limitation to noisy classifier weights, which, while not impairing overall…

Machine Learning · Computer Science 2025-06-09 Haripriya Harikumar , Santu Rana

To use control charts in practice, the in-control state usually has to be estimated. This estimation has a detrimental effect on the performance of control charts, which is often measured for example by the false alarm probability or the…

Methodology · Statistics 2013-07-30 Axel Gandy , Jan Terje Kvaløy

Existing methods for quantifying predictive uncertainty in neural networks are either computationally intractable for large language models or require access to training data that is typically unavailable. We derive a lightweight…

Machine Learning · Computer Science 2026-04-01 Nils Grünefeld , Jes Frellsen , Christian Hardmeier

In data mining, when binary prediction rules are used to predict a binary outcome, many performance measures are used in a vast array of literature for the purposes of evaluation and comparison. Some examples include classification…

Machine Learning · Statistics 2025-07-08 Zheng Yuan , Wenxin Jiang

A number of popular estimators of the between-study variance, $\tau^2$, are based on the Cochran's $Q$ statistic for testing heterogeneity in meta analysis. We introduce new point and interval estimators of $\tau^2$ for log-odds-ratio.…

Methodology · Statistics 2022-08-02 Elena Kulinskaya , David C. Hoaglin

We study the fundamental problem of estimating the mean of a $d$-dimensional distribution with covariance $\Sigma \preccurlyeq \sigma^2 I_d$ given $n$ samples. When $d = 1$, \cite{catoni} showed an estimator with error $(1+o(1)) \cdot…

Statistics Theory · Mathematics 2024-02-20 Shivam Gupta , Samuel B. Hopkins , Eric Price

For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify…

Machine Learning · Statistics 2021-04-28 Themistoklis P. Sapsis

Traditional Relative Efficiency (RE), based solely on variance, has limitations in evaluating estimator performance, particularly in planned missing data designs. We introduce Bhirkuti's Relative Efficiency (BRE), a novel metric that…

Methodology · Statistics 2025-05-01 Aneel Bhusal , Todd D. Little

Research in NLP is often supported by experimental results, and improved reporting of such results can lead to better understanding and more reproducible science. In this paper we analyze three statistical estimators for expected validation…

Computation and Language · Computer Science 2021-10-05 Jesse Dodge , Suchin Gururangan , Dallas Card , Roy Schwartz , Noah A. Smith

The integrated conditional moment (ICM) test is a classical and widely used method for assessing the adequacy of regression models. Although it performs well in fixed-dimension settings, its behavior changes dramatically when the predictor…

Methodology · Statistics 2026-04-17 Yue Hu , Haiqi Li , Xintao Xia

The bootstrap is a foundational tool in statistical inference, but its classical implementation relies on Monte Carlo resampling, introducing approximation error and incurring high computational cost -- especially for large datasets and…

Computation · Statistics 2026-04-02 Yongkai Chen , Ping Ma , Wenxuan Zhong

Extracting the outcome of a quantum computation is a difficult task. In many cases, the quantum phase estimation algorithm is used to digitally encode a value in a quantum register whose amplitudes' magnitudes reflect the discrete sinc…

Quantum Physics · Physics 2022-07-04 Charlee Stefanski , Vanio Markov , Constantin Gonciulea

We study parameter inference in simulation-based stochastic models where the analytical form of the likelihood is unknown. The main difficulty is that score evaluation as a ratio of noisy Monte Carlo estimators induces bias and instability,…

Machine Learning · Statistics 2025-10-31 Zehao Li , Zhouchen Lin , Yijie Peng

Statistical prediction plays an important role in many decision processes such as university budgeting (depending on the number of students who will enroll), capital budgeting (depending on the remaining lifetime of a fleet of systems), the…

Methodology · Statistics 2021-10-14 Qinglong Tian , Daniel J. Nordman , William Q. Meeker

In this paper, we consider the problem of constructing confidence interval for the correlation coefficient in a bivariate normal distribution. For this problem, we found fifteen approaches in literatures. Also, we have proposed a…

Methodology · Statistics 2014-10-31 Mohammad Reza Kazemi , Ali Akbar Jafari

We consider a simulation-based Ranking and Selection (R&S) problem with input uncertainty, where unknown input distributions can be estimated using input data arriving in batches of varying sizes over time. Each time a batch arrives,…

Optimization and Control · Mathematics 2022-09-05 Di Wu , Yuhao Wang , Enlu Zhou

This paper introduces a first implementation of a novel likelihood-ratio-based approach for constructing confidence intervals for neural networks. Our method, called DeepLR, offers several qualitative advantages: most notably, the ability…

Machine Learning · Statistics 2023-08-07 Laurens Sluijterman , Eric Cator , Tom Heskes

When the study variable is functional and storage capacities are limited or transmission costs are high, selecting with survey sampling techniques a small fraction of the observations is an interesting alternative to signal compression…

Statistics Theory · Mathematics 2013-02-15 Hervé Cardot , Camelia Goga , Pauline Lardin

Recently, many machine learning and statistical models such as non-linear regressions, the Single Index, Multi-index, Varying Coefficient Index Models and Two-layer Neural Networks can be reduced to or be seen as a special case of a new…

Machine Learning · Computer Science 2020-10-20 Di Wang , Xiangyu Guo , Chaowen Guan , Shi Li , Jinhui Xu

Least absolute shrinkage and selection operator or Lasso is one of the widely used regularization methods in regression. Statisticians usually implement Lasso in practice by choosing the penalty parameter in a data-dependent way, the most…

Methodology · Statistics 2026-05-08 Mayukh Choudhury , Debraj Das