English
Related papers

Related papers: On Variance Estimation of Random Forests with Infi…

200 papers

Stochastic optimization is fundamental to modern machine learning. Recent research has extended the study of stochastic first-order methods (SFOMs) from light-tailed to heavy-tailed noise, which frequently arises in practice, with clipping…

Machine Learning · Computer Science 2025-12-17 Chuan He

For differences between means of continuous data from independent groups, the customary scale-free measure of effect is the standardized mean difference (SMD). To justify use of SMD, one should be reasonably confident that the group-level…

Statistics Theory · Mathematics 2025-12-10 Elena Kulinskaya , David C. Hoaglin

Assessing the fairness of a decision making system with respect to a protected class, such as gender or race, is challenging when class membership labels are unavailable. Probabilistic models for predicting the protected class based on…

Applications · Statistics 2018-11-28 Jiahao Chen , Nathan Kallus , Xiaojie Mao , Geoffry Svacha , Madeleine Udell

We describe the use of an unsupervised Random Forest for similarity learning and improved unsupervised anomaly detection. By training a Random Forest to discriminate between real data and synthetic data sampled from a uniform distribution…

Machine Learning · Statistics 2025-04-23 Joshua S. Harvey , Joshua Rosaler , Mingshu Li , Dhruv Desai , Dhagash Mehta

The problem of adaptive sampling for estimating probability mass functions (pmf) uniformly well is considered. Performance of the sampling strategy is measured in terms of the worst-case mean squared error. A Bayesian variant of the…

Methodology · Statistics 2020-12-09 Dhruva Kartik , Neeraj Sood , Urbashi Mitra , Tara Javidi

In this paper we propose using the principle of boosting to reduce the bias of a random forest prediction in the regression setting. From the original random forest fit we extract the residuals and then fit another random forest to these…

Machine Learning · Statistics 2021-02-25 Indrayudh Ghosal , Giles Hooker

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Covariate shift relaxes the widely-employed independent and identically distributed (IID) assumption by allowing different training and testing input distributions. Unfortunately, common methods for addressing covariate shift by trying to…

Machine Learning · Computer Science 2018-01-02 Anqi Liu , Brian D. Ziebart

Debiasing is a fundamental concept in high-dimensional statistics. While degrees-of-freedom adjustment is the state-of-the-art technique in high-dimensional linear regression, it is limited to i.i.d. samples and sub-Gaussian covariates.…

Statistics Theory · Mathematics 2026-01-01 Yufan Li , Pragya Sur

We consider distributed optimization problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We develop unbiased parameter averaging methods for randomized second order optimization…

Machine Learning · Statistics 2020-02-18 Burak Bartan , Mert Pilanci

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

Standard practice obtains an unbiased variance estimator by dividing by $N-1$ rather than $N$. Yet if only half the data are used to compute the mean, dividing by $N$ can still yield an unbiased estimator. We show that an alternative mean…

Statistics Theory · Mathematics 2025-04-10 Dai Akita

The fate of scientific hypotheses often relies on the ability of a computational model to explain the data, quantified in modern statistical approaches by the likelihood function. The log-likelihood is the key element for parameter…

Machine Learning · Computer Science 2021-01-27 Bas van Opheusden , Luigi Acerbi , Wei Ji Ma

In object detection with deep neural networks, the box-wise objectness score tends to be overconfident, sometimes even indicating high confidence in presence of inaccurate predictions. Hence, the reliability of the prediction and therefore…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Marius Schubert , Karsten Kahl , Matthias Rottmann

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

Isolation Forest (iForest) stands out as a widely-used unsupervised anomaly detector, primarily owing to its remarkable runtime efficiency and superior performance in large-scale tasks. Despite its widespread adoption, a theoretical…

Machine Learning · Computer Science 2026-01-28 Qin-Cheng Zheng , Shao-Qun Zhang , Shen-Huan Lyu , Yuan Jiang , Zhi-Hua Zhou

Uncertainty quantification (UQ) in deep learning regression is of wide interest, as it supports critical applications including sequential decision making and risk-sensitive tasks. In heteroskedastic regression, where the uncertainty of the…

Machine Learning · Computer Science 2026-03-03 Mikkel Jordahn , Jonas Vestergaard Jensen , James Harrison , Michael Riis Andersen , Mikkel N. Schmidt

This survey will appear as a chapter of the forthcoming book [19]. A U-statistic of order $k$ with kernel $f:\X^k \to \R^d$ over a Poisson process is defined in \cite{ReiSch11} as$$ \sum\_{x\_1, \dots , x\_k \in \eta^k\_{\neq}} f(x\_1,…

Probability · Mathematics 2015-03-27 Raphaël Lachèze-Rey , Matthias Reitzner

Due to the growing adoption of deep neural networks in many fields of science and engineering, modeling and estimating their uncertainties has become of primary importance. Despite the growing literature about uncertainty quantification in…

Machine Learning · Computer Science 2023-02-15 Brian Staber , Sébastien Da Veiga

Inverse problems play a key role in modern image/signal processing methods. However, since they are generally ill-conditioned or ill-posed due to lack of observations, their solutions may have significant intrinsic uncertainty. Analysing…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Xiaohao Cai , Marcelo Pereyra , Jason D. McEwen