English
Related papers

Related papers: Unifying Design-based Inference: A New Variance Es…

200 papers

Asymptotically linear estimators in semiparametric models are usually studied through a von Mises expansion in which first-order inference is based on the influence-function variance. This reduction is valid only when the second-order…

Methodology · Statistics 2026-05-26 Lin Li

We introduce overdispersed black-box variational inference, a method to reduce the variance of the Monte Carlo estimator of the gradient in black-box variational inference. Instead of taking samples from the variational distribution, we use…

Machine Learning · Statistics 2016-03-04 Francisco J. R. Ruiz , Michalis K. Titsias , David M. Blei

We propose the family of generalized resubstitution classifier error estimators based on empirical measures. These error estimators are computationally efficient and do not require re-training of classifiers. The plain resubstitution error…

Machine Learning · Statistics 2021-10-26 Parisa Ghane , Ulisses Braga-Neto

Accurate estimation of predictive uncertainty in modern neural networks is critical to achieve well calibrated predictions and detect out-of-distribution (OOD) inputs. The most promising approaches have been predominantly focused on…

Machine Learning · Computer Science 2020-07-13 Shreyas Padhy , Zachary Nado , Jie Ren , Jeremiah Liu , Jasper Snoek , Balaji Lakshminarayanan

Out-of-distribution (OOD) detection and uncertainty estimation (UE) are critical components for building safe machine learning systems, especially in real-world scenarios where unexpected inputs are inevitable. However the two problems…

Machine Learning · Computer Science 2025-12-01 Pirzada Suhail , Rehna Afroz , Gouranga Bala , Amit Sethi

We propose a simple and general variant of the standard reparameterized gradient estimator for the variational evidence lower bound. Specifically, we remove a part of the total derivative with respect to the variational parameters that…

Machine Learning · Statistics 2017-05-30 Geoffrey Roeder , Yuhuai Wu , David Duvenaud

With the recently rapid development in deep learning, deep neural networks have been widely adopted in many real-life applications. However, deep neural networks are also known to have very little control over its uncertainty for unseen…

Machine Learning · Computer Science 2019-04-23 Wenhu Chen , Yilin Shen , Hongxia Jin , William Wang

In causal inference, the Inverse Probability Weighting (IPW) estimator is commonly used to estimate causal effects for estimands within the class of Weighted Average Treatment Effect (WATE). When constructing confidence intervals (CIs),…

Methodology · Statistics 2023-12-14 Shunichiro Orihara

The fundamental invariants for vector ODEs of order $\ge 3$ considered up to point transformations consist of generalized Wilczynski invariants and C-class invariants. An ODE of C-class is characterized by the vanishing of the former. For…

Differential Geometry · Mathematics 2023-08-11 Johnson Allen Kessy , Dennis The

Consider a finite sample from an unknown distribution over a countable alphabet. Unobserved events are alphabet symbols which do not appear in the sample. Estimating the probabilities of unobserved events is a basic problem in statistics…

Statistics Theory · Mathematics 2022-11-08 Amichai Painsky

The aim of this paper is to introduce new statistical criterions for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools…

Statistics Theory · Mathematics 2015-03-19 Michel Broniatowski , Aida Toma , Igor Vajda

Modern machine learning models deployed in the wild can encounter both covariate and semantic shifts, giving rise to the problems of out-of-distribution (OOD) generalization and OOD detection respectively. While both problems have received…

Machine Learning · Computer Science 2025-12-22 Haoyue Bai , Gregory Canal , Xuefeng Du , Jeongyeol Kwon , Robert Nowak , Yixuan Li

A fast Bayesian method that seamlessly fuses classification and hypothesis testing via discriminant analysis is developed. Building upon the original discriminant analysis classifier, modelling components are added to identify…

Methodology · Statistics 2019-08-28 Weichang Yu , John T. Ormerod , Michael Stewart

There has been a recent surge in research on causal panel data models, leading to many new estimators for average causal effects. However, researchers have paid less attention to quantifying the precision of these estimators. This paper…

Econometrics · Economics 2025-11-25 Alexander Almeida , Susan Athey , Guido Imbens , Eva Lestant , Alexia Olaizola

We present a latent variable model for classification that provides a novel probabilistic interpretation of neural network softmax classifiers. We derive a variational objective to train the model, analogous to the evidence lower bound…

Machine Learning · Computer Science 2024-01-10 Shehzaad Dhuliawala , Mrinmaya Sachan , Carl Allen

A method based on one class support vector machine (OCSVM) is proposed for class incremental learning. Several OCSVM models divide the input space into several parts. Then, the 1VS1 classifiers are constructed for the confuse part by using…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Chengfei Yao , Jie Zou , Yanan Luo , Tao Li , Gang Bai

Classifying patterns of known classes and rejecting ambiguous and novel (also called as out-of-distribution (OOD)) inputs are involved in open world pattern recognition. Deep neural network models usually excel in closed-set classification…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhen Cheng , Xu-Yao Zhang , Cheng-Lin Liu

We obtain estimation error rates for estimators obtained by aggregation of regularized median-of-means tests, following a construction of Le Cam. The results hold with exponentially large probability -- as in the gaussian framework with…

Statistics Theory · Mathematics 2017-07-19 Lecué Guillaume , Lerasle Matthieu

One-class classification (OCC) is a longstanding method for anomaly detection. With the powerful representation capability of the pre-trained backbone, OCC methods have witnessed significant performance improvements. Typically, most of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Han Gao , Huiyuan Luo , Fei Shen , Zhengtao Zhang

A development of an inverse first-order divided difference operator for functions of several variables is presented. Two generalized derivative-free algorithms builded up from Ostrowski's method for solving systems of nonlinear equations…

Numerical Analysis · Mathematics 2011-10-12 Miquel Grau-Sánchez , Miquel Noguera , Sergio Amat