English
Related papers

Related papers: Unifying Design-based Inference: A New Variance Es…

200 papers

Improving the reliability of deployed machine learning systems often involves developing methods to detect out-of-distribution (OOD) inputs. However, existing research often narrowly focuses on samples from classes that are absent from the…

Machine Learning · Computer Science 2024-12-11 Charles Guille-Escuret , Pierre-André Noël , Ioannis Mitliagkas , David Vazquez , Joao Monteiro

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

A significant limitation of one-class classification anomaly detection methods is their reliance on the assumption that unlabeled training data only contains normal instances. To overcome this impractical assumption, we propose two novel…

Machine Learning · Computer Science 2023-09-04 Le Thi Khanh Hien , Sukanya Patra , Souhaib Ben Taieb

This paper introduces the Variational Determinant Estimator (VDE), a variational extension of the recently proposed determinant estimator discovered by arXiv:2005.06553v2. Our estimator significantly reduces the variance even for low sample…

Machine Learning · Computer Science 2021-01-11 Simon Passenheim , Emiel Hoogeboom

Open-set object detection (OSOD) aims to detect the known categories and reject unknown objects in a dynamic world, which has achieved significant attention. However, previous approaches only consider this problem in data-abundant…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Binyi Su , Hua Zhang , Jingzhi Li , Zhong Zhou

This paper introduces the $f$-divergence variational inference ($f$-VI) that generalizes variational inference to all $f$-divergences. Initiated from minimizing a crafty surrogate $f$-divergence that shares the statistical consistency with…

Machine Learning · Computer Science 2021-04-06 Neng Wan , Dapeng Li , Naira Hovakimyan

Wide-angle photometric surveys of previously uncharted sky areas or wavelength regimes will always bring in unexpected sources whose existence and properties cannot be easily predicted from earlier observations: novelties or even anomalies.…

Instrumentation and Methods for Astrophysics · Physics 2017-10-11 A. Solarz , M. Bilicki , M. Gromadzki , A. Pollo , A. Durkalec , M. Wypych

Many statistical data are imprecise due to factors such as measurement errors, computation errors, and lack of information. In such cases, data are better represented by intervals rather than by single numbers. Existing methods for…

Statistics Theory · Mathematics 2014-01-22 Yan Sun , Dan Ralescu

An important problem that arises in reinforcement learning and Monte Carlo methods is estimating quantities defined by the stationary distribution of a Markov chain. In many real-world applications, access to the underlying transition…

Machine Learning · Statistics 2020-02-24 Ruiyi Zhang , Bo Dai , Lihong Li , Dale Schuurmans

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach…

Machine Learning · Statistics 2017-12-15 John Duchi , Hongseok Namkoong

We present a systematic benchmark of out-of-distribution (OOD) detection CSFs through a representation-centric lens. Our study spans CNN and ViT backbones, multiple training paradigms, four image-classification source datasets (CIFAR-10,…

Machine Learning · Computer Science 2026-05-19 Claudio César Claros Olivares , Austin J. Brockmeier

We address the problem of A/B testing, a widely used protocol for evaluating the potential improvement achieved by a new decision system compared to a baseline. This protocol segments the population into two subgroups, each exposed to a…

Machine Learning · Statistics 2025-06-16 Otmane Sakhi , Alexandre Gilotte , David Rohde

Probabilistic knowledge graph embeddings represent entities as distributions, using learned variances to quantify epistemic uncertainty. We identify a fundamental limitation: these variances are relation-agnostic, meaning an entity receives…

Machine Learning · Computer Science 2026-01-05 Chorok Lee

A serious problem in image classification is that a trained model might perform well for input data that originates from the same distribution as the data available for model training, but performs much worse for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Rajat Koner , Poulami Sinhamahapatra , Karsten Roscher , Stephan Günnemann , Volker Tresp

Global sensitivity analysis with variance-based measures suffers from several theoretical and practical limitations, since they focus only on the variance of the output and handle multivariate variables in a limited way. In this paper, we…

Statistics Theory · Mathematics 2013-11-12 Sébastien Da Veiga

The use of surrogate models instead of computationally expensive simulation codes is very convenient in engineering. Roughly speaking, there are two kinds of surrogate models: the deterministic and the probabilistic ones. These last are…

Applications · Statistics 2015-12-24 Malek Ben Salem , Olivier Roustant , Fabrice Gamboa , Lionel Tomaso

Uncertainty estimation has been extensively studied in recent literature, which can usually be classified as aleatoric uncertainty and epistemic uncertainty. In current aleatoric uncertainty estimation frameworks, it is often neglected that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jing Zhang , Yuchao Dai , Mehrtash Harandi , Yiran Zhong , Nick Barnes , Richard Hartley

Deterministic embeddings learned by contrastive learning (CL) methods such as SimCLR and SupCon achieve state-of-the-art performance but lack a principled mechanism for uncertainty quantification. We propose Variational Contrastive Learning…

Machine Learning · Computer Science 2025-10-08 Minoh Jeong , Seonho Kim , Alfred Hero

One-class classification (OCC), i.e., identifying whether an example belongs to the same distribution as the training data, is essential for deploying machine learning models in the real world. Adapting the pre-trained features on the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zilong Zhang , Zhibin Zhao , Deyu Meng , Xingwu Zhang , Xuefeng Chen

In this brief paper, we present a simple approach to estimate the variance of measurement noise with time-varying 1-D signals. The proposed approach exploits the relationship between the noise variance and the variance of the prediction…

Signal Processing · Electrical Eng. & Systems 2021-04-09 Qin Li , Junchan Zhao