English
Related papers

Related papers: Unsupervised Risk Estimation Using Only Conditiona…

200 papers

Independence testing is a fundamental problem in statistical inference: given samples from a joint distribution $p$ over multiple random variables, the goal is to determine whether $p$ is a product distribution or is $\epsilon$-far from all…

Machine Learning · Statistics 2026-03-06 Maryam Aliakbarpour , Alireza Azizi , Ria Stevens

The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capable of estimating their own uncertainty. In the context of regression, instead of estimating…

Machine Learning · Computer Science 2026-05-14 Quentin Duchemin , Guillaume Obozinski

Given a fixed budget for total model size, one must choose between training a single large model or combining the predictions of multiple smaller models. We investigate this trade-off for ensembles of random-feature ridge regression models…

Machine Learning · Computer Science 2025-10-28 Benjamin S. Ruben , William L. Tong , Hamza Tahir Chaudhry , Cengiz Pehlevan

Semi-supervised learning (SSL) constructs classifiers using both labelled and unlabelled data. It leverages information from labelled samples, whose acquisition is often costly or labour-intensive, together with unlabelled data to enhance…

Machine Learning · Statistics 2025-12-29 Jinran Wu , You-Gan Wang , Geoffrey J. McLachlan

We propose a sequential, anytime-valid method to test the conditional independence of a response $Y$ and a predictor $X$ given a random vector $Z$. The proposed test is based on e-statistics and test martingales, which generalize likelihood…

Methodology · Statistics 2023-02-22 Peter Grünwald , Alexander Henzi , Tyron Lardy

We define generalized innovations associated with generalized error models having arbitrary distributions, that is, distributions that can be mixtures of continuous and discrete distributions. These models include stochastic volatility…

Methodology · Statistics 2026-05-15 Kilani Ghoudi , Bouchra R. Nasri , Bruno N. Remillard

Predictive algorithms inform consequential decisions in settings with selective labels: outcomes are observed only for units selected by past decision makers. This creates an identification problem under unobserved confounding -- when…

Econometrics · Economics 2025-11-07 Ashesh Rambachan , Amanda Coston , Edward Kennedy

Increasingly, medical research is dependent on data collected for non-research purposes, such as electronic health records data (EHR). EHR data and other large databases can be prone to measurement error in key exposures, and unadjusted…

Methodology · Statistics 2020-05-13 Kyunghee Han , Thomas Lumley , Bryan E. Shepherd , Pamela A. Shaw

A major challenge in estimating treatment effects in observational studies is the reliance on untestable conditions such as the assumption of no unmeasured confounding. In this work, we propose an algorithm that can falsify the assumption…

Methodology · Statistics 2025-06-03 Rickard K. A. Karlsson , Jesse H. Krijthe

We propose new concepts in order to analyze and model the dependence structure between two time series. Our methods rely exclusively on the order structure of the data points. Hence, the methods are stable under monotone transformations of…

Statistics Theory · Mathematics 2015-02-02 Alexander Schnurr , Herold Dehling

We consider testing whether a set of Gaussian variables, selected from the data, is independent of the remaining variables. We assume that this set is selected via a very simple approach that is commonly used across scientific disciplines:…

Methodology · Statistics 2022-11-04 Arkajyoti Saha , Daniela Witten , Jacob Bien

Most predictive models assume that training and test data are generated from a stationary process. However, this assumption does not hold true in practice. In this paper, we consider the scenario of a gradual concept drift due to the…

Machine Learning · Computer Science 2020-02-12 Subhro Das , Prasanth Lade , Soundar Srinivasan

Learning a policy using only observational data is challenging because the distribution of states it induces at execution time may differ from the distribution observed during training. We propose to train a policy by unrolling a learned…

Machine Learning · Computer Science 2019-01-10 Mikael Henaff , Alfredo Canziani , Yann LeCun

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

Machine Learning · Computer Science 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Modern image classifiers are very accurate, but the predictions come without uncertainty estimates. Conformal predictors provide uncertainty estimates by computing a set of classes containing the correct class with a user-specified…

Machine Learning · Computer Science 2023-06-06 Fatih Furkan Yilmaz , Reinhard Heckel

This paper studies the problem of learning with augmented classes (LAC), where augmented classes unobserved in the training data might emerge in the testing phase. Previous studies generally attempt to discover augmented classes by…

Machine Learning · Computer Science 2020-11-30 Yu-Jie Zhang , Peng Zhao , Zhi-Hua Zhou

Machine-learning driven models have proven to be powerful tools for the identification of phases of matter. In particular, unsupervised methods hold the promise to help discover new phases of matter without the need for any prior…

Unsupervised outlier detection is attractive because it eliminates the need for labeled data. Moreover, forming multi-model ensembles can improve detection robustness. However, composing an ensemble without labeled data is challenging.…

Machine Learning · Computer Science 2026-05-19 Hong-Phuc Phan , Tuan-Anh Vu , Tung Kieu , Son Ha Xuan , Bin Yang , Christian S. Jensen

Artificial intelligence models trained from data can only be as good as the underlying data is. Biases in training data propagating through to the output of a machine learning model are a well-documented and well-understood phenomenon, but…

Machine Learning · Computer Science 2025-04-02 Stefan Rass , Martin Dallinger

In real-world applications, the limited availability of labeled outcomes presents significant challenges for statistical inference due to high collection costs, technical barriers, and other constraints. In this work, we propose a method to…

Methodology · Statistics 2025-10-14 Menghan Yi , Yanlin Tang , Huixia Judy Wang