English
Related papers

Related papers: Positive and Unlabeled Data: Model, Estimation, In…

200 papers

The problem of learning from positive and unlabeled data (A.K.A. PU learning) has been studied in a binary (i.e., positive versus negative) classification setting, where the input data consist of (1) observations from the positive class and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Omar Zamzam , Haleh Akrami , Richard Leahy

Dual-encoder (DE) models are widely used in retrieval tasks, most commonly studied on open QA benchmarks that are often characterized by multi-class and limited training data. In contrast, their performance in multi-label and data-rich…

Machine Learning · Computer Science 2024-03-19 Nilesh Gupta , Devvrit Khatri , Ankit S Rawat , Srinadh Bhojanapalli , Prateek Jain , Inderjit Dhillon

Positive-Unlabelled (PU) learning is a growing field of machine learning that aims to learn classifiers from data consisting of labelled positive and unlabelled instances, which can be in reality positive or negative, but whose label is…

Machine Learning · Computer Science 2024-01-15 Jack D. Saunders , Alex A. Freitas

When faced with distribution shift at test time, deep neural networks often make inaccurate predictions with unreliable uncertainty estimates. While improving the robustness of neural networks is one promising approach to mitigate this…

Machine Learning · Computer Science 2021-09-28 Aurick Zhou , Sergey Levine

Combining multiple predictors obtained from distributed data sources to an accurate meta-learner is promising to achieve enhanced performance in lots of prediction problems. As the accuracy of each predictor is usually unknown, integrating…

Machine Learning · Statistics 2024-08-16 Shiva Afshar , Yinghan Chen , Shizhong Han , Ying Lin

Ensemble learning aims to improve generalization ability by using multiple base learners. It is well-known that to construct a good ensemble, the base learners should be accurate as well as diverse. In this paper, unlabeled data is…

Machine Learning · Computer Science 2010-09-28 Min-Ling Zhang , Zhi-Hua Zhou

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

We study identification and estimation of causal effects in settings with panel data. Traditionally researchers follow model-based identification strategies relying on assumptions governing the relation between the potential outcomes and…

Econometrics · Economics 2022-02-18 Dmitry Arkhangelsky , Guido W. Imbens

The recently proposed unlabeled-unlabeled (UU) classification method allows us to train a binary classifier only from two unlabeled datasets with different class priors. Since this method is based on the empirical risk minimization, it…

Machine Learning · Computer Science 2020-04-01 Nan Lu , Tianyi Zhang , Gang Niu , Masashi Sugiyama

A common approach in positive-unlabeled learning is to train a classification model between labeled and unlabeled data. This strategy is in fact known to give an optimal classifier under mild conditions; however, it results in biased…

Machine Learning · Statistics 2017-02-03 Shantanu Jain , Martha White , Predrag Radivojac

Semi-supervised anomaly detection is a common problem, as often the datasets containing anomalies are partially labeled. We propose a canonical framework: Semi-supervised Pseudo-labeler Anomaly Detection with Ensembling (SPADE) that isn't…

Machine Learning · Computer Science 2022-12-02 Jinsung Yoon , Kihyuk Sohn , Chun-Liang Li , Sercan O. Arik , Tomas Pfister

Minimizing prediction uncertainty on unlabeled data is a key factor to achieve good performance in semi-supervised learning (SSL). The prediction uncertainty is typically expressed as the \emph{entropy} computed by the transformed…

Machine Learning · Computer Science 2021-12-16 Jing Li , Yuangang Pan , Ivor W. Tsang

All models may be wrong -- but that is not necessarily a problem for inference. Consider the standard $t$-test for the significance of a variable $X$ for predicting response $Y$ whilst controlling for $p$ other covariates $Z$ in a random…

Statistics Theory · Mathematics 2022-05-20 Rajen D. Shah , Peter Bühlmann

Recent advances in weakly supervised classification allow us to train a classifier only from positive and unlabeled (PU) data. However, existing PU classification methods typically require an accurate estimate of the class-prior…

Machine Learning · Statistics 2022-06-22 Tomoya Sakai , Gang Niu , Masashi Sugiyama

Diffusion models have shown remarkable success in text-to-image generation, making preference alignment for these models increasingly important. The preference labels are typically available only at the terminal of denoising trajectories,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Dingyuan Shi , Yong Wang , Hangyu Li , Xiangxiang Chu

Mendelian randomization (MR) is a widely used tool for causal inference in the presence of unmeasured confounders, which uses single nucleotide polymorphisms (SNPs) as instrumental variables to estimate causal effects. However, SNPs often…

Methodology · Statistics 2025-04-29 Ruoyu Wang , Haoyu Zhang , Xihong Lin

We introduce a testing-by-betting framework that leverages predictions on unlabeled data to enhance the power of sequential hypothesis testing. Given limited samples from the joint distribution of $(X,Y)$, and additional unlabeled samples…

Machine Learning · Computer Science 2026-05-28 Yaniv Tenzer , Elad Tolochinsky , Yaniv Romano

A major challenge in Semi-Supervised Learning (SSL) is the limited information available about the class distribution in the unlabeled data. In many real-world applications this arises from the prevalence of long-tailed distributions, where…

Machine Learning · Computer Science 2025-02-04 Khiem Pham , Charles Herrmann , Ramin Zabih

Testing and evaluation is an important step before the large-scale application of the autonomous driving systems (ADSs). Based on the three level of scenario abstraction theory, a testing can be performed within a logical scenario, followed…

Artificial Intelligence · Computer Science 2025-10-24 Xinzheng Wu , Junyi Chen , Jianfeng Wu , Longgao Zhang , Tian Xia , Yong Shen

In this paper we develop a principled, probabilistic, unified approach to non-standard classification tasks, such as semi-supervised, positive-unlabelled, multi-positive-unlabelled and noisy-label learning. We train a classifier on the…

Machine Learning · Computer Science 2020-06-17 Jeppe Nørregaard , Lars Kai Hansen