English
Related papers

Related papers: MixPUL: Consistency-based Augmentation for Positiv…

200 papers

Positive unlabeled (PU) learning is useful in various practical situations, where there is a need to learn a classifier for a class of interest from an unlabeled data set, which may contain anomalies as well as samples from unknown classes.…

Machine Learning · Computer Science 2018-08-17 Emanuele Sansone , Francesco G. B. De Natale , Zhi-Hua Zhou

Semi-supervised learning (SSL) has long been proved to be an effective technique to construct powerful models with limited labels. In the existing literature, consistency regularization-based methods, which force the perturbed samples to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Xihong Yang , Xiaochang Hu , Sihang Zhou , Xinwang Liu , En Zhu

When dealing with binary classification of data with only one labeled class data scientists employ two main approaches, namely One-Class (OC) classification and Positive Unlabeled (PU) learning. The former only learns from labeled positive…

Machine Learning · Computer Science 2022-03-15 Farid Bagirov , Dmitry Ivanov , Aleksei Shpilman

We propose a new method of learning from positive and unlabeled (PU) examples in highly imbalanced datasets. Many real-world problems, such as disease gene identification, targeted marketing, fraud detection, and recommender systems, are…

Machine Learning · Computer Science 2026-05-15 Elias Zavitsanos , Georgios Paliouras

Self-supervised pretraining on unlabeled data followed by supervised fine-tuning on labeled data is a popular paradigm for learning from limited labeled examples. We extend this paradigm to the classical positive unlabeled (PU) setting,…

Machine Learning · Computer Science 2024-04-01 Anish Acharya , Sujay Sanghavi , Li Jing , Bhargav Bhushanam , Dhruv Choudhary , Michael Rabbat , Inderjit Dhillon

PU (Positive Unlabeled) learning is a variant of supervised classification learning in which the only labels revealed to the learner are of positively labeled instances. PU learning arises in many real-world applications. Most existing work…

Machine Learning · Computer Science 2025-07-11 Farnam Mansouri , Shai Ben-David

Data augmentation is popular in the training of large neural networks; currently, however, there is no clear theoretical comparison between different algorithmic choices on how to use augmented data. In this paper, we take a step in this…

Machine Learning · Computer Science 2022-06-17 Shuo Yang , Yijun Dong , Rachel Ward , Inderjit S. Dhillon , Sujay Sanghavi , Qi Lei

While recent studies on semi-supervised learning have shown remarkable progress in leveraging both labeled and unlabeled data, most of them presume a basic setting of the model is randomly initialized. In this work, we consider…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Abulikemu Abuduweili , Xingjian Li , Humphrey Shi , Cheng-Zhong Xu , Dejing Dou

The core issue in semi-supervised learning (SSL) lies in how to effectively leverage unlabeled data, whereas most existing methods tend to put a great emphasis on the utilization of high-confidence samples yet seldom fully explore the usage…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Yue Duan , Zhen Zhao , Lei Qi , Lei Wang , Luping Zhou , Yinghuan Shi , Yang Gao

Presently the most successful approaches to semi-supervised learning are based on consistency regularization, whereby a model is trained to be robust to small perturbations of its inputs and parameters. To understand consistency…

Machine Learning · Computer Science 2019-02-22 Ben Athiwaratkun , Marc Finzi , Pavel Izmailov , Andrew Gordon Wilson

The scarcity of class-labeled data is a ubiquitous bottleneck in many machine learning problems. While abundant unlabeled data typically exist and provide a potential solution, it is highly challenging to exploit them. In this paper, we…

Machine Learning · Computer Science 2025-07-25 Bing Yu , Ke Sun , He Wang , Zhouchen Lin , Zhanxing Zhu

Planning for a wide range of real-world tasks necessitates to know and write all constraints. However, instances exist where these constraints are either unknown or challenging to specify accurately. A possible solution is to infer the…

Machine Learning · Computer Science 2025-01-17 Baiyu Peng , Aude Billard

We address learning from positive and unlabeled (PU) data, a common setting in which only some positives are labeled and the rest are mixed with negatives. Classical exponential tilting models guarantee identifiability by assuming a linear…

Methodology · Statistics 2025-08-19 Peijun Sang , Yifan Sun , Qinglong Tian , Donglin Zeng , Pengfei Li

Positive-Unlabeled (PU) learning aims to learn a model with rare positive samples and abundant unlabeled samples. Compared with classical binary classification, the task of PU learning is much more challenging due to the existence of many…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chengming Xu , Chen Liu , Siqian Yang , Yabiao Wang , Shijie Zhang , Lijie Jia , Yanwei Fu

When learning from positive and unlabelled data, it is a strong assumption that the positive observations are randomly sampled from the distribution of $X$ conditional on $Y = 1$, where X stands for the feature and Y the label. Most…

Machine Learning · Computer Science 2020-03-04 Fengxiang He , Tongliang Liu , Geoffrey I Webb , Dacheng Tao

The recent research in semi-supervised learning (SSL) is mostly dominated by consistency regularization based methods which achieve strong performance. However, they heavily rely on domain-specific data augmentations, which are not easy to…

Machine Learning · Computer Science 2021-04-20 Mamshad Nayeem Rizve , Kevin Duarte , Yogesh S Rawat , Mubarak Shah

Recent advances in semi-supervised learning have shown tremendous potential in overcoming a major barrier to the success of modern machine learning algorithms: access to vast amounts of human-labeled training data. Previous algorithms based…

Machine Learning · Computer Science 2019-11-22 Phi Vu Tran

Active learning (AL) combines data labeling and model training to minimize the labeling cost by prioritizing the selection of high value data that can best improve model performance. In pool-based active learning, accessible unlabeled data…

Machine Learning · Computer Science 2020-07-21 Mingfei Gao , Zizhao Zhang , Guo Yu , Sercan O. Arik , Larry S. Davis , Tomas Pfister

Consistency training, which exploits both supervised and unsupervised learning with different augmentations on image, is an effective method of utilizing unlabeled data in semi-supervised learning (SSL) manner. Here, we present another…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Juyong Lee , Seunghyuk Cho

Complementary-label learning is a weakly supervised learning problem in which each training example is associated with one or multiple complementary labels indicating the classes to which it does not belong. Existing consistent approaches…

Machine Learning · Computer Science 2024-10-14 Wei Wang , Takashi Ishida , Yu-Jie Zhang , Gang Niu , Masashi Sugiyama