English
Related papers

Related papers: On the Minimal Supervision for Training Any Binary…

200 papers

Positive Unlabeled (PU) learning aims to learn a binary classifier from only positive and unlabeled data, which is utilized in many real-world scenarios. However, existing PU learning algorithms cannot deal with the real-world challenge in…

Machine Learning · Computer Science 2022-07-28 Zhongnian Li , Liutao Yang , Zhongchen Ma , Tongfeng Sun , Xinzheng Xu , Daoqiang Zhang

We present a general methodology for using unlabeled data to design semi supervised learning (SSL) variants of the Empirical Risk Minimization (ERM) learning process. Focusing on generalized linear regression, we analyze of the…

Machine Learning · Statistics 2022-03-08 Oren Yuval , Saharon Rosset

Training a classifier exploiting a huge amount of supervised data is expensive or even prohibited in a situation, where the labeling cost is high. The remarkable progress in working with weaker forms of supervision is binary classification…

Machine Learning · Computer Science 2023-06-13 Yuhao Wu , Xiaobo Xia , Jun Yu , Bo Han , Gang Niu , Masashi Sugiyama , Tongliang Liu

We consider the problem of learning a binary classifier from only positive and unlabeled observations (called PU learning). Recent studies in PU learning have shown superior performance theoretically and empirically. However, most existing…

Machine Learning · Statistics 2020-02-21 Yongchan Kwon , Wonyoung Kim , Masashi Sugiyama , Myunghee Cho Paik

Positive-unlabeled learning (PU learning) is known as a special case of semi-supervised binary classification where only a fraction of positive examples are labeled. The challenge is then to find the correct classifier despite this lack of…

Statistics Theory · Mathematics 2022-01-19 Olivier Coudray , Christine Keribin , Pascal Massart , Patrick Pamphile

We investigate the learning dynamics of classifiers in scenarios where classes are separable or classifiers are over-parameterized. In both cases, Empirical Risk Minimization (ERM) results in zero training error. However, there are many…

Machine Learning · Computer Science 2024-10-23 Julius Martinetz , Christoph Linse , Thomas Martinetz

A weakly-supervised learning framework named as complementary-label learning has been proposed recently, where each sample is equipped with a single complementary label that denotes one of the classes the sample does not belong to. However,…

Machine Learning · Statistics 2020-07-24 Yuzhou Cao , Shuqi Liu , Yitian Xu

Learning algorithms that aggregate predictions from an ensemble of diverse base classifiers consistently outperform individual methods. Many of these strategies have been developed in a supervised setting, where the accuracy of each base…

Machine Learning · Statistics 2018-02-14 Mehmet Eren Ahsen , Robert Vogel , Gustavo Stolovitzky

In the paper we argue that performance of the classifiers based on Empirical Risk Minimization (ERM) for positive unlabeled data, which are designed for case-control sampling scheme may significantly deteriorate when applied to a…

Machine Learning · Computer Science 2026-04-08 Jan Mielniczuk , Adam Wawrzeńczyk

In binary classification, there are situations where negative (N) data are too diverse to be fully labeled and we often resort to positive-unlabeled (PU) learning in these scenarios. However, collecting a non-representative N set that…

Machine Learning · Computer Science 2019-07-16 Yu-Guan Hsieh , Gang Niu , Masashi Sugiyama

The multi-label classification problem has generated significant interest in recent years. However, existing approaches do not adequately address two key challenges: (a) the ability to tackle problems with a large number (say millions) of…

Machine Learning · Computer Science 2013-11-26 Hsiang-Fu Yu , Prateek Jain , Purushottam Kar , Inderjit S. Dhillon

In contrast to the standard learning paradigm where all classes can be observed in training data, learning with augmented classes (LAC) tackles the problem where augmented classes unobserved in the training data may emerge in the test…

Machine Learning · Computer Science 2023-06-13 Senlin Shu , Shuo He , Haobo Wang , Hongxin Wei , Tao Xiang , Lei Feng

Positive-Unlabeled (PU) learning tries to learn binary classifiers from a few labeled positive examples with many unlabeled ones. Compared with ordinary semi-supervised learning, this task is much more challenging due to the absence of any…

Machine Learning · Computer Science 2022-12-07 Yunrui Zhao , Qianqian Xu , Yangbangyan Jiang , Peisong Wen , Qingming Huang

Existing similarity-based weakly supervised learning approaches often rely on precise similarity annotations between data pairs, which may inadvertently expose sensitive label information and raise privacy risks. To mitigate this issue, we…

Machine Learning · Computer Science 2025-09-16 Meng Wei , Zhongnian Li , Peng Ying , Xinzheng Xu

Complementary-label learning is a weakly supervised learning problem in which each training example is associated with one or multiple complementary labels indicating the classes to which it does not belong. Existing consistent approaches…

Machine Learning · Computer Science 2024-10-14 Wei Wang , Takashi Ishida , Yu-Jie Zhang , Gang Niu , Masashi Sugiyama

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

Machine Learning · Computer Science 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

We show how to estimate a model's test error from unlabeled data, on distributions very different from the training distribution, while assuming only that certain conditional independencies are preserved between train and test. We do not…

Machine Learning · Computer Science 2016-06-17 Jacob Steinhardt , Percy Liang

For many interesting tasks, such as medical diagnosis and web page classification, a learner only has access to some positively labeled examples and many unlabeled examples. Learning from this type of data requires making assumptions about…

Machine Learning · Computer Science 2018-08-28 Jessa Bekker , Jesse Davis

Self-supervised pretraining on unlabeled data followed by supervised fine-tuning on labeled data is a popular paradigm for learning from limited labeled examples. We extend this paradigm to the classical positive unlabeled (PU) setting,…

Machine Learning · Computer Science 2024-04-01 Anish Acharya , Sujay Sanghavi , Li Jing , Bhargav Bhushanam , Dhruv Choudhary , Michael Rabbat , Inderjit Dhillon

Self-training is a powerful approach to deep learning. The key process is to find a pseudo-label for modeling. However, previous self-training algorithms suffer from the over-confidence issue brought by the hard labels, even some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia