English
Related papers

Related papers: On the Minimal Supervision for Training Any Binary…

200 papers

The recently proposed unlabeled-unlabeled (UU) classification method allows us to train a binary classifier only from two unlabeled datasets with different class priors. Since this method is based on the empirical risk minimization, it…

Machine Learning · Computer Science 2020-04-01 Nan Lu , Tianyi Zhang , Gang Niu , Masashi Sugiyama

From only positive (P) and unlabeled (U) data, a binary classifier could be trained with PU learning, in which the state of the art is unbiased PU learning. However, if its model is very flexible, empirical risks on training data will go…

Machine Learning · Computer Science 2017-11-07 Ryuichi Kiryo , Gang Niu , Marthinus C. du Plessis , Masashi Sugiyama

Supervised learning needs a huge amount of labeled data, which can be a big bottleneck under the situation where there is a privacy concern or labeling cost is high. To overcome this problem, we propose a new weakly-supervised learning…

Machine Learning · Computer Science 2018-08-16 Han Bao , Gang Niu , Masashi Sugiyama

To cope with high annotation costs, training a classifier only from weakly supervised data has attracted a great deal of attention these days. Among various approaches, strengthening supervision from completely unsupervised classification…

Machine Learning · Computer Science 2021-06-14 Nan Lu , Shida Lei , Gang Niu , Issei Sato , Masashi Sugiyama

Positive-unlabeled (PU) learning trains a binary classifier using only positive and unlabeled data. A common simplifying assumption is that the positive data is representative of the target positive class. This assumption rarely holds in…

Machine Learning · Computer Science 2020-11-10 Zayd Hammoudeh , Daniel Lowd

Recent years have witnessed a great success of supervised deep learning, where predictive models were trained from a large amount of fully labeled data. However, in practice, labeling such big data can be very costly and may not even be…

Machine Learning · Computer Science 2022-10-18 Yuting Tang , Nan Lu , Tianyi Zhang , Masashi Sugiyama

Pairwise similarities and dissimilarities between data points might be easier to obtain than fully labeled data in real-world classification problems, e.g., in privacy-aware situations. To handle such pairwise information, an empirical risk…

Machine Learning · Computer Science 2019-04-29 Takuya Shimada , Han Bao , Issei Sato , Masashi Sugiyama

Empirical risk minimization (ERM) is sensitive to spurious correlations in the training data, which poses a significant risk when deploying systems trained under this paradigm in high-stake applications. While the existing literature…

Machine Learning · Computer Science 2023-10-31 Christos Tsirigotis , Joao Monteiro , Pau Rodriguez , David Vazquez , Aaron Courville

Many popular linear classifiers, such as logistic regression, boosting, or SVM, are trained by optimizing a margin-based risk function. Traditionally, these risk functions are computed based on a labeled dataset. We develop a novel…

Machine Learning · Computer Science 2010-07-23 Krishnakumar Balasubramanian , Pinar Donmez , Guy Lebanon

We present a novel approach to learn binary classifiers when only positive and unlabeled instances are available (PU learning). This problem is routinely cast as a supervised task with label noise in the negative set. We use an ensemble of…

Machine Learning · Statistics 2015-02-13 Marc Claesen , Frank De Smet , Johan A. K. Suykens , Bart De Moor

We consider a problem of learning a binary classifier only from positive data and unlabeled data (PU learning) and estimating the class-prior in unlabeled data under the case-control scenario. Most of the recent methods of PU learning…

Machine Learning · Computer Science 2018-09-18 Masahiro Kato , Liyuan Xu , Gang Niu , Masashi Sugiyama

Can we learn a binary classifier from only positive data, without any negative data or unlabeled data? We show that if one can equip positive data with confidence (positive-confidence), one can successfully learn a binary classifier, which…

Machine Learning · Statistics 2018-11-29 Takashi Ishida , Gang Niu , Masashi Sugiyama

Empirical Risk Minimization (ERM) is fragile in scenarios with insufficient labeled samples. A vanilla extension of ERM to unlabeled samples is Entropy Minimization (EntMin), which employs the soft-labels of unlabeled samples to guide their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yulong Zhang , Yuan Yao , Shuhao Chen , Pengrong Jin , Yu Zhang , Jian Jin , Jiangang Lu

Existing algorithms aiming to learn a binary classifier from positive (P) and unlabeled (U) data generally require estimating the class prior or label noises ahead of building a classification model. However, the estimation and classifier…

Machine Learning · Computer Science 2020-09-01 Tianyu Li , Chien-Chih Wang , Yukun Ma , Patricia Ortal , Qifang Zhao , Bjorn Stenger , Yu Hirate

In various situations one is given only the predictions of multiple classifiers over a large unlabeled test data. This scenario raises the following questions: Without any labeled data and without any a-priori knowledge about the…

Machine Learning · Statistics 2014-10-31 Ariel Jaffe , Boaz Nadler , Yuval Kluger

Weakly supervised learning has drawn considerable attention recently to reduce the expensive time and labor consumption of labeling massive data. In this paper, we investigate a novel weakly supervised learning problem of learning from…

Machine Learning · Statistics 2021-02-16 Yuzhou Cao , Lei Feng , Yitian Xu , Bo An , Gang Niu , Masashi Sugiyama

Learning from positive and unlabeled data (PU learning) is actively researched machine learning task. The goal is to train a binary classification model based on a training dataset containing part of positives which are labeled, and…

Machine Learning · Statistics 2023-12-29 Wojciech Rejchel , Paweł Teisseyre , Jan Mielniczuk

We consider the task of training classifiers without labels. We propose a weakly supervised method---adversarial label learning---that trains classifiers to perform well against an adversary that chooses labels for training data. The weak…

Machine Learning · Computer Science 2019-01-31 Chidubem Arachie , Bert Huang

Obtaining accurate class labels is often costly or unreliable, and may also be limited by privacy or other practical conditions. Compared with asking an annotator to provide the exact class, it is often easier to ask whether the true label…

Machine Learning · Computer Science 2026-05-11 Jiaxu Su , Junpeng Li , Changchun Hua , Yana Yang

The fundamental theorem of statistical learning states that for binary classification problems, any Empirical Risk Minimization (ERM) learning rule has close to optimal sample complexity. In this paper we seek for a generic optimal learner…

Machine Learning · Computer Science 2014-05-13 Amit Daniely , Shai Shalev-Shwartz
‹ Prev 1 2 3 10 Next ›