English
Related papers

Related papers: Information-Theoretic Representation Learning for …

200 papers

Supervised learning needs a huge amount of labeled data, which can be a big bottleneck under the situation where there is a privacy concern or labeling cost is high. To overcome this problem, we propose a new weakly-supervised learning…

Machine Learning · Computer Science 2018-08-16 Han Bao , Gang Niu , Masashi Sugiyama

This paper proposes a novel pseudo-labeling method for medical image segmentation that can perform learning on ``individual images'' to select effective pseudo-labels. We introduce Positive and Unlabeled Learning (PU learning), which uses…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Takehiro Yamane , Itaru Tsuge , Susumu Saito , Ryoma Bise

When dealing with binary classification of data with only one labeled class data scientists employ two main approaches, namely One-Class (OC) classification and Positive Unlabeled (PU) learning. The former only learns from labeled positive…

Machine Learning · Computer Science 2022-03-15 Farid Bagirov , Dmitry Ivanov , Aleksei Shpilman

We propose a new method of learning from positive and unlabeled (PU) examples in highly imbalanced datasets. Many real-world problems, such as disease gene identification, targeted marketing, fraud detection, and recommender systems, are…

Machine Learning · Computer Science 2026-05-15 Elias Zavitsanos , Georgios Paliouras

Existing algorithms aiming to learn a binary classifier from positive (P) and unlabeled (U) data generally require estimating the class prior or label noises ahead of building a classification model. However, the estimation and classifier…

Machine Learning · Computer Science 2020-09-01 Tianyu Li , Chien-Chih Wang , Yukun Ma , Patricia Ortal , Qifang Zhao , Bjorn Stenger , Yu Hirate

Positive Unlabeled (PU) learning is widely used in many applications, where a binary classifier is trained on the datasets consisting of only positive and unlabeled samples. In this paper, we improve PU learning over state-of-the-art from…

Machine Learning · Computer Science 2020-04-22 Liwei Jiang , Dan Li , Qisheng Wang , Shuai Wang , Songtao Wang

Positive-unlabeled learning (PU learning) is known as a special case of semi-supervised binary classification where only a fraction of positive examples are labeled. The challenge is then to find the correct classifier despite this lack of…

Statistics Theory · Mathematics 2022-01-19 Olivier Coudray , Christine Keribin , Pascal Massart , Patrick Pamphile

Positive-Unlabeled (PU) learning aims to train a binary classifier (positive vs. negative) where only limited positive data and abundant unlabeled data are available. While widely applicable, state-of-the-art PU learning methods…

Machine Learning · Computer Science 2026-02-11 Hengwei Zhao , Zhengzhong Tu , Zhuo Zheng , Wei Wang , Junjue Wang , Rusty Feagin , Wenzhe Jiao

Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to…

Machine Learning · Statistics 2022-04-12 Tomoya Sakai , Gang Niu , Masashi Sugiyama

In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder. Importantly, we show that structure matters: incorporating knowledge about…

Given only positive examples and unlabeled examples (from both positive and negative classes), we might hope nevertheless to estimate an accurate positive-versus-negative classifier. Formally, this task is broken down into two subtasks: (i)…

Machine Learning · Computer Science 2021-11-02 Saurabh Garg , Yifan Wu , Alex Smola , Sivaraman Balakrishnan , Zachary C. Lipton

When learning from positive and unlabelled data, it is a strong assumption that the positive observations are randomly sampled from the distribution of $X$ conditional on $Y = 1$, where X stands for the feature and Y the label. Most…

Machine Learning · Computer Science 2020-03-04 Fengxiang He , Tongliang Liu , Geoffrey I Webb , Dacheng Tao

We introduce a new observational setting for Positive Unlabeled (PU) data where the observations at prediction time are also labeled. This occurs commonly in practice -- we argue that the additional information is important for prediction,…

Machine Learning · Statistics 2024-07-16 Jan Mielniczuk , Adam Wawrzeńczyk

The success of deep learning in computer vision is rooted in the ability of deep networks to scale up model complexity as demanded by challenging visual tasks. As complexity is increased, so is the need for large amounts of labeled data to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Gustav Larsson

We consider the situation in which a user has collected a small set of documents on a cohesive topic, and they want to retrieve additional documents on this topic from a large collection. Information Retrieval (IR) solutions treat the…

Computation and Language · Computer Science 2021-01-18 Alon Jacovi , Gang Niu , Yoav Goldberg , Masashi Sugiyama

People learn to discriminate between classes without explicit exposure to negative examples. On the contrary, traditional machine learning algorithms often rely on negative examples, otherwise the model would be prone to collapse and…

Machine Learning · Computer Science 2020-05-08 Chenhao Xie , Qiao Cheng , Jiaqing Liang , Lihan Chen , Yanghua Xiao

Many attempts have been done to extend the great success of convolutional neural networks (CNNs) achieved on high-end GPU servers to portable devices such as smart phones. Providing compression and acceleration service of deep learning…

Machine Learning · Computer Science 2019-10-09 Yixing Xu , Yunhe Wang , Hanting Chen , Kai Han , Chunjing Xu , Dacheng Tao , Chang Xu

Learning from positive and unlabeled data (PU learning) is a weakly supervised variant of binary classification in which the learner receives labels only for (some) positively labeled instances, while all other examples remain unlabeled.…

Machine Learning · Computer Science 2026-02-03 Farnam Mansouri , Sandra Zilles , Shai Ben-David

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Learning from positive and unlabeled data or PU learning is the setting where a learner only has access to positive examples and unlabeled data. The assumption is that the unlabeled data can contain both positive and negative examples. This…

Machine Learning · Computer Science 2020-05-19 Jessa Bekker , Jesse Davis