English
Related papers

Related papers: Information-Theoretic Representation Learning for …

200 papers

Representation learning from unlabeled data has been extensively studied in statistics, data science and signal processing with a rich literature on techniques for dimension reduction, compression, multi-dimensional scaling among others.…

Machine Learning · Computer Science 2025-10-03 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

Most of the semi-supervised classification methods developed so far use unlabeled data for regularization purposes under particular distributional assumptions such as the cluster assumption. In contrast, recently developed methods of…

Machine Learning · Computer Science 2017-06-19 Tomoya Sakai , Marthinus Christoffel du Plessis , Gang Niu , Masashi Sugiyama

Transductive learning is a supervised machine learning task in which, unlike in traditional inductive learning, the unlabelled data that require labelling are a finite set and are available at training time. Similarly to inductive learning…

Machine Learning · Computer Science 2025-07-31 Lorenzo Volpi , Alejandro Moreo , Fabrizio Sebastiani

Learning from positive and unlabeled (PU) data is a setting where the learner only has access to positive and unlabeled samples while having no information on negative examples. Such PU setting is of great importance in various tasks such…

Machine Learning · Computer Science 2022-09-07 Emilio Dorigatti , Jonas Schweisthal , Bernd Bischl , Mina Rezaei

This paper proposes an information-theoretic representation learning framework, named conditional information flow maximization, to extract noise-invariant sufficient representations for the input data and target task. It promotes the…

Machine Learning · Computer Science 2024-08-13 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

Positive-unlabeled (PU) learning is a weakly supervised binary classification problem, in which the goal is to learn a binary classifier from only positive and unlabeled data, without access to negative data. In recent years, many PU…

Machine Learning · Computer Science 2026-02-24 Wei Wang , Dong-Dong Wu , Ming Li , Jingxiong Zhang , Gang Niu , Masashi Sugiyama

Positive--Unlabeled (PU) learning considers settings in which only positive and unlabeled data are available, while negatives are missing or left unlabeled. This situation is common in real applications where annotating reliable negatives…

Machine Learning · Computer Science 2025-10-30 Miao Zhang , Junpeng Li , Changchun Hua , Yana Yang

Positive-Unlabeled (PU) learning aims to learn a model with rare positive samples and abundant unlabeled samples. Compared with classical binary classification, the task of PU learning is much more challenging due to the existence of many…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Chengming Xu , Chen Liu , Siqian Yang , Yabiao Wang , Shijie Zhang , Lijie Jia , Yanwei Fu

Given only positive (P) and unlabeled (U) data, PU learning can train a binary classifier without any negative data. It has two building blocks: PU class-prior estimation (CPE) and PU classification; the latter has been well studied while…

Machine Learning · Computer Science 2022-06-06 Yu Yao , Tongliang Liu , Bo Han , Mingming Gong , Gang Niu , Masashi Sugiyama , Dacheng Tao

Learning from positive and unlabeled data (PU learning) is actively researched machine learning task. The goal is to train a binary classification model based on a training dataset containing part of positives which are labeled, and…

Machine Learning · Statistics 2023-12-29 Wojciech Rejchel , Paweł Teisseyre , Jan Mielniczuk

Positive-unlabeled (PU) learning addresses binary classification when only a set of labeled positives is available alongside a pool of unlabeled samples drawn from a mixture of positives and negatives. Existing PU methods typically require…

Machine Learning · Statistics 2026-05-08 Siyan Liu , Yi Chang , Manli Cheng , Qinglong Tian , Pengfei Li

Positive-unlabeled learning refers to the process of training a binary classifier using only positive and unlabeled data. Although unlabeled data can contain positive data, all unlabeled data are regarded as negative data in existing…

Machine Learning · Computer Science 2021-03-09 Daiki Tanaka , Daiki Ikami , Kiyoharu Aizawa

The scarcity of class-labeled data is a ubiquitous bottleneck in many machine learning problems. While abundant unlabeled data typically exist and provide a potential solution, it is highly challenging to exploit them. In this paper, we…

Machine Learning · Computer Science 2025-07-25 Bing Yu , Ke Sun , He Wang , Zhouchen Lin , Zhanxing Zhu

Classification with positive and unlabeled (PU) data frequently arises in bioinformatics, clinical data, and ecological studies, where collecting negative samples can be prohibitively expensive. While prior works on PU data focus on binary…

Methodology · Statistics 2023-04-20 Lili Zheng , Garvesh Raskutti

Positive and Unlabeled (PU) learning, a binary classification model trained with only positive and unlabeled data, generally suffers from overfitted risk estimation due to inconsistent data distributions. To address this, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Chengjie Wang , Chengming Xu , Zhenye Gan , Jianlong Hu , Wenbing Zhu , Lizhuag Ma

Positive-unlabeled (PU) learning aims to train a classifier using the data containing only labeled-positive instances and unlabeled instances. However, existing PU learning methods are generally hard to achieve satisfactory performance on…

Machine Learning · Statistics 2024-06-03 Xiaoke Wang , Xiaochen Yang , Rui Zhu , Jing-Hao Xue

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

Positive-unlabeled (PU) learning deals with binary classification problems when only positive (P) and unlabeled (U) data are available. Many recent PU methods are based on neural networks, but little has been done to develop boosting…

Machine Learning · Computer Science 2022-12-08 Yawen Zhao , Mingzhe Zhang , Chenhao Zhang , Weitong Chen , Nan Ye , Miao Xu

Learning reward functions from data is a promising path towards achieving scalable Reinforcement Learning (RL) for robotics. However, a major challenge in training agents from learned reward models is that the agent can learn to exploit…

Machine Learning · Computer Science 2019-11-04 Danfei Xu , Misha Denil

The information bottleneck principle provides an information-theoretic method for representation learning, by training an encoder to retain all information which is relevant for predicting the label while minimizing the amount of other,…

Machine Learning · Computer Science 2020-02-19 Marco Federici , Anjan Dutta , Patrick Forré , Nate Kushman , Zeynep Akata