English
Related papers

Related papers: Unsupervised Learning under Latent Label Shift

200 papers

In conventional domain adaptation, a critical assumption is that there exists a fully labeled domain (source) that contains the same label space as another unlabeled or scarcely labeled domain (target). However, in the real world, there…

Machine Learning · Computer Science 2019-05-01 Shuhan Tan , Jiening Jiao , Wei-Shi Zheng

Supervised classification approaches can predict labels for unknown data because of the supervised training process. The success of classification is heavily dependent on the labeled training data. Differently, clustering is effective in…

Machine Learning · Computer Science 2015-02-19 Fangfang Li , Guandong Xu , Longbing Cao

When faced with distribution shift at test time, deep neural networks often make inaccurate predictions with unreliable uncertainty estimates. While improving the robustness of neural networks is one promising approach to mitigate this…

Machine Learning · Computer Science 2021-09-28 Aurick Zhou , Sergey Levine

Self-supervised pretraining on unlabeled data followed by supervised fine-tuning on labeled data is a popular paradigm for learning from limited labeled examples. We extend this paradigm to the classical positive unlabeled (PU) setting,…

Machine Learning · Computer Science 2024-04-01 Anish Acharya , Sujay Sanghavi , Li Jing , Bhargav Bhushanam , Dhruv Choudhary , Michael Rabbat , Inderjit Dhillon

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

Humans are capable of learning new concepts from only a few (labeled) exemplars, incrementally and continually. This happens within the context that we can differentiate among the exemplars, and between the exemplars and large amounts of…

Machine Learning · Computer Science 2022-02-08 Daniel T. Chang

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

Machine Learning · Computer Science 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Semi-supervised learning deals with the problem of how, if possible, to take advantage of a huge amount of not classified data, to perform classification, in situations when, typically, the labelled data are few. Even though this is not…

Statistics Theory · Mathematics 2017-12-18 Alejandro Cholaquidis , Ricardo Fraiman , Mariela Sued

Learning from indirect supervision signals is important in real-world AI applications when, often, gold labels are missing or too costly. In this paper, we develop a unified theoretical framework for multi-class classification when the…

Machine Learning · Computer Science 2020-11-12 Kaifu Wang , Qiang Ning , Dan Roth

Standard Unsupervised Domain Adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target but usually requires simultaneous access to both source and target data. Moreover, UDA approaches commonly assume…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Mattia Litrico , Davide Talon , Sebastiano Battiato , Alessio Del Bue , Mario Valerio Giuffrida , Pietro Morerio

Recent advancements in unsupervised domain adaptation (UDA) and semi-supervised learning (SSL), particularly incorporating causality, have led to significant methodological improvements in these learning problems. However, a formal theory…

Machine Learning · Computer Science 2024-09-17 Xuetong Wu , Mingming Gong , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

In this paper, we address a complex but practical scenario in semi-supervised learning (SSL) named open-set SSL, where unlabeled data contain both in-distribution (ID) and out-of-distribution (OOD) samples. Unlike previous methods that only…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Ganlong Zhao , Guanbin Li , Yipeng Qin , Jinjin Zhang , Zhenhua Chai , Xiaolin Wei , Liang Lin , Yizhou Yu

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Domain adaptation helps transfer the knowledge gained from a labeled source domain to an unlabeled target domain. During the past few years, different domain adaptation techniques have been published. One common flaw of these approaches is…

Machine Learning · Computer Science 2020-12-25 Mohammad J. Hashemi , Eric Keller

Semi-supervised learning (SSL) aims to train a machine learning model using both labelled and unlabelled data. While the unlabelled data have been used in various ways to improve the prediction accuracy, the reason why unlabelled data could…

Machine Learning · Statistics 2025-10-28 Archer Moore , Heejung Shim , Jingge Zhu , Mingming Gong

Open-world semi-supervised learning (OWSSL) extends conventional semi-supervised learning to open-world scenarios by taking account of novel categories in unlabeled datasets. Despite the recent advancements in OWSSL, the success often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Seongheon Park , Hyuk Kwon , Kwanghoon Sohn , Kibok Lee

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

Machine Learning · Computer Science 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

In unsupervised domain adaptation, existing theory focuses on situations where the source and target domains are close. In practice, conditional entropy minimization and pseudo-labeling work even when the domain shifts are much larger than…

Machine Learning · Computer Science 2020-12-09 Yining Chen , Colin Wei , Ananya Kumar , Tengyu Ma

Domain adaptation solves image classification problems in the target domain by taking advantage of the labelled source data and unlabelled target data. Usually, the source and target domains share the same set of classes. As a special case,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Qian Wang , Fanlin Meng , Toby P. Breckon