English
Related papers

Related papers: Domain Adaptation for Dense Retrieval through Self…

200 papers

Unsupervised domain adaptation (DA) with the aid of pseudo labeling techniques has emerged as a crucial approach for domain-adaptive 3D object detection. While effective, existing DA methods suffer from a substantial drop in performance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhuoxiao Chen , Yadan Luo , Zheng Wang , Mahsa Baktashmotlagh , Zi Huang

Self-training has been shown to be helpful in addressing data scarcity for many domains, including vision, speech, and language. Specifically, self-training, or pseudo-labeling, labels unsupervised data and adds that to the training pool.…

Computation and Language · Computer Science 2022-12-21 Mozhdeh Gheini , Tatiana Likhomanenko , Matthias Sperber , Hendra Setiawan

Black-Box unsupervised domain adaptation (BBUDA) learns knowledge only with the prediction of target data from the source model without access to the source data and source model, which attempts to alleviate concerns about the privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yawen Zou , Chunzhi Gu , Jun Yu , Shangce Gao , Chao Zhang

Domain adaptation manages to transfer the knowledge of well-labeled source data to unlabeled target data. Many recent efforts focus on improving the prediction accuracy of target pseudo-labels to reduce conditional distribution shift. In…

Machine Learning · Computer Science 2023-02-20 Lei Tian , Yongqiang Tang , Liangchen Hu , Wensheng Zhang

Recent multilingual pre-trained models have shown better performance in various multilingual tasks. However, these models perform poorly on multilingual retrieval tasks due to lacking multilingual training data. In this paper, we propose to…

Information Retrieval · Computer Science 2023-03-28 Houxing Ren , Linjun Shou , Jian Pei , Ning Wu , Ming Gong , Daxin Jiang

Semi-supervised learning, i.e. jointly learning from labeled and unlabeled samples, is an active research topic due to its key role on relaxing human supervision. In the context of image classification, recent advances to learn from…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

In semi-supervised domain adaptation, a few labeled samples per class in the target domain guide features of the remaining target samples to aggregate around them. However, the trained model cannot produce a highly discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Jichang Li , Guanbin Li , Yemin Shi , Yizhou Yu

Despite the impressive improvements achieved by unsupervised deep neural networks in computer vision and NLP tasks, such improvements have not yet been observed in ranking for information retrieval. The reason may be the complexity of the…

Information Retrieval · Computer Science 2017-05-30 Mostafa Dehghani , Hamed Zamani , Aliaksei Severyn , Jaap Kamps , W. Bruce Croft

This paper focuses on the unsupervised domain adaptation of transferring the knowledge from the source domain to the target domain in the context of semantic segmentation. Existing approaches usually regard the pseudo label as the ground…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Zhedong Zheng , Yi Yang

Semi-supervised object detection has made significant progress with the development of mean teacher driven self-training. Despite the promising results, the label mismatch problem is not yet fully explored in the previous works, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Binbin Chen , Weijie Chen , Shicai Yang , Yunyi Xuan , Jie Song , Di Xie , Shiliang Pu , Mingli Song , Yueting Zhuang

"Self-training" has become a dominant method for semantic segmentation via unsupervised domain adaptation (UDA). It creates a set of pseudo labels for the target domain to give explicit supervision. However, the pseudo labels are noisy,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Inseop Chung , Jayeon Yoo , Nojun Kwak

Recent progress in semi- and self-supervised learning has caused a rift in the long-held belief about the need for an enormous amount of labeled data for machine learning and the irrelevancy of unlabeled data. Although it has been…

Machine Learning · Computer Science 2023-03-14 Minwook Kim , Juseong Kim , Giltae Song

Deep learning is usually data starved, and the unsupervised domain adaptation (UDA) is developed to introduce the knowledge in the labeled source domain to the unlabeled target domain. Recently, deep self-training presents a powerful means…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Lingsheng Kong , Bo Hu , Xiongchang Liu , Jun Lu , Jane You , Xiaofeng Liu

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

Pseudo-labels are confident predictions made on unlabeled target data by a classifier trained on labeled source data. They are widely used for adapting a model to unlabeled data, e.g., in a semi-supervised learning setting. Our key insight…

Machine Learning · Computer Science 2022-04-22 Xudong Wang , Zhirong Wu , Long Lian , Stella X. Yu

Dense retrieval represents queries and documents as high-dimensional embeddings, but these representations can be redundant at the query level: for a given information need, only a subset of dimensions is consistently helpful for ranking.…

Information Retrieval · Computer Science 2026-02-10 Zhanyu Wu , Richong Zhang , Zhijie Nie

With the goal of directly generalizing trained model to unseen target domains, domain generalization (DG), a newly proposed learning paradigm, has attracted considerable attention. Previous DG models usually require a sufficient quantity of…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Ruiqi Wang , Lei Qi , Yinghuan Shi , Yang Gao

Domain adaptation has been a fundamental technology for transferring knowledge from a source domain to a target domain. The key issue of domain adaptation is how to reduce the distribution discrepancy between two domains in a proper way…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Lei Tian , Yongqiang Tang , Liangchen Hu , Zhida Ren , Wensheng Zhang

Training deep neural networks (DNNs) with limited supervision has been a popular research topic as it can significantly alleviate the annotation burden. Self-training has been successfully applied in semi-supervised learning tasks, but one…

Machine Learning · Computer Science 2023-02-17 Ran Xu , Yue Yu , Hejie Cui , Xuan Kan , Yanqiao Zhu , Joyce Ho , Chao Zhang , Carl Yang

This work addresses the unsupervised adaptation of an existing object detector to a new target domain. We assume that a large number of unlabeled videos from this domain are readily available. We automatically obtain labels on the target…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Aruni RoyChowdhury , Prithvijit Chakrabarty , Ashish Singh , SouYoung Jin , Huaizu Jiang , Liangliang Cao , Erik Learned-Miller