English
Related papers

Related papers: Prompt-based Distribution Alignment for Unsupervis…

200 papers

Adapting pre-trained language models (PrLMs) (e.g., BERT) to new domains has gained much attention recently. Instead of fine-tuning PrLMs as done in most previous work, we investigate how to adapt the features of PrLMs to new domains…

Computation and Language · Computer Science 2020-12-01 Hai Ye , Qingyu Tan , Ruidan He , Juntao Li , Hwee Tou Ng , Lidong Bing

In this work we explore Unsupervised Domain Adaptation (UDA) of pretrained language models for downstream tasks. We introduce UDALM, a fine-tuning procedure, using a mixed classification and Masked Language Model loss, that can adapt to the…

Computation and Language · Computer Science 2021-04-16 Constantinos Karouzos , Georgios Paraskevopoulos , Alexandros Potamianos

Extensive studies on Unsupervised Domain Adaptation (UDA) have propelled the deployment of deep learning from limited experimental datasets into real-world unconstrained domains. Most UDA approaches align features within a common embedding…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Wenxuan Ma , Jinming Zhang , Shuang Li , Chi Harold Liu , Yulin Wang , Wei Li

Graph neural networks (GNNs) have shown great ability for node classification on graphs. However, the success of GNNs relies on abundant labeled data, while obtaining high-quality labels is costly and challenging, especially for newly…

Machine Learning · Computer Science 2025-06-02 Yilong Wang , Tianxiang Zhao , Zongyu Wu , Suhang Wang

Unsupervised domain adaptation (UDA) methods facilitate the transfer of models to target domains without labels. However, these methods necessitate a labeled target validation set for hyper-parameter tuning and model selection. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Minghao Chen , Zepeng Gao , Shuai Zhao , Qibo Qiu , Wenxiao Wang , Binbin Lin , Xiaofei He

Prompt tuning, or the conditioning of a frozen pretrained language model (PLM) with soft prompts learned from data, has demonstrated impressive performance on a wide range of NLP tasks. However, prompt tuning requires a large training…

Computation and Language · Computer Science 2022-10-24 Xu Guo , Boyang Li , Han Yu

Unsupervised domain adaptation (UDA) is to make predictions for unlabeled data on a target domain, given labeled data on a source domain whose distribution shifts from the target one. Mainstream UDA methods learn aligned features between…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Hui Tang , Ke Chen , Kui Jia

Unsupervised domain adaptation (UDA) is vital for alleviating the workload of labeling 3D point cloud data and mitigating the absence of labels when facing a newly defined domain. Various methods of utilizing images to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jingyi Xu , Weidong Yang , Lingdong Kong , Youquan Liu , Rui Zhang , Qingyuan Zhou , Ben Fei

Unsupervised domain adaption (UDA) is a transfer learning task where the data and annotations of the source domain are available but only have access to the unlabeled target data during training. Most previous methods try to minimise the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Xinyao Shu , Shiyang Yan , Zhenyu Lu , Xinshao Wang , Yuan Xie

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

Unsupervised domain adaptation (UDA) plays a crucial role in addressing distribution shifts in machine learning. In this work, we improve the theoretical foundations of UDA proposed in Acuna et al. (2021) by refining their…

Machine Learning · Statistics 2024-10-29 Ziqiao Wang , Yongyi Mao

Unsupervised Domain Adaptation (UDA) addresses the problem of performance degradation due to domain shift between training and testing sets, which is common in computer vision applications. Most existing UDA approaches are based on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Yan Yan , Hao Tang , Jianjun Qian , Jian Zhang , Xiao-Yuan Jing

Unsupervised domain adaptation~(UDA) aims at reducing the distribution discrepancy when transferring knowledge from a labeled source domain to an unlabeled target domain. Previous UDA methods assume that the source and target domains share…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Chuan-Xian Ren , Pengfei Ge , Peiyi Yang , Shuicheng Yan

Unsupervised domain adaptive classifcation intends to improve the classifcation performance on unlabeled target domain. To alleviate the adverse effect of domain shift, many approaches align the source and target domains in the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Guoqiang Wei , Cuiling Lan , Wenjun Zeng , Zhizheng Zhang , Zhibo Chen

Domain shift poses a significant challenge in cross-domain spoken language recognition (SLR) by reducing its effectiveness. Unsupervised domain adaptation (UDA) algorithms have been explored to address domain shifts in SLR without relying…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

Unsupervised domain adaptation (UDA) aims to learn the unlabeled target domain by transferring the knowledge of the labeled source domain. To date, most of the existing works focus on the scenario of one source domain and one target domain…

Machine Learning · Computer Science 2018-09-18 Huanhuan Yu , Menglei Hu , Songcan Chen

Unsupervised domain adaptation (UDA) for semantic segmentation addresses the cross-domain problem with fine source domain labels. However, the acquisition of semantic labels has always been a difficult step, many scenarios only have weak…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Shengjie Liu , Chuang Zhu , Wenqi Tang

Unsupervised Domain Adaptation (UDA) aims to adapt models from labeled source domains to unlabeled target domains. When adapting to adverse scenes, existing UDA methods fail to perform well due to the lack of instructions, leading their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Ziyang Gong , Fuhao Li , Yupeng Deng , Deblina Bhattacharjee , Xianzheng Ma , Xiangwei Zhu , Zhenming Ji

Semantic segmentation suffers from significant performance degradation when the trained network is applied to a different domain. To address this issue, unsupervised domain adaptation (UDA) has been extensively studied. Despite the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wangkai Li , Rui Sun , Huayu Mai , Tianzhu Zhang

Deep learning-based solutions for semantic segmentation suffer from significant performance degradation when tested on data with different characteristics than what was used during the training. Adapting the models using annotated data from…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Xingchen Zhao , Niluthpol Chowdhury Mithun , Abhinav Rajvanshi , Han-Pang Chiu , Supun Samarasekera