English
Related papers

Related papers: Unsupervised Domain Adaptation of Contextualized E…

200 papers

Pretraining deep neural network architectures with a language modeling objective has brought large improvements for many natural language processing tasks. Exemplified by BERT, a recently proposed such architecture, we demonstrate that…

Computation and Language · Computer Science 2019-12-05 Timo Schick , Hinrich Schütze

The rapid expansion of texts' volume and diversity presents formidable challenges in multi-domain settings. These challenges are also visible in the Persian name entity recognition (NER) settings. Traditional approaches, either employing a…

Computation and Language · Computer Science 2024-04-04 Parham Abed Azad , Hamid Beigy

Domain adaptive text classification is a challenging problem for the large-scale pretrained language models because they often require expensive additional labeled data to adapt to new domains. Existing works usually fails to leverage the…

Computation and Language · Computer Science 2022-06-22 Tian Li , Xiang Chen , Zhen Dong , Weijiang Yu , Yijun Yan , Kurt Keutzer , Shanghang Zhang

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

Computation and Language · Computer Science 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the…

Machine Learning · Computer Science 2019-06-03 Rui Wang , Guoyin Wang , Ricardo Henao

Large pre-trained models have achieved great success in many natural language processing tasks. However, when they are applied in specific domains, these models suffer from domain shift and bring challenges in fine-tuning and online serving…

Computation and Language · Computer Science 2021-06-30 Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between…

Computer Vision and Pattern Recognition · Computer Science 2017-11-08 Saeid Motiian , Quinn Jones , Seyed Mehdi Iranmanesh , Gianfranco Doretto

Multi-source unsupervised domain adaptation~(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framework based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jianzhong He , Xu Jia , Shuaijun Chen , Jianzhuang Liu

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

Machine Learning · Computer Science 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

We present a novel multiple-source unsupervised model for text classification under domain shift. Our model exploits the update rates in document representations to dynamically integrate domain encoders. It also employs a probabilistic…

Computation and Language · Computer Science 2022-03-22 Payam Karisani

Unsupervised domain adaptation for semantic segmentation aims to make models trained on synthetic data (source domain) adapt to real images (target domain). Previous feature-level adversarial learning methods only consider adapting models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Hongruixuan Chen , Chen Wu , Yonghao Xu , Bo Du

Domain adaptive semantic segmentation is recognized as a promising technique to alleviate the domain shift between the labeled source domain and the unlabeled target domain in many real-world applications, such as automatic pilot. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Fuming You , Jingjing Li , Lei Zhu , Ke Lu , Zhi Chen , Zi Huang

Unsupervised domain adaptation is effective in leveraging the rich information from the source domain to the unsupervised target domain. Though deep learning and adversarial strategy make an important breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-03-02 You-Wei Luo , Chuan-Xian Ren , Pengfei Ge , Ke-Kun Huang , Yu-Feng Yu

Recent literature has demonstrated the potential of multilingual Neural Machine Translation (mNMT) models. However, the most efficient models are not well suited to specialized industries. In these cases, internal data is scarce and…

Computation and Language · Computer Science 2022-10-28 Mathieu Grosso , Pirashanth Ratnamogan , Alexis Mathey , William Vanhuffel , Michael Fotso Fotso

Existing Question Answering (QA) systems limited by the capability of answering questions from unseen domain or any out-of-domain distributions making them less reliable for deployment to real scenarios. Most importantly all the existing QA…

Computation and Language · Computer Science 2023-05-10 Anant Khandelwal

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

Computation and Language · Computer Science 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

Semi-supervised domain adaptation aims to classify data belonging to a target domain by utilizing a related label-rich source domain and very few labeled examples of the target domain. Here, we propose a novel framework, Pred&Guide, which…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Megh Manoj Bhalerao , Anurag Singh , Soma Biswas

In semi-supervised domain adaptation, a few labeled samples per class in the target domain guide features of the remaining target samples to aggregate around them. However, the trained model cannot produce a highly discriminative feature…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Jichang Li , Guanbin Li , Yemin Shi , Yizhou Yu

While unsupervised domain adaptation methods based on deep architectures have achieved remarkable success in many computer vision tasks, they rely on a strong assumption, i.e. labeled source data must be available. In this work we overcome…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Willi Menapace , Stéphane Lathuilière , Elisa Ricci