中文
相关论文

相关论文: Unsupervised Domain Adaptation of Contextualized E…

200 篇论文

Pretraining deep neural network architectures with a language modeling objective has brought large improvements for many natural language processing tasks. Exemplified by BERT, a recently proposed such architecture, we demonstrate that…

计算与语言 · 计算机科学 2019-12-05 Timo Schick , Hinrich Schütze

The rapid expansion of texts' volume and diversity presents formidable challenges in multi-domain settings. These challenges are also visible in the Persian name entity recognition (NER) settings. Traditional approaches, either employing a…

计算与语言 · 计算机科学 2024-04-04 Parham Abed Azad , Hamid Beigy

Domain adaptive text classification is a challenging problem for the large-scale pretrained language models because they often require expensive additional labeled data to adapt to new domains. Existing works usually fails to leverage the…

计算与语言 · 计算机科学 2022-06-22 Tian Li , Xiang Chen , Zhen Dong , Weijiang Yu , Yijun Yan , Kurt Keutzer , Shanghang Zhang

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

计算与语言 · 计算机科学 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Unsupervised domain adaptation seeks to learn an invariant and discriminative representation for an unlabeled target domain by leveraging the information of a labeled source dataset. We propose to improve the discriminative ability of the…

机器学习 · 计算机科学 2019-06-03 Rui Wang , Guoyin Wang , Ricardo Henao

Large pre-trained models have achieved great success in many natural language processing tasks. However, when they are applied in specific domains, these models suffer from domain shift and bring challenges in fine-tuning and online serving…

计算与语言 · 计算机科学 2021-06-30 Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei

This work provides a framework for addressing the problem of supervised domain adaptation with deep models. The main idea is to exploit adversarial learning to learn an embedded subspace that simultaneously maximizes the confusion between…

计算机视觉与模式识别 · 计算机科学 2017-11-08 Saeid Motiian , Quinn Jones , Seyed Mehdi Iranmanesh , Gianfranco Doretto

Multi-source unsupervised domain adaptation~(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framework based on…

计算机视觉与模式识别 · 计算机科学 2021-06-21 Jianzhong He , Xu Jia , Shuaijun Chen , Jianzhuang Liu

Domain shift is a significant challenge in machine learning, particularly in medical applications where data distributions differ across institutions due to variations in data collection practices, equipment, and procedures. This can…

机器学习 · 计算机科学 2025-06-30 Takumi Okuo , Shinnosuke Matsuo , Shota Harada , Kiyohito Tanaka , Ryoma Bise

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

We present a novel multiple-source unsupervised model for text classification under domain shift. Our model exploits the update rates in document representations to dynamically integrate domain encoders. It also employs a probabilistic…

计算与语言 · 计算机科学 2022-03-22 Payam Karisani

Unsupervised domain adaptation for semantic segmentation aims to make models trained on synthetic data (source domain) adapt to real images (target domain). Previous feature-level adversarial learning methods only consider adapting models…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Hongruixuan Chen , Chen Wu , Yonghao Xu , Bo Du

Domain adaptive semantic segmentation is recognized as a promising technique to alleviate the domain shift between the labeled source domain and the unlabeled target domain in many real-world applications, such as automatic pilot. However,…

计算机视觉与模式识别 · 计算机科学 2021-10-14 Fuming You , Jingjing Li , Lei Zhu , Ke Lu , Zhi Chen , Zi Huang

Unsupervised domain adaptation is effective in leveraging the rich information from the source domain to the unsupervised target domain. Though deep learning and adversarial strategy make an important breakthrough in the adaptability of…

机器学习 · 计算机科学 2020-03-02 You-Wei Luo , Chuan-Xian Ren , Pengfei Ge , Ke-Kun Huang , Yu-Feng Yu

Recent literature has demonstrated the potential of multilingual Neural Machine Translation (mNMT) models. However, the most efficient models are not well suited to specialized industries. In these cases, internal data is scarce and…

计算与语言 · 计算机科学 2022-10-28 Mathieu Grosso , Pirashanth Ratnamogan , Alexis Mathey , William Vanhuffel , Michael Fotso Fotso

Existing Question Answering (QA) systems limited by the capability of answering questions from unseen domain or any out-of-domain distributions making them less reliable for deployment to real scenarios. Most importantly all the existing QA…

计算与语言 · 计算机科学 2023-05-10 Anant Khandelwal

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

计算与语言 · 计算机科学 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

Semi-supervised domain adaptation aims to classify data belonging to a target domain by utilizing a related label-rich source domain and very few labeled examples of the target domain. Here, we propose a novel framework, Pred&Guide, which…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Megh Manoj Bhalerao , Anurag Singh , Soma Biswas

In semi-supervised domain adaptation, a few labeled samples per class in the target domain guide features of the remaining target samples to aggregate around them. However, the trained model cannot produce a highly discriminative feature…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Jichang Li , Guanbin Li , Yemin Shi , Yizhou Yu

While unsupervised domain adaptation methods based on deep architectures have achieved remarkable success in many computer vision tasks, they rely on a strong assumption, i.e. labeled source data must be available. In this work we overcome…

计算机视觉与模式识别 · 计算机科学 2020-08-12 Willi Menapace , Stéphane Lathuilière , Elisa Ricci