English
Related papers

Related papers: Knowledge Distillation for BERT Unsupervised Domai…

200 papers

Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains relatively…

Machine Learning · Computer Science 2024-02-20 Yunjuan Wang , Hussein Hazimeh , Natalia Ponomareva , Alexey Kurakin , Ibrahim Hammoud , Raman Arora

Aspect-Based Sentiment Analysis (ABSA) deals with the extraction of sentiments and their targets. Collecting labeled data for this task in order to help neural networks generalize better can be laborious and time-consuming. As an…

Machine Learning · Computer Science 2020-10-26 Akbar Karimi , Leonardo Rossi , Andrea Prati

Aspect-based sentiment analysis (ABSA) in natural language processing enables organizations to understand customer opinions on specific product aspects. While deep learning models are widely used for English ABSA, their application in…

Computation and Language · Computer Science 2025-09-23 Salha Alyami , Amani Jamal , Areej Alhothali

In recent years, unsupervised domain adaptation (UDA) for semantic segmentation has brought many researchers'attention. Many of them take an approach to design a complex system so as to better align the gap between source and target domain.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Junhao Yan , Woonsok Lee

Unsupervised domain adaptation (UDA) is important for applications where large scale annotation of representative data is challenging. For semantic segmentation in particular, it helps deploy on real "target domain" data models that are…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tuan-Hung Vu , Himalaya Jain , Maxime Bucher , Matthieu Cord , Patrick Pérez

Domain adversarial training has shown its effective capability for finding domain invariant feature representations and been successfully adopted for various domain adaptation tasks. However, recent advances of large models (e.g., vision…

Machine Learning · Computer Science 2024-07-18 Jiahong Chen , Zhilin Zhang , Lucy Li , Behzad Shahrasbi , Arjun Mishra

Speaker verification systems often degrade significantly when there is a language mismatch between training and testing data. Being able to improve cross-lingual speaker verification system using unlabeled data can greatly increase the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-03 Wei Xia , Jing Huang , John H. L. Hansen

Unsupervised Domain Adaptation (UDA) refers to the method that utilizes annotated source domain data and unlabeled target domain data to train a model capable of generalizing to the target domain data. Domain discrepancy leads to a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ting Li , Jianshu Chao , Deyu An

Federated learning improves data privacy and efficiency in machine learning performed over networks of distributed devices, such as mobile phones, IoT and wearable devices, etc. Yet models trained with federated learning can still fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Xingchao Peng , Zijun Huang , Yizhe Zhu , Kate Saenko

Domain-adapted sentiment classification refers to training on a labeled source domain to well infer document-level sentiment on an unlabeled target domain. Most existing relevant models involve a feature extractor and a sentiment…

Computation and Language · Computer Science 2020-02-06 Qianming Xue , Wei Zhang , Hongyuan Zha

We consider the problem of OOD generalization, where the goal is to train a model that performs well on test distributions that are different from the training distribution. Deep learning models are known to be fragile to such shifts and…

Machine Learning · Computer Science 2022-08-22 Anshul Nasery , Sravanti Addepalli , Praneeth Netrapalli , Prateek Jain

Recent advances in pre-training huge models on large amounts of text through self supervision have obtained state-of-the-art results in various natural language processing tasks. However, these huge and expensive models are difficult to use…

Computation and Language · Computer Science 2020-07-24 Subhabrata Mukherjee , Ahmed Hassan Awadallah

Unsupervised domain adaptation (UDA) seeks to alleviate the problem of domain shift between the distribution of unlabeled data from the target domain w.r.t. labeled data from the source domain. While the single-target UDA scenario is well…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Le Thanh Nguyen-Meidine , Atif Belal , Madhu Kiran , Jose Dolz , Louis-Antoine Blais-Morin , Eric Granger

To be successful in single source domain generalization, maximizing diversity of synthesized domains has emerged as one of the most effective strategies. Many of the recent successes have come from methods that pre-specify the types of…

Machine Learning · Computer Science 2022-12-14 Tejas Gokhale , Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Chitta Baral , Yezhou Yang

Unsupervised domain adaptation addresses the problem of classifying data in an unlabeled target domain, given labeled source domain data that share a common label space but follow a different distribution. Most of the recent methods take…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Hui Tang , Yaowei Wang , Kui Jia

The Visual Domain Adaptation Challenge 2021 called for unsupervised domain adaptation methods that could improve the performance of models by transferring the knowledge obtained from source datasets to out-of-distribution target datasets.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Burhan Ul Tayyab , Nicholas Chua

Despite the recent advancement in speech emotion recognition (SER) within a single corpus setting, the performance of these SER systems degrades significantly for cross-corpus and cross-language scenarios. The key reason is the lack of…

Sound · Computer Science 2022-04-20 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Björn Schuller

In unsupervised domain adaptive (UDA) semantic segmentation, the distillation based methods are currently dominant in performance. However, the distillation technique requires complicate multi-stage process and many training tricks. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Junjie Li , Zilei Wang , Yuan Gao , Xiaoming Hu

Unsupervised Domain Adaptation (UDA) aims at improving the generalization capability of a model trained on a source domain to perform well on a target domain for which no labeled data is available. In this paper, we consider the semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Teo Spadotto , Marco Toldo , Umberto Michieli , Pietro Zanuttigh

Discrepancy between training and testing domains is a fundamental problem in the generalization of machine learning techniques. Recently, several approaches have been proposed to learn domain invariant feature representations through…

Machine Learning · Statistics 2019-03-18 Yitong Li , Michael Murias , Samantha Major , Geraldine Dawson , David E. Carlson