English
Related papers

Related papers: Domain Adaptation with Adversarial Training on Pen…

200 papers

In this work we explore Unsupervised Domain Adaptation (UDA) of pretrained language models for downstream tasks. We introduce UDALM, a fine-tuning procedure, using a mixed classification and Masked Language Model loss, that can adapt to the…

Computation and Language · Computer Science 2021-04-16 Constantinos Karouzos , Georgios Paraskevopoulos , Alexandros Potamianos

Recent works on domain adaptation exploit adversarial training to obtain domain-invariant feature representations from the joint learning of feature extractor and domain discriminator networks. However, domain adversarial methods render…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seungmin Lee , Dongwan Kim , Namil Kim , Seong-Gyun Jeong

Domain adaptation is a potential method to train a powerful deep neural network, which can handle the absence of labeled data. More precisely, domain adaptation solving the limitation called dataset bias or domain shift when the training…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Thai-Vu Nguyen , Anh Nguyen , Nghia Le , Bac Le

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

Domain Adaptation aiming to learn a transferable feature between different but related domains has been well investigated and has shown excellent empirical performances. Previous works mainly focused on matching the marginal feature…

Machine Learning · Computer Science 2020-05-26 Fan Zhou , Changjian Shui , Bincheng Huang , Boyu Wang , Brahim Chaib-draa

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a label-rich source domain to an unlabeled target domain by addressing domain shifts. Most UDA approaches emphasize transfer ability, but often overlook robustness against…

Machine Learning · Computer Science 2025-11-17 Fuxiang Huang , Xiaowei Fu , Shiyu Ye , Lina Ma , Wen Li , Xinbo Gao , David Zhang , Lei Zhang

Fine-grained action recognition datasets exhibit environmental bias, where multiple video sequences are captured from a limited number of environments. Training a model in one environment and deploying in another results in a drop in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Jonathan Munro , Dima Damen

Unsupervised Domain Adaptation (UDA) refers to the method that utilizes annotated source domain data and unlabeled target domain data to train a model capable of generalizing to the target domain data. Domain discrepancy leads to a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ting Li , Jianshu Chao , Deyu An

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for…

Machine Learning · Computer Science 2022-06-17 Harsh Rangwani , Sumukh K Aithal , Mayank Mishra , Arihant Jain , R. Venkatesh Babu

Unsupervised domain adaptation (UDA) aims to transfer the knowledge on a labeled source domain distribution to perform well on an unlabeled target domain. Recently, the deep self-training involves an iterative process of predicting on the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Xiaofeng Liu , Bo Hu , Xiongchang Liu , Jun Lu , Jane You , Lingsheng Kong

We consider unsupervised domain adaptation (UDA), where labeled data from a source domain (e.g., photographs) and unlabeled data from a target domain (e.g., sketches) are used to learn a classifier for the target domain. Conventional UDA…

Machine Learning · Computer Science 2022-12-05 Kendrick Shen , Robbie Jones , Ananya Kumar , Sang Michael Xie , Jeff Z. HaoChen , Tengyu Ma , Percy Liang

Data augmentation has been widely used to improve generalization in training deep neural networks. Recent works show that using worst-case transformations or adversarial augmentation strategies can significantly improve the accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Liang Xiao , Jiaolong Xu , Dawei Zhao , Erke Shang , Qi Zhu , Bin Dai

We tackle the task of building supervised event trigger identification models which can generalize better across domains. Our work leverages the adversarial domain adaptation (ADA) framework to introduce domain-invariance. ADA uses…

Computation and Language · Computer Science 2020-05-26 Aakanksha Naik , Carolyn Rosé

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

Recent works on domain adaptation reveal the effectiveness of adversarial learning on filling the discrepancy between source and target domains. However, two common limitations exist in current adversarial-learning-based methods. First,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Minghao Xu , Jian Zhang , Bingbing Ni , Teng Li , Chengjie Wang , Qi Tian , Wenjun Zhang

In this paper, we make two contributions to unsupervised domain adaptation (UDA) using the convolutional neural network (CNN). First, our approach transfers knowledge in all the convolutional layers through attention alignment. Most…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Guoliang Kang , Liang Zheng , Yan Yan , Yi Yang

Unsupervised domain adaptation, which involves transferring knowledge from a label-rich source domain to an unlabeled target domain, can be used to substantially reduce annotation costs in the field of object detection. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kazuma Fujii , Hiroshi Kera , Kazuhiko Kawamoto