English
Related papers

Related papers: Domain-Conditioned Transformer for Fully Test-time…

200 papers

Over the past decade, domain adaptation has become a widely studied branch of transfer learning that aims to improve performance on target domains by leveraging knowledge from the source domain. Conventional domain adaptation methods often…

Machine Learning · Computer Science 2023-02-24 Zhiqi Yu , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

Practical learning-based autonomous driving models must be capable of generalizing learned behaviors from simulated to real domains, and from training data to unseen domains with unusual image properties. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Shivam Akhauri , Laura Zheng , Tom Goldstein , Ming Lin

We present a novel approach for test-time adaptation via online self-training, consisting of two components. First, we introduce a statistical framework that detects distribution shifts in the classifier's entropy values obtained on a…

Machine Learning · Computer Science 2025-01-07 Yarin Bar , Shalev Shaer , Yaniv Romano

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not always be available.…

Computation and Language · Computer Science 2022-06-15 Xiang Pan , Alex Sheng , David Shimshoni , Aditya Singhal , Sara Rosenthal , Avirup Sil

This paper proposes a novel test-time adaptation strategy that adjusts the model pre-trained on the source domain using only unlabeled online data from the target domain to alleviate the performance degradation due to the distribution shift…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Sungha Choi , Seunghan Yang , Seokeon Choi , Sungrack Yun

In practice, environments constantly change over time and space, posing significant challenges for object detectors trained based on a closed-set assumption, i.e., training and test data share the same distribution. To this end, continual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Deng Li , Aming Wu , Yang Li , Yaowei Wang , Yahong Han

Object detectors frequently encounter significant performance degradation when confronted with domain gaps between collected data (source domain) and data from real-world applications (target domain). To address this task, numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jianhong Han , Liang Chen , Yupei Wang

Multi-source Domain Adaptation (MDA) seeks to adapt models trained on data from multiple labeled source domains to perform effectively on an unlabeled target domain data, assuming access to sources data. To address the challenges of model…

Machine Learning · Computer Science 2024-08-20 Omar Ghannou , Younès Bennani

The task of unsupervised domain adaptation is proposed to transfer the knowledge of a label-rich domain (source domain) to a label-scarce domain (target domain). Matching feature distributions between different domains is a widely applied…

Machine Learning · Computer Science 2018-12-19 Toshihiko Matsuura , Kuniaki Saito , Tatsuya Harada

This work proposes a robust Partial Domain Adaptation (PDA) framework that mitigates the negative transfer problem by incorporating a robust target-supervision strategy. It leverages ensemble learning and includes diverse, complementary…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen

Surface defect detection is significant in industrial production. However, detecting defects with varying textures and anomaly classes during the test time is challenging. This arises due to the differences in data distributions between…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yiran Song , Qianyu Zhou , Lizhuang Ma

Unsupervised Domain Adaptation (UDA) aims to leverage a label-rich source domain to solve tasks on a related unlabeled target domain. It is a challenging problem especially when a large domain gap lies between the source and target domains.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Tao Sun , Cheng Lu , Tianshuo Zhang , Haibin Ling

Recent works of multi-source domain adaptation focus on learning a domain-agnostic model, of which the parameters are static. However, such a static model is difficult to handle conflicts across multiple domains, and suffers from a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yunsheng Li , Lu Yuan , Yinpeng Chen , Pei Wang , Nuno Vasconcelos

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Cross-domain sentiment classification has been a hot spot these years, which aims to learn a reliable classifier using labeled data from a source domain and evaluate it on a target domain. In this vein, most approaches utilized domain…

Computation and Language · Computer Science 2022-09-08 Yicheng Zhu , Yiqiao Qiu , Qingyuan Wu , Fu Lee Wang , Yanghui Rao

Recent advances in unsupervised domain adaptation have shown the effectiveness of adversarial training to adapt features across domains, endowing neural networks with the capability of being tested on a target domain without requiring any…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Mikel Menta , Adriana Romero , Joost van de Weijer

Adapter layers are lightweight, learnable units inserted between transformer layers. Recent work explores using such layers for neural machine translation (NMT), to adapt pre-trained models to new domains or language pairs, training only a…

Computation and Language · Computer Science 2021-10-20 Asa Cooper Stickland , Alexandre Bérard , Vassilina Nikoulina

Transformers architecture apply self-attention to tokens represented as vectors, before a fully connected (neuronal network) layer. These two parts can be layered many times. Traditionally, self-attention is seen as a mechanism for…

Computation and Language · Computer Science 2025-01-22 Evgeniy Shin , Heinrich Matzinger

Existing domain adaptation methods aim at learning features that can be generalized among domains. These methods commonly require to update source classifier to adapt to the target domain and do not properly handle the trade off between the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Shaokai Ye , Kailu Wu , Mu Zhou , Yunfei Yang , Sia huat Tan , Kaidi Xu , Jiebo Song , Chenglong Bao , Kaisheng Ma

Domain adaptation is an important task to enable learning when labels are scarce. While most works focus only on the image modality, there are many important multi-modal datasets. In order to leverage multi-modality for domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Maximilian Jaritz , Tuan-Hung Vu , Raoul de Charette , Émilie Wirbel , Patrick Pérez