English
Related papers

Related papers: Domain-Conditioned Transformer for Fully Test-time…

200 papers

Domain adaptation tasks such as cross-domain sentiment classification aim to utilize existing labeled data in the source domain and unlabeled or few labeled data in the target domain to improve the performance in the target domain via…

Computation and Language · Computer Science 2022-01-03 Dongbo Xi , Fuzhen Zhuang , Ganbin Zhou , Xiaohu Cheng , Fen Lin , Qing He

Data samples generated by several real world processes are dynamic in nature \textit{i.e.}, their characteristics vary with time. Thus it is not possible to train and tackle all possible distributional shifts between training and inference,…

Machine Learning · Computer Science 2021-10-22 Prabhu Teja Sivaprasad , François Fleuret

We propose a test-time adaptation method for cross-domain image segmentation. Our method is simple: Given a new unseen instance at test time, we adapt a pre-trained model by conducting instance-specific BatchNorm (statistics) calibration.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yuliang Zou , Zizhao Zhang , Chun-Liang Li , Han Zhang , Tomas Pfister , Jia-Bin Huang

The recent breakthrough of Transformers in deep learning has drawn significant attention of the time series community due to their ability to capture long-range dependencies. However, like other deep learning models, Transformers face…

Machine Learning · Computer Science 2024-01-15 Subina Khanal , Seshu Tirupathi , Giulio Zizzo , Ambrish Rawat , Torben Bach Pedersen

Tremendous research efforts have been made to thrive deep domain adaptation (DA) by seeking domain-invariant features. Most existing deep DA models only focus on aligning feature representations of task-specific layers across domains while…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Shuang Li , Chi Harold Liu , Qiuxia Lin , Binhui Xie , Zhengming Ding , Gao Huang , Jian Tang

Recently, semantic parsing has attracted much attention in the community. Although many neural modeling efforts have greatly improved the performance, it still suffers from the data scarcity issue. In this paper, we propose a novel semantic…

Computation and Language · Computer Science 2020-06-24 Zechang Li , Yuxuan Lai , Yansong Feng , Dongyan Zhao

Transformer-based architectures are the most used architectures in many deep learning fields like Natural Language Processing, Computer Vision or Speech processing. It may encourage the direct use of Transformers in the constrained tasks,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-29 Youness Dkhissi , Valentin Vielzeuf , Elys Allesiardo , Anthony Larcher

A practical shortcoming of deep neural networks is their specialization to a single task and domain. While recent techniques in domain adaptation and multi-domain learning enable the learning of more domain-agnostic features, their success…

Machine Learning · Computer Science 2020-06-02 Lucas Deecke , Timothy Hospedales , Hakan Bilen

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

As acquiring pixel-wise annotations of real-world images for semantic segmentation is a costly process, a model can instead be trained with more accessible synthetic data and adapted to real images without requiring their annotations. This…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Lukas Hoyer , Dengxin Dai , Luc Van Gool

Spatio-temporal action localization is an important problem in computer vision that involves detecting where and when activities occur, and therefore requires modeling of both spatial and temporal features. This problem is typically…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Nakul Agarwal , Yi-Ting Chen , Behzad Dariush , Ming-Hsuan Yang

The current trend of automating inspections at substations has sparked a surge in interest in the field of transformer image recognition. However, due to restrictions in the number of parameters in existing models, high-resolution images…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Siyi Zhang , Cheng Liu , Xiang Li , Xin Zhai , Zhen Wei , Sizhe Li , Xun Ma

Test-time adaptation (TTA) aims to adapt a trained classifier using online unlabeled test data only, without any information related to the training procedure. Most existing TTA methods adapt the trained classifier using the classifier's…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Minguk Jang , Sae-Young Chung , Hye Won Chung

The Visual Domain Adaptation Challenge 2021 called for unsupervised domain adaptation methods that could improve the performance of models by transferring the knowledge obtained from source datasets to out-of-distribution target datasets.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Burhan Ul Tayyab , Nicholas Chua

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

Most few-shot learning works rely on the same domain assumption between the base and the target tasks, hindering their practical applications. This paper proposes an adaptive transformer network (ADAPTER), a simple but effective solution…

Machine Learning · Computer Science 2024-01-26 Naeem Paeedeh , Mahardhika Pratama , Muhammad Anwar Ma'sum , Wolfgang Mayer , Zehong Cao , Ryszard Kowlczyk

Deep imitation learning is promising for solving dexterous manipulation tasks because it does not require an environment model and pre-programmed robot behavior. However, its application to dual-arm manipulation tasks remains challenging.…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Current Domain Adaptation (DA) methods based on deep architectures assume that the source samples arise from a single distribution. However, in practice, most datasets can be regarded as mixtures of multiple domains. In these cases…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Massimiliano Mancini , Lorenzo Porzi , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

Semantic segmentation is an important sub-task for many applications, but pixel-level ground truth labeling is costly and there is a tendency to overfit the training data, limiting generalization. Unsupervised domain adaptation can…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Yue Wang , Yuke Li , James H. Elder , Runmin Wu , Huchuan Lu