English
Related papers

Related papers: Efficient Pre-trained Features and Recurrent Pseud…

200 papers

We propose a novel task-agnostic in-domain pre-training method that sits between generic pre-training and fine-tuning. Our approach selectively masks in-domain keywords, i.e., words that provide a compact representation of the target…

Computation and Language · Computer Science 2023-07-17 Shahriar Golchin , Mihai Surdeanu , Nazgol Tavabi , Ata Kiapour

Unsupervised domain adaptation in person re-identification resorts to labeled source data to promote the model training on target domain, facing the dilemmas caused by large domain shift and large camera variations. The non-overlapping…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Chuan-Xian Ren , Bo-Hua Liang , Zhen Lei

Successful unsupervised domain adaptation is guaranteed only under strong assumptions such as covariate shift and overlap between input domains. The latter is often violated in high-dimensional applications like image classification which,…

Machine Learning · Computer Science 2024-06-13 Adam Breitholtz , Anton Matsson , Fredrik D. Johansson

Machine learning in medical imaging during clinical routine is impaired by changes in scanner protocols, hardware, or policies resulting in a heterogeneous set of acquisition settings. When training a deep learning model on an initial…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Matthias Perkonigg , Johannes Hofmanninger , Christian Herold , Helmut Prosch , Georg Langs

Effort in releasing large-scale datasets may be compromised by privacy and intellectual property considerations. A feasible alternative is to release pre-trained models instead. While these models are strong on their original task (source…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yunzhong Hou , Liang Zheng

Unsupervised Domain Adaptation aims to learn a model on a source domain with labeled data in order to perform well on unlabeled data of a target domain. Current approaches focus on learning \textit{Domain Invariant Representations}. It…

Machine Learning · Computer Science 2019-07-30 Victor Bouvier , Philippe Very , Céline Hudelot , Clément Chastagnol

The objective of unsupervised domain adaptation is to leverage features from a labeled source domain and learn a classifier for an unlabeled target domain, with a similar but different data distribution. Most deep learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-19 Pedro O. Pinheiro

Active domain adaptation (ADA) studies have mainly addressed query selection while following existing domain adaptation strategies. However, we argue that it is critical to consider not only query selection criteria but also domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Kyeongtak Han , Youngeun Kim , Dongyoon Han , Sungeun Hong

In recent years, researchers have been paying increasing attention to the threats brought by deep learning models to data security and privacy, especially in the field of domain adaptation. Existing unsupervised domain adaptation (UDA)…

Machine Learning · Computer Science 2021-08-31 Kunhong Wu , Yucheng Shi , Yahong Han , Yunfeng Shao , Bingshuai Li , Qi Tian

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

Machine Learning · Computer Science 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

Unsupervised domain adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain. Existing self-training based UDA approaches assign pseudo labels for target data and treat them as ground…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Xiaoqing Guo , Chen Yang , Baopu Li , Yixuan Yuan

Unsupervised domain adaptation aiming to learn a specific task for one domain using another domain data has emerged to address the labeling issue in supervised learning, especially because it is difficult to obtain massive amounts of…

Machine Learning · Computer Science 2019-03-13 Jaeyoon Yoo , Changhwa Park , Yongjun Hong , Sungroh Yoon

Domain Adaptation (DA) is a highly relevant research topic when it comes to image classification with deep neural networks. Combining multiple source domains in a sophisticated way to optimize a classification model can improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Sebastian Schrom , Stephan Hasler , Jürgen Adamy

Recent advancements in deep learning-based wearable human action recognition (wHAR) have improved the capture and classification of complex motions, but adoption remains limited due to the lack of expert annotations and domain discrepancies…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Indrajeet Ghosh , Garvit Chugh , Abu Zaher Md Faridee , Nirmalya Roy

Unsupervised domain adaptation (UDA) has been successfully applied to transfer knowledge from a labeled source domain to target domains without their labels. Recently introduced transferable prototypical networks (TPN) further addresses…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Fangxu Xing , Jia You , Jun Lu , C. -C. Jay Kuo , Georges El Fakhri , Jonghye Woo

Unsupervised domain adaptation (UDA) aims to transfer knowledge learned from a fully-labeled source domain to a different unlabeled target domain. Most existing UDA methods learn domain-invariant feature representations by minimizing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Rui Wang , Zuxuan Wu , Zejia Weng , Jingjing Chen , Guo-Jun Qi , Yu-Gang Jiang

Many unsupervised domain adaptive (UDA) person re-identification (ReID) approaches combine clustering-based pseudo-label prediction with feature fine-tuning. However, because of domain gap, the pseudo-labels are not always reliable and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Kecheng Zheng , Cuiling Lan , Wenjun Zeng , Zhizheng Zhang , Zheng-Jun Zha

We study the task of unsupervised domain adaptation, where no labeled data from the target domain is provided during training time. To deal with the potential discrepancy between the source and target distributions, both in features and…

Machine Learning · Computer Science 2017-10-03 Cuong D. Tran , Ognjen Rudovic , Vladimir Pavlovic

Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) for semi-supervised semantic segmentation via…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Lihe Yang , Wei Zhuo , Lei Qi , Yinghuan Shi , Yang Gao

Domain Generalization aims to develop models that can generalize to novel and unseen data distributions. In this work, we study how model architectures and pre-training objectives impact feature richness and propose a method to effectively…

Machine Learning · Computer Science 2025-04-30 Xavier Thomas , Deepti Ghadiyaram