English
Related papers

Related papers: Unsupervised Domain Adaptation with Feature Embedd…

200 papers

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

Computation and Language · Computer Science 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Domain alignment is currently the most prevalent solution to unsupervised domain-adaptation tasks and are often being presented as minimizers of some theoretical upper-bounds on risk in the target domain. However, further works revealed…

Machine Learning · Computer Science 2021-09-17 Rodrigue Siry , Louis Hémadou , Loïc Simon , Frédéric Jurie

Domain shift poses a fundamental challenge in time series analysis, where models trained on source domain often fail dramatically when applied in target domain with different yet similar distributions. While current unsupervised domain…

Machine Learning · Computer Science 2025-08-07 Rongyao Cai , Ming Jin , Qingsong Wen , Kexin Zhang

Unsupervised domain adaptation is effective in leveraging rich information from a labeled source domain to an unlabeled target domain. Though deep learning and adversarial strategy made a significant breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-08-25 You-Wei Luo , Chuan-Xian Ren , Dao-Qing Dai , Hong Yan

A classifier trained on a dataset seldom works on other datasets obtained under different conditions due to domain shift. This problem is commonly addressed by domain adaptation methods. In this work we introduce a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Subhankar Roy , Aliaksandr Siarohin , Enver Sangineto , Samuel Rota Bulo , Nicu Sebe , Elisa Ricci

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

Transfer Learning is concerned with the application of knowledge gained from solving a problem to a different but related problem domain. In this paper, we propose a method and efficient algorithm for ranking and selecting representations…

Machine Learning · Computer Science 2014-05-29 Son N. Tran , Artur d'Avila Garcez

Domain adaption (DA) allows machine learning methods trained on data sampled from one distribution to be applied to data sampled from another. It is thus of great practical importance to the application of such methods. Despite the fact…

Computer Vision and Pattern Recognition · Computer Science 2017-07-20 Hao Lu , Lei Zhang , Zhiguo Cao , Wei Wei , Ke Xian , Chunhua Shen , Anton van den Hengel

Successful unsupervised domain adaptation is guaranteed only under strong assumptions such as covariate shift and overlap between input domains. The latter is often violated in high-dimensional applications like image classification which,…

Machine Learning · Computer Science 2024-06-13 Adam Breitholtz , Anton Matsson , Fredrik D. Johansson

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain-invariant features to decrease the discrepancy between the feature distributions…

Machine Learning · Computer Science 2021-06-30 Yuntao Du , Yinghao Chen , Fengli Cui , Xiaowen Zhang , Chongjun Wang

Deep neural networks have gained tremendous success in a broad range of machine learning tasks due to its remarkable capability to learn semantic-rich features from high-dimensional data. However, they often require large-scale labelled…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hu Wang , Guansong Pang , Chunhua Shen , Congbo Ma

Unsupervised word embeddings have become a popular approach of word representation in NLP tasks. However there are limitations to the semantics represented by unsupervised embeddings, and inadequate fine-tuning of embeddings can lead to…

Computation and Language · Computer Science 2019-06-10 Xiao Zhang , Ji Wu , Dejing Dou

Domain adaptation deals with adapting classifiers trained on data from a source distribution, to work effectively on data from a target distribution. In this paper, we introduce the Nonlinear Embedding Transform (NET) for unsupervised…

Artificial Intelligence · Computer Science 2017-06-26 Hemanth Venkateswara , Shayok Chakraborty , Troy McDaniel , Sethuraman Panchanathan

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

Machine Learning · Computer Science 2022-09-30 Mohammad Rostami

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Unsupervised domain adaptation aims at learning a shared model for two related, but not identical, domains by leveraging supervision from a source domain to an unsupervised target domain. A number of effective domain adaptation approaches…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Jinming Cao , Oren Katzir , Peng Jiang , Dani Lischinski , Danny Cohen-Or , Changhe Tu , Yangyan Li

It is known that, without awareness of the process, our brain appears to focus on the general shape of objects rather than superficial statistics of context. On the other hand, learning autonomously allows discovering invariant regularities…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Nader Asadi , Amir M. Sarfi , Mehrdad Hosseinzadeh , Zahra Karimpour , Mahdi Eftekhari

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning, which matches and aligns the data distributions on the…

Information Retrieval · Computer Science 2023-11-01 Ruicheng Xian , Honglei Zhuang , Zhen Qin , Hamed Zamani , Jing Lu , Ji Ma , Kai Hui , Han Zhao , Xuanhui Wang , Michael Bendersky