English
Related papers

Related papers: Domain Adaptation for Statistical Classifiers

200 papers

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

Domain adaptation (DA) is an important and emerging field of machine learning that tackles the problem occurring when the distributions of training (source domain) and test (target domain) data are similar but different. Current theoretical…

Machine Learning · Statistics 2017-08-01 Ievgen Redko , Amaury Habrard , Marc Sebban

Deep Learning heavily depends on large labeled datasets which limits further improvements. While unlabeled data is available in large amounts, in particular in image recognition, it does not fulfill the closed world assumption of…

Machine Learning · Computer Science 2020-12-24 Maximilian Augustin , Matthias Hein

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

This paper deals with the unsupervised domain adaptation problem, where one wants to estimate a prediction function $f$ in a given target domain without any labeled sample by exploiting the knowledge available from a source domain where…

Machine Learning · Statistics 2017-10-24 Nicolas Courty , Rémi Flamary , Amaury Habrard , Alain Rakotomamonjy

Domain adaptation is important in sentiment analysis as sentiment-indicating words vary between domains. Recently, multi-domain adaptation has become more pervasive, but existing approaches train on all available source domains including…

Computation and Language · Computer Science 2017-02-09 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Self-training crowd counting has not been attentively explored though it is one of the important challenges in computer vision. In practice, the fully supervised methods usually require an intensive resource of manual annotation. In order…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Pha Nguyen , Thanh-Dat Truong , Miaoqing Huang , Yi Liang , Ngan Le , Khoa Luu

Unsupervised domain adaptation studies how to transfer a learner from a labeled source domain to an unlabeled target domain with different distributions. Existing methods mainly focus on matching the marginal distributions of the source and…

Machine Learning · Computer Science 2022-03-08 Yi-Ming Zhai , You-Wei Luo

Domain adaptation (DA) is a technique that transfers predictive models trained on a labeled source domain to an unlabeled target domain, with the core difficulty of resolving distributional shift between domains. Currently, most popular DA…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Bo Li , Yezhen Wang , Tong Che , Shanghang Zhang , Sicheng Zhao , Pengfei Xu , Wei Zhou , Yoshua Bengio , Kurt Keutzer

We consider the cross-domain sentiment classification problem, where a sentiment classifier is to be learned from a source domain and to be generalized to a target domain. Our approach explicitly minimizes the distance between the source…

Computation and Language · Computer Science 2018-09-05 Ruidan He , Wee Sun Lee , Hwee Tou Ng , Daniel Dahlmeier

Natural language processing (NLP) algorithms are rapidly improving but often struggle when applied to out-of-distribution examples. A prominent approach to mitigate the domain gap is domain adaptation, where a model trained on a source…

Computation and Language · Computer Science 2022-09-05 Eyal Ben-David , Yftah Ziser , Roi Reichart

Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two…

Machine Learning · Computer Science 2019-11-20 Qian Wang , Toby P. Breckon

The empirical fact that classifiers, trained on given data collections, perform poorly when tested on data acquired in different settings is theoretically explained in domain adaptation through a shift among distributions of the source and…

Computer Vision and Pattern Recognition · Computer Science 2017-04-28 Fabio Maria Carlucci , Lorenzo Porzi , Barbara Caputo , Elisa Ricci , Samuel Rota Bulò

Traditional machine learning algorithms assume that the training and test data have the same distribution, while this assumption does not necessarily hold in real applications. Domain adaptation methods take into account the deviations in…

Machine Learning · Statistics 2019-02-26 Elif Vural

The notion of "in-domain data" in NLP is often over-simplistic and vague, as textual data varies in many nuanced linguistic aspects such as topic, style or level of formality. In addition, domain labels are many times unavailable, making it…

Computation and Language · Computer Science 2020-05-04 Roee Aharoni , Yoav Goldberg

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Supervised learning results typically rely on assumptions of i.i.d. data. Unfortunately, those assumptions are commonly violated in practice. In this work, we tackle such problem by focusing on domain generalization: a formalization where…

Machine Learning · Computer Science 2024-10-30 Isabela Albuquerque , João Monteiro , Mohammad Darvishi , Tiago H. Falk , Ioannis Mitliagkas

Methods of transfer learning try to combine knowledge from several related tasks (or domains) to improve performance on a test task. Inspired by causal methodology, we relax the usual covariate shift assumption and assume that it holds true…

Machine Learning · Statistics 2018-09-25 Mateo Rojas-Carulla , Bernhard Schölkopf , Richard Turner , Jonas Peters

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

The generalization power of deep-learning models is dependent on rich-labelled data. This supervision using large-scaled annotated information is restrictive in most real-world scenarios where data collection and their annotation involve…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Sandipan Choudhuri , Riti Paul , Arunabha Sen , Baoxin Li , Hemanth Venkateswara