English
Related papers

Related papers: When Distributions Shifts: Causal Generalization f…

200 papers

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Recognizing the prevalence of domain shift as a common challenge in machine learning, various domain generalization (DG) techniques have been developed to enhance the performance of machine learning systems when dealing with…

Machine Learning · Computer Science 2024-05-07 Yujie Lin , Chen Zhao , Minglai Shao , Baoluo Meng , Xujiang Zhao , Haifeng Chen

We study few-shot supervised domain adaptation (DA) for regression problems, where only a few labeled target domain data and many labeled source domain data are available. Many of the current DA methods base their transfer assumptions on…

Machine Learning · Computer Science 2020-08-20 Takeshi Teshima , Issei Sato , Masashi Sugiyama

The task of learning a sentiment classification model that adapts well to any target domain, different from the source domain, is a challenging problem. Majority of the existing approaches focus on learning a common representation by…

Machine Learning · Computer Science 2019-12-05 Pratik Kayal , Mayank Singh , Pawan Goyal

The phenomenon of distribution shift (DS) occurs when a dataset at test time differs from the dataset at training time, which can significantly impair the performance of a machine learning model in practical settings due to a lack of…

Deep neural networks and huge language models are becoming omnipresent in natural language applications. As they are known for requiring large amounts of training data, there is a growing body of work to improve the performance in…

Computation and Language · Computer Science 2021-04-12 Michael A. Hedderich , Lukas Lange , Heike Adel , Jannik Strötgen , Dietrich Klakow

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Aristotelis Ballas , Christos Diou

Generating large-scale synthetic data in simulation is a feasible alternative to collecting/labelling real data for training vision-based deep learning models, albeit the modelling inaccuracies do not generalize to the physical world. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Ajay Kumar Tanwani

Domain generalization (DG) strives to address distribution shifts across diverse environments to enhance model's generalizability. Current DG approaches are confined to acquiring robust representations with continuous features, specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shaocong Long , Qianyu Zhou , Xikun Jiang , Chenhao Ying , Lizhuang Ma , Yuan Luo

Causal representation learning has emerged as the center of action in causal machine learning research. In particular, multi-domain datasets present a natural opportunity for showcasing the advantages of causal representation learning over…

Machine Learning · Computer Science 2023-12-12 Kartik Ahuja , Amin Mansouri , Yixin Wang

Domain adaption has been widely adapted for cross-domain sentiment analysis to transfer knowledge from the source domain to the target domain. Whereas, most methods are proposed under the assumption that the target (test) domain is known,…

Computation and Language · Computer Science 2024-02-23 Siyin Wang , Jie Zhou , Qin Chen , Qi Zhang , Tao Gui , Xuanjing Huang

A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Multi-source unsupervised domain adaptation aims to leverage labeled data from multiple source domains for training a machine learning model to generalize well on a target domain without labels. Source domain selection plays a crucial role…

Machine Learning · Computer Science 2024-11-12 Yao Ma , Samuel Louvan , Zhunxuan Wang

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Cross-domain sentiment analysis is currently a hot topic in the research and engineering areas. One of the most popular frameworks in this field is the domain-invariant representation learning (DIRL) paradigm, which aims to learn a…

Machine Learning · Computer Science 2019-09-19 Minlong Peng , Qi Zhang , Xuanjing Huang

An important goal common to domain adaptation and causal inference is to make accurate predictions when the distributions for the source (or training) domain(s) and target (or test) domain(s) differ. In many cases, these different…

Machine Learning · Computer Science 2022-08-31 Sara Magliacane , Thijs van Ommen , Tom Claassen , Stephan Bongers , Philip Versteeg , Joris M. Mooij

Sentiment analysis is a task that may suffer from a lack of data in certain cases, as the datasets are often generated and annotated by humans. In cases where data is inadequate for training discriminative models, generate models may aid…

Machine Learning · Computer Science 2019-02-20 Rahul Gupta

Training a deep learning model with artificially generated data can be an alternative when training data are scarce, yet it suffers from poor generalization performance due to a large domain gap. In this paper, we characterize the domain…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Gilhyun Nam , Gyeongjae Choi , Kyungmin Lee

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

Machine Learning · Computer Science 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He