English
Related papers

Related papers: Representation via Representations: Domain General…

200 papers

Domain generalization is a critical challenge for machine learning systems. Prior domain generalization methods focus on extracting domain-invariant features across several stationary domains to enable generalization to new domains.…

Machine Learning · Computer Science 2024-01-17 Binghui Xie , Yongqiang Chen , Jiaqi Wang , Kaiwen Zhou , Bo Han , Wei Meng , James Cheng

In reinforcement learning, state representations are used to tractably deal with large problem spaces. State representations serve both to approximate the value function with few parameters, but also to generalize to newly encountered…

Machine Learning · Computer Science 2022-03-02 Charline Le Lan , Stephen Tu , Adam Oberman , Rishabh Agarwal , Marc G. Bellemare

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Training models that are robust to data domain shift has gained an increasing interest both in academia and industry. Question-Answering language models, being one of the typical problem in Natural Language Processing (NLP) research, has…

Computation and Language · Computer Science 2022-06-27 Shubham Shrivastava , Kaiyue Wang

This paper offers a new perspective to ease the challenge of domain generalization, which involves maintaining robust results even in unseen environments. Our design focuses on the decision-making process in the final classifier layer.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Liang Chen , Yong Zhang , Yibing Song , Anton van den Hengel , Lingqiao Liu

The objective of domain generalization (DG) is to enable models to be robust against domain shift. DG is crucial for deploying vision-language models (VLMs) in real-world applications, yet most existing methods rely on domain labels that…

Machine Learning · Computer Science 2026-02-02 Zhixing Li , Arsham Gholamzadeh Khoee , Yinan Yu

One method for obtaining generalizable solutions to machine learning tasks when presented with diverse training environments is to find \textit{invariant representations} of the data. These are representations of the covariates such that…

Machine Learning · Computer Science 2022-08-16 Advait Parulekar , Karthikeyan Shanmugam , Sanjay Shakkottai

In this paper, we propose a novel framework to analyze the theoretical properties of the learning process for a representative type of domain adaptation, which combines data from multiple sources and one target (or briefly called…

Machine Learning · Computer Science 2014-01-03 Chao Zhang , Lei Zhang , Wei Fan , Jieping Ye

We propose a novel domain generalization technique, referred to as Randomized Adversarial Style Perturbation (RASP), which is motivated by the observation that the characteristics of each domain are captured by the feature statistics…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Taehoon Kim , Bohyung Han

We are concerned with learning models that generalize well to different \emph{unseen} domains. We consider a worst-case formulation over data distributions that are near the source domain in the feature space. Only using training data from…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Riccardo Volpi , Hongseok Namkoong , Ozan Sener , John Duchi , Vittorio Murino , Silvio Savarese

Domain generalization aims to enhance the model robustness against domain shift without accessing the target domain. Since the available source domains for training are limited, recent approaches focus on generating samples of novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Seogkyu Jeon , Kibeom Hong , Pilhyeon Lee , Jewook Lee , Hyeran Byun

Producing agents that can generalize to a wide range of visually different environments is a significant challenge in reinforcement learning. One method for overcoming this issue is visual domain randomization, whereby at the start of each…

Machine Learning · Computer Science 2020-03-09 Reda Bahi Slaoui , William R. Clements , Jakob N. Foerster , Sébastien Toth

Modern machine learning (ML) models are becoming increasingly popular and are widely used in decision-making systems. However, studies have shown critical issues of ML discrimination and unfairness, which hinder their adoption on high-stake…

Machine Learning · Computer Science 2023-06-01 Yueqing Liang , Canyu Chen , Tian Tian , Kai Shu

Recent studies show that deep neural networks are vulnerable to adversarial examples which can be generated via certain types of transformations. Being robust to a desired family of adversarial attacks is then equivalent to being invariant…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Jiawei Chen , Janusz Konrad , Prakash Ishwar

We investigate adversarial learning in the case when only an unnormalized form of the density can be accessed, rather than samples. With insights so garnered, adversarial learning is extended to the case for which one has access to an…

Machine Learning · Computer Science 2019-01-04 Chunyuan Li , Ke Bai , Jianqiao Li , Guoyin Wang , Changyou Chen , Lawrence Carin

Researchers have been facing a difficult problem that data generation mechanisms could be influenced by internal or external factors leading to the training and test data with quite different distributions, consequently traditional…

Machine Learning · Statistics 2021-10-14 Anqi Wu

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Representation learning is increasingly applied to generate representations that generalize well across multiple downstream tasks. Ensuring fairness guarantees in representation learning is crucial to prevent unfairness toward specific…

Machine Learning · Computer Science 2025-10-27 Yuhong Luo , Austin Hoag , Xintong Wang , Philip S. Thomas , Przemyslaw A. Grabowicz

The major challenge in today's computer vision scenario is the availability of good quality labeled data. In a field of study like image classification, where data is of utmost importance, we need to find more reliable methods which can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Aashish Dhawan , Divyanshu Mudgal

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning, which matches and aligns the data distributions on the…

Information Retrieval · Computer Science 2023-11-01 Ruicheng Xian , Honglei Zhuang , Zhen Qin , Hamed Zamani , Jing Lu , Ji Ma , Kai Hui , Han Zhao , Xuanhui Wang , Michael Bendersky