English
Related papers

Related papers: Learning to Learn Single Domain Generalization

200 papers

In this work, we study the problem of learning a single model for multiple domains. Unlike the conventional machine learning scenario where each domain can have the corresponding model, multiple domains (i.e., applications/users) may share…

Machine Learning · Computer Science 2019-05-23 Qi Qian , Shenghuo Zhu , Jiasheng Tang , Rong Jin , Baigui Sun , Hao Li

In the problem of domain generalization (DG), there are labeled training data sets from several related prediction problems, and the goal is to make accurate predictions on future unlabeled data sets that are not known to the learner. This…

Machine Learning · Statistics 2021-01-08 Gilles Blanchard , Aniket Anand Deshmukh , Urun Dogan , Gyemin Lee , Clayton Scott

Out-of-Distribution (OOD) generalization in machine learning is a burgeoning area of study. Its primary goal is to enhance the adaptability and resilience of machine learning models when faced with new, unseen, and potentially adversarial…

Machine Learning · Computer Science 2024-11-05 Chengtao Jian , Kai Yang , Yang Jiao

Adversarial learning methods are a promising approach to training robust deep networks, and can generate complex samples across diverse domains. They also can improve recognition despite the presence of domain shift or dataset bias: several…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Eric Tzeng , Judy Hoffman , Kate Saenko , Trevor Darrell

Domain adaptation is widely used in learning problems lacking labels. Recent studies show that deep adversarial domain adaptation models can make markable improvements in performance, which include symmetric and asymmetric architectures.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Guanyu Cai , Yuqin Wang , Mengchu Zhou , Lianghua He

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

Computation and Language · Computer Science 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari

Domain adaptation aims to generalise a high-performance learner on target domain (non-labelled data) by leveraging the knowledge from source domain (rich labelled data) which comes from a different but related distribution. Assuming the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Jie Su

Machine learning is vulnerable to adversarial examples-inputs designed to cause models to perform poorly. However, it is unclear if adversarial examples represent realistic inputs in the modeled domains. Diverse domains such as networks and…

Cryptography and Security · Computer Science 2021-11-09 Ryan Sheatsley , Blaine Hoak , Eric Pauley , Yohan Beugin , Michael J. Weisman , Patrick McDaniel

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Numerous algorithms have been proposed for transferring knowledge from a label-rich domain (source) to a label-scarce domain (target). Almost all of them are proposed for a closed-set scenario, where the source and the target domain…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Kuniaki Saito , Shohei Yamamoto , Yoshitaka Ushiku , Tatsuya Harada

A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Given data from diverse sets of distinct distributions, domain generalization aims to learn models that generalize to unseen distributions. A common approach is designing a data-driven surrogate penalty to capture generalization and…

Machine Learning · Computer Science 2023-08-31 Ozan Sener , Vladlen Koltun

Standard supervised learning setting assumes that training data and test data come from the same distribution (domain). Domain generalization (DG) methods try to learn a model that when trained on data from multiple domains, would…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Udit Maniyar , Joseph K J , Aniket Anand Deshmukh , Urun Dogan , Vineeth N Balasubramanian

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Existing adversarial domain adaptation methods mainly consider the marginal distribution and these methods may lead to either under transfer or negative transfer. To address this problem, we present a self-adaptive re-weighted adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Shanshan Wang , Lei Zhang

Traditional place categorization approaches in robot vision assume that training and test images have similar visual appearance. Therefore, any seasonal, illumination and environmental changes typically lead to severe degradation in…

Robotics · Computer Science 2018-05-31 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Domain generalization (DG) is a fundamental yet very challenging research topic in machine learning. The existing arts mainly focus on learning domain-invariant features with limited source domains in a static model. Unfortunately, there is…

Machine Learning · Computer Science 2022-05-30 Zhishu Sun , Zhifeng Shen , Luojun Lin , Yuanlong Yu , Zhifeng Yang , Shicai Yang , Weijie Chen

Domain adaptation aims at improving model performance by leveraging the learned knowledge in the source domain and transferring it to the target domain. Recently, domain adversarial methods have been particularly successful in alleviating…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Qin Wang , Gabriel Michau , Olga Fink

Although Deep Neural Networks(DNNs) have achieved successful applications in many fields, they are vulnerable to adversarial examples.Adversarial training is one of the most effective methods to improve the robustness of DNNs, and it is…

Machine Learning · Computer Science 2020-03-26 Ya-guan Qian , Xi-Ming Zhang , Wassim Swaileh , Li Wei , Bin Wang , Jian-Hai Chen , Wu-Jie Zhou , Jing-Sheng Lei

This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang