中文
相关论文

相关论文: Out-of-Domain Robustness via Targeted Augmentation…

200 篇论文

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

机器学习 · 计算机科学 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

The mismatch between training and target data is one major challenge for current machine learning systems. When training data is collected from multiple domains and the target domains include all training domains and other new domains, we…

机器学习 · 计算机科学 2021-01-22 Haotian Ye , Chuanlong Xie , Yue Liu , Zhenguo Li

We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose Meta-Learning based…

计算机视觉与模式识别 · 计算机科学 2022-06-17 Xi Peng , Fengchun Qiao , Long Zhao

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

机器学习 · 计算机科学 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Since real-world training datasets cannot properly sample the long tail of the underlying data distribution, corner cases and rare out-of-domain samples can severely hinder the performance of state-of-the-art models. This problem becomes…

计算机视觉与模式识别 · 计算机科学 2023-10-19 Alexander Lehner , Stefano Gasperini , Alvaro Marcos-Ramiro , Michael Schmidt , Nassir Navab , Benjamin Busam , Federico Tombari

Prior work typically describes out-of-domain (OOD) or out-of-distribution (OODist) samples as those that originate from dataset(s) or source(s) different from the training set but for the same task. When compared to in-domain (ID) samples,…

计算与语言 · 计算机科学 2023-06-05 Rhitabrat Pokharel , Ameeta Agrawal

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao

Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a…

计算机视觉与模式识别 · 计算机科学 2023-03-09 Qiuhao Zeng , Wei Wang , Fan Zhou , Charles Ling , Boyu Wang

Recent advances on large-scale pre-training have shown great potentials of leveraging a large set of Pre-Trained Models (PTMs) for improving Out-of-Distribution (OoD) generalization, for which the goal is to perform well on possible unseen…

机器学习 · 计算机科学 2022-10-18 Qishi Dong , Awais Muhammad , Fengwei Zhou , Chuanlong Xie , Tianyang Hu , Yongxin Yang , Sung-Ho Bae , Zhenguo Li

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

机器学习 · 计算机科学 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

Developing and deploying machine learning models safely depends on the ability to characterize and compare their abilities to generalize to new environments. Although recent work has proposed a variety of methods that can directly predict…

机器学习 · 计算机科学 2023-07-18 Nathan Ng , Neha Hulkund , Kyunghyun Cho , Marzyeh Ghassemi

Generalizing deep learning models to unknown target domain distribution with low latency has motivated research into test-time training/adaptation (TTT/TTA). Existing approaches often focus on improving test-time training performance under…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Yushu Li , Xun Xu , Yongyi Su , Kui Jia

Deep learning models can perform well when evaluated on images from the same distribution as the training set. However, applying small perturbations in the forms of noise, artifacts, occlusions, blurring, etc. to a model's input image and…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Zahra Golpayegani , Patrick St-Amant , Nizar Bouguila

Conversational agents are usually designed for closed-world environments. Unfortunately, users can behave unexpectedly. Based on the open-world environment, we often encounter the situation that the training and test data are sampled from…

计算与语言 · 计算机科学 2022-04-25 Petr Lorenc , Tommaso Gargiani , Jan Pichl , Jakub Konrád , Petr Marek , Ondřej Kobza , Jan Šedivý

We introduce four new real-world distribution shift datasets consisting of changes in image style, image blurriness, geographic location, camera operation, and more. With our new datasets, we take stock of previously proposed methods for…

Domain generalization (DG) task aims to learn a robust model from source domains that could handle the out-of-distribution (OOD) issue. In order to improve the generalization ability of the model in unseen domains, increasing the diversity…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Shanshan Wang , ALuSi , Xun Yang , Ke Xu , Huibin Tan , Xingyi Zhang

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

机器学习 · 统计学 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

In real-world applications, it is important and desirable to learn a model that performs well on out-of-distribution (OOD) data. Recently, causality has become a powerful tool to tackle the OOD generalization problem, with the idea resting…

机器学习 · 统计学 2022-03-25 Ruoyu Wang , Mingyang Yi , Zhitang Chen , Shengyu Zhu

Domain adaptation aims to transfer knowledge of labeled instances obtained from a source domain to a target domain to fill the gap between the domains. Most domain adaptation methods assume that the source and target domains have the same…

机器学习 · 计算机科学 2022-09-13 Toshimitsu Aritake , Hideitsu Hino

Despite being very powerful in standard learning settings, deep learning models can be extremely brittle when deployed in scenarios different from those on which they were trained. Domain generalization methods investigate this problem and…

计算机视觉与模式识别 · 计算机科学 2021-01-28 Francesco Cappio Borlino , Antonio D'Innocente , Tatiana Tommasi