中文
相关论文

相关论文: Domain Generalization by Rejecting Extreme Augment…

200 篇论文

Data augmentation is a dominant method for reducing model overfitting and improving generalization. Most existing data augmentation methods tend to find a compromise in augmenting the data, \textit{i.e.}, increasing the amplitude of…

计算机视觉与模式识别 · 计算机科学 2023-10-17 Zehao Wang , Yiwen Guo , Qizhang Li , Guanglei Yang , Wangmeng Zuo

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

机器学习 · 统计学 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

Data augmentation is often used to enlarge datasets with synthetic samples generated in accordance with the underlying data distribution. To enable a wider range of augmentations, we explore negative data augmentation strategies (NDA)that…

计算机视觉与模式识别 · 计算机科学 2021-02-11 Abhishek Sinha , Kumar Ayush , Jiaming Song , Burak Uzkent , Hongxia Jin , Stefano Ermon

Deep reinforcement learning (RL) agents often fail to generalize to unseen scenarios, even when they are trained on many instances of semantically similar environments. Data augmentation has recently been shown to improve the sample…

机器学习 · 计算机科学 2021-02-23 Roberta Raileanu , Max Goldstein , Denis Yarats , Ilya Kostrikov , Rob Fergus

Contrary to most machine learning models, modern deep artificial neural networks typically include multiple components that contribute to regularization. Despite the fact that some (explicit) regularization techniques, such as weight decay…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Alex Hernández-García , Peter König

We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose Meta-Learning based…

计算机视觉与模式识别 · 计算机科学 2022-06-17 Xi Peng , Fengchun Qiao , Long Zhao

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

机器学习 · 计算机科学 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

Data augmentation is essential to achieve state-of-the-art performance in many deep learning applications. However, the most effective augmentation techniques become computationally prohibitive for even medium-sized datasets. To address…

机器学习 · 计算机科学 2023-07-21 Tian Yu Liu , Baharan Mirzasoleiman

Domain generalization aims to develop models that are robust to distribution shifts. Existing methods focus on learning invariance across domains to enhance model robustness, and data augmentation has been widely used to learn invariant…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Yingnan Liu , Yingtian Zou , Rui Qiao , Fusheng Liu , Mong Li Lee , Wynne Hsu

Domain generalization (DG) is a fundamental yet very challenging research topic in machine learning. The existing arts mainly focus on learning domain-invariant features with limited source domains in a static model. Unfortunately, there is…

机器学习 · 计算机科学 2022-05-30 Zhishu Sun , Zhifeng Shen , Luojun Lin , Yuanlong Yu , Zhifeng Yang , Shicai Yang , Weijie Chen

Optimization of image transformation functions for the purpose of data augmentation has been intensively studied. In particular, adversarial data augmentation strategies, which search augmentation maximizing task loss, show significant…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Teppei Suzuki

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

机器学习 · 计算机科学 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including…

计算机视觉与模式识别 · 计算机科学 2019-06-13 Ling Zhang , Xiaosong Wang , Dong Yang , Thomas Sanford , Stephanie Harmon , Baris Turkbey , Holger Roth , Andriy Myronenko , Daguang Xu , Ziyue Xu

Data augmentation has proved extremely useful by increasing training data variance to alleviate overfitting and improve deep neural networks' generalization performance. In medical image analysis, a well-designed augmentation policy usually…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Yunhe Gao , Zhiqiang Tang , Mu Zhou , Dimitris Metaxas

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

机器学习 · 统计学 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani

Data modification, either via additional training datasets, data augmentation, debiasing, and dataset filtering, has been proposed as an effective solution for generalizing to out-of-domain (OOD) inputs, in both natural language processing…

计算与语言 · 计算机科学 2022-03-16 Tejas Gokhale , Swaroop Mishra , Man Luo , Bhavdeep Singh Sachdeva , Chitta Baral

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

机器学习 · 统计学 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Random data augmentation is a critical technique to avoid overfitting in training deep neural network models. However, data augmentation and network training are usually treated as two isolated processes, limiting the effectiveness of…

计算机视觉与模式识别 · 计算机科学 2018-05-25 Xi Peng , Zhiqiang Tang , Fei Yang , Rogerio Feris , Dimitris Metaxas

Given data from diverse sets of distinct distributions, domain generalization aims to learn models that generalize to unseen distributions. A common approach is designing a data-driven surrogate penalty to capture generalization and…

机器学习 · 计算机科学 2023-08-31 Ozan Sener , Vladlen Koltun

In general, an experimental environment for deep learning assumes that the training and the test dataset are sampled from the same distribution. However, in real-world situations, a difference in the distribution between two datasets,…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Daehee Kim , Seunghyun Park , Jinkyu Kim , Jaekoo Lee