中文
相关论文

相关论文: Reappraising Domain Generalization in Neural Netwo…

200 篇论文

Domain Generalization (DG) research has gained considerable traction as of late, since the ability to generalize to unseen data distributions is a requirement that eludes even state-of-the-art training algorithms. In this paper we observe…

机器学习 · 计算机科学 2025-07-22 Aristotelis Ballas , Christos Diou

Learning robust vision models that perform well in out-of-distribution (OOD) situations is an important task for model deployment in real-world settings. Despite extensive research in this field, many proposed methods have only shown minor…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Gyuseong Lee , Wooseok Jang , Jinhyeon Kim , Jaewoo Jung , Seungryong Kim

The goal of domain generalization algorithms is to predict well on distributions different from those seen during training. While a myriad of domain generalization algorithms exist, inconsistencies in experimental conditions -- datasets,…

机器学习 · 计算机科学 2020-07-06 Ishaan Gulrajani , David Lopez-Paz

Various normalization layers have been proposed to help the training of neural networks. Group Normalization (GN) is one of the effective and attractive studies that achieved significant performances in the visual recognition task. Despite…

计算机视觉与模式识别 · 计算机科学 2022-07-06 Agus Gunawan , Xu Yin , Kang Zhang

Improving the generalization ability of Deep Neural Networks (DNNs) is critical for their practical uses, which has been a longstanding challenge. Some theoretical studies have uncovered that DNNs have preferences for some frequency…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Shiqi Lin , Zhizheng Zhang , Zhipeng Huang , Yan Lu , Cuiling Lan , Peng Chu , Quanzeng You , Jiang Wang , Zicheng Liu , Amey Parulkar , Viraj Navkal , Zhibo Chen

Domain generalization (DG) aims at learning a model on source domains to well generalize on the unseen target domain. Although it has achieved great success, most of existing methods require the label information for all training samples in…

计算机视觉与模式识别 · 计算机科学 2024-04-30 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

Distributional shift between domains poses great challenges to modern machine learning algorithms. The domain generalization (DG) signifies a popular line targeting this issue, where these methods intend to uncover universal patterns across…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Hao Chen , Qi Zhang , Zenan Huang , Haobo Wang , Junbo Zhao

Domain generalization (DG) methods aim to develop models that generalize to settings where the test distribution is different from the training data. In this paper, we focus on the challenging problem of multi-source zero shot DG (MDG),…

机器学习 · 计算机科学 2022-11-07 Kowshik Thopalli , Sameeksha Katoch , Pavan Turaga , Jayaraman J. Thiagarajan

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

机器学习 · 计算机科学 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

Enhancing the domain generalization performance of Face Anti-Spoofing (FAS) techniques has emerged as a research focus. Existing methods are dedicated to extracting domain-invariant features from various training domains. Despite the…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Lianrui Mu , Jianhong Bai , Xiaoxuan He , Jiangnan Ye , Xiaoyu Liang , Yuchen Yang , Jiedong Zhuang , Haoji Hu

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

Domain generalization (DG) deals with the problem of domain shift where a machine learning model trained on multiple-source domains fail to generalize well on a target domain with different statistics. Multiple approaches have been proposed…

计算机视觉与模式识别 · 计算机科学 2020-07-29 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Most statistical learning algorithms rely on an over-simplified assumption, that is, the train and test data are independent and identically distributed. In real-world scenarios, however, it is common for models to encounter data from new…

图像与视频处理 · 电气工程与系统科学 2023-04-07 Zheyuan Zhang , Bin Wang , Lanhong Yao , Ugur Demir , Debesh Jha , Ismail Baris Turkbey , Boqing Gong , Ulas Bagci

Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained…

图像与视频处理 · 电气工程与系统科学 2023-12-14 Hongyi Pan , Bin Wang , Zheyuan Zhang , Xin Zhu , Debesh Jha , Ahmet Enis Cetin , Concetto Spampinato , Ulas Bagci

Deep neural networks achieve stellar generalisation on a variety of problems, despite often being large enough to easily fit all their training data. Here we study the generalisation dynamics of two-layer neural networks in a…

机器学习 · 统计学 2019-06-21 Sebastian Goldt , Madhu S. Advani , Andrew M. Saxe , Florent Krzakala , Lenka Zdeborová

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

We address the fundamental question of why deep neural networks generalize by establishing a pointwise generalization theory for fully connected networks. This framework resolves long-standing barriers to characterizing the rich nonlinear…

机器学习 · 计算机科学 2026-05-19 Shaojie Li , Yunbei Xu

Domain Generalization (DG) studies the capability of a deep learning model to generalize to out-of-training distributions. In the last decade, literature has been massively filled with training methodologies that claim to obtain more…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Simone Angarano , Mauro Martini , Francesco Salvetti , Vittorio Mazzia , Marcello Chiaberge

There are ubiquitous distribution shifts in the real world. However, deep neural networks (DNNs) are easily biased towards the training set, which causes severe performance degradation when they receive out-of-distribution data. Many…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Jiao Zhang , Xu-Yao Zhang , Cheng-Lin Liu

Out-of-distribution (OOD) generalization is a favorable yet challenging property for deep neural networks. The core challenges lie in the limited availability of source domains that help models learn an invariant representation from the…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yijiang Li , Sucheng Ren , Weipeng Deng , Yuzhi Xu , Ying Gao , Edith Ngai , Haohan Wang