English
Related papers

Related papers: Normalization Perturbation: A Simple Domain Genera…

200 papers

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Aristotelis Ballas , Christos Diou

For many practical computer vision applications, the learned models usually have high performance on the datasets used for training but suffer from significant performance degradation when deployed in new environments, where there are…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Xin Jin , Cuiling Lan , Wenjun Zeng , Zhibo Chen

This paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training. Our motivation originates from the recent progresses in deep…

Machine Learning · Computer Science 2022-03-08 Chris Xing Tian , Haoliang Li , Xiaofei Xie , Yang Liu , Shiqi Wang

Driving scene parsing is critical for autonomous vehicles to operate reliably in complex real-world traffic environments. To reduce the reliance on costly pixel-level annotations, synthetic datasets with automatically generated labels have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Jiahe Fan , Xiao Ma , Sergey Vityazev , George Giakos , Shaolong Shu , Rui Fan

Deep neural networks have shown exemplary performance on semantic scene understanding tasks on source domains, but due to the absence of style diversity during training, enhancing performance on unseen target domains using only single…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Sumanth Udupa , Prajwal Gurunath , Aniruddh Sikdar , Suresh Sundaram

Recent studies have proven that DNNs, unlike human vision, tend to exploit texture information rather than shape. Such texture bias is one of the factors for the poor generalization performance of DNNs. We observe that the texture bias…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Hwan Heo , Youngjin Oh , Jaewon Lee , Hyunwoo J. Kim

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

Deep convolutional neural networks are known to be unstable during training at high learning rate unless normalization techniques are employed. Normalizing weights or activations allows the use of higher learning rates, resulting in faster…

Machine Learning · Computer Science 2019-12-02 Brendan Ruff , Taylor Beck , Joscha Bach

Despite being very powerful in standard learning settings, deep learning models can be extremely brittle when deployed in scenarios different from those on which they were trained. Domain generalization methods investigate this problem and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Francesco Cappio Borlino , Antonio D'Innocente , Tatiana Tommasi

We aim for source-free domain adaptation, where the task is to deploy a model pre-trained on source domains to target domains. The challenges stem from the distribution shift from the source to the target domain, coupled with the…

Machine Learning · Computer Science 2022-10-20 Mengmeng Jing , Xiantong Zhen , Jingjing Li , Cees G. M. Snoek

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

Machine Learning · Computer Science 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple…

Machine Learning · Computer Science 2020-07-22 Seonguk Seo , Yumin Suh , Dongwan Kim , Geeho Kim , Jongwoo Han , Bohyung Han

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Ngan Le

Domain generalization (DG) aims to generalize a model trained on multiple source (i.e., training) domains to a distributionally different target (i.e., test) domain. In contrast to the conventional DG that strictly requires the availability…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zijian Wang , Yadan Luo , Ruihong Qiu , Zi Huang , Mahsa Baktashmotlagh

The absence of well-structured large datasets in medical computer vision results in decreased performance of automated systems and, especially, of deep learning models. Domain generalization techniques aim to approach unknown domains from a…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Nikolaos Spanos , Anastasios Arsenos , Paraskevi-Antonia Theofilou , Paraskevi Tzouveli , Athanasios Voulodimos , Stefanos Kollias

Foundation models have achieved remarkable success across diverse machine-learning domains through large-scale pretraining on large, diverse datasets. However, pretraining on such datasets introduces significant challenges due to…

Machine Learning · Computer Science 2025-04-16 Peiliang Gong , Emadeldeen Eldele , Min Wu , Zhenghua Chen , Xiaoli Li , Daoqiang Zhang

The ability to generalize to unseen domains is crucial for machine learning systems deployed in the real world, especially when we only have data from limited training domains. In this paper, we propose a simple and effective regularization…

Machine Learning · Computer Science 2023-12-06 Zhenmei Shi , Yifei Ming , Ying Fan , Frederic Sala , Yingyu Liang