English
Related papers

Related papers: Normalization Perturbation: A Simple Domain Genera…

200 papers

Graph transformation that predicts graph transition from one mode to another is an important and common problem. Despite much progress in developing advanced graph transformation techniques in recent years, the fundamental assumption…

Machine Learning · Computer Science 2023-05-25 Shiyu Wang , Guangji Bai , Qingyang Zhu , Zhaohui Qin , Liang Zhao

Data-driven depth estimation methods struggle with the generalization outside their training scenes due to the immense variability of the real-world scenes. This problem can be partially addressed by utilising synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Maxim Maximov , Kevin Galim , Laura Leal-Taixé

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Deep neural networks rely heavily on normalization methods to improve their performance and learning behavior. Although normalization methods spurred the development of increasingly deep and efficient architectures, they also increase the…

Machine Learning · Computer Science 2021-10-06 Alexander Fuchs , Christian Knoll , Franz Pernkopf

Practical learning-based autonomous driving models must be capable of generalizing learned behaviors from simulated to real domains, and from training data to unseen domains with unusual image properties. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Shivam Akhauri , Laura Zheng , Tom Goldstein , Ming Lin

We introduce style augmentation, a new form of data augmentation based on random style transfer, for improving the robustness of convolutional neural networks (CNN) over both classification and regression based tasks. During training, our…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Philip T. Jackson , Amir Atapour-Abarghouei , Stephen Bonner , Toby Breckon , Boguslaw Obara

Training a deep neural network with a small amount of data is a challenging problem as it is vulnerable to overfitting. However, one of the practical difficulties that we often face is to collect many samples. Transfer learning is a…

Machine Learning · Computer Science 2020-07-13 Yunho Jeon , Yongseok Choi , Jaesun Park , Subin Yi , Dongyeon Cho , Jiwon Kim

Domain shift widely exists in the visual world, while modern deep neural networks commonly suffer from severe performance degradation under domain shift due to the poor generalization ability, which limits the real-world applications. The…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yuyang Zhao , Zhun Zhong , Na Zhao , Nicu Sebe , Gim Hee Lee

Despite the recent success of stereo matching with convolutional neural networks (CNNs), it remains arduous to generalize a pre-trained deep stereo model to a novel domain. A major difficulty is to collect accurate ground-truth disparities…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Jiahao Pang , Wenxiu Sun , Chengxi Yang , Jimmy Ren , Ruichao Xiao , Jin Zeng , Liang Lin

Domain Generalization techniques aim to enhance model robustness by simulating novel data distributions during training, typically through various augmentation or stylization strategies. However, these methods frequently suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Gustavo Adolfo Vargas Hakim , David Osowiechi , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

A popular method to reduce the training time of deep neural networks is to normalize activations at each layer. Although various normalization schemes have been proposed, they all follow a common theme: normalize across spatial dimensions…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Boyi Li , Felix Wu , Kilian Q. Weinberger , Serge Belongie

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

Deep neural networks (DNN) have shown unprecedented success in various computer vision applications such as image classification and object detection. However, it is still a common annoyance during the training phase, that one has to…

Computer Vision and Pattern Recognition · Computer Science 2016-11-09 Yanghao Li , Naiyan Wang , Jianping Shi , Jiaying Liu , Xiaodi Hou

Bridging the 'reality gap' that separates simulated robotics from experiments on hardware could accelerate robotic research through improved data availability. This paper explores domain randomization, a simple technique for training models…

Robotics · Computer Science 2017-03-22 Josh Tobin , Rachel Fong , Alex Ray , Jonas Schneider , Wojciech Zaremba , Pieter Abbeel

Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Qiuhao Zeng , Wei Wang , Fan Zhou , Charles Ling , Boyu Wang

Although learning-based image restoration methods have made significant progress, they still struggle with limited generalization to real-world scenarios due to the substantial domain gap caused by training on synthetic data. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kang Liao , Zongsheng Yue , Zhouxia Wang , Chen Change Loy

Deep neural networks (DNNs) are being widely applied for various real-world applications across domains due to their high performance (e.g., high accuracy on image classification). Nevertheless, a well-trained DNN after deployment could…

Machine Learning · Computer Science 2020-11-20 Bing Yu , Hua Qi , Qing Guo , Felix Juefei-Xu , Xiaofei Xie , Lei Ma , Jianjun Zhao

The problem of domain generalization is to learn from multiple training domains, and extract a domain-agnostic model that can then be applied to an unseen domain. Domain generalization (DG) has a clear motivation in contexts where there are…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

We propose a simple domain adaptation method for neural networks in a supervised setting. Supervised domain adaptation is a way of improving the generalization performance on the target domain by using the source domain dataset, assuming…

Computation and Language · Computer Science 2016-07-05 Yusuke Watanabe , Kazuma Hashimoto , Yoshimasa Tsuruoka