English
Related papers

Related papers: Attention Diversification for Domain Generalizatio…

200 papers

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Neerav Karani , Ertunc Erdil , Krishna Chaitanya , Ender Konukoglu

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

Deep learning models face persistent challenges in training, particularly due to internal covariate shift and label shift. While single-mode normalization methods like Batch Normalization partially address these issues, they are constrained…

Machine Learning · Computer Science 2024-10-31 Bilal Faye , Hanane Azzag , Mustapha Lebbah , Djamel Bouchaffra

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Domain generalization (DG) is a prevalent problem in real-world applications, which aims to train well-generalized models for unseen target domains by utilizing several source domains. Since domain labels, i.e., which domain each data point…

Machine Learning · Computer Science 2023-11-14 Yunze Tong , Junkun Yuan , Min Zhang , Didi Zhu , Keli Zhang , Fei Wu , Kun Kuang

Domain adaptation aims at training a classifier in one dataset and applying it to a related but not identical dataset. One successfully used framework of domain adaptation is to learn a transformation to match both the distribution of the…

Computer Vision and Pattern Recognition · Computer Science 2015-03-03 Xu Zhang , Felix Xinnan Yu , Shih-Fu Chang , Shengjin Wang

Large capacity deep learning models are often prone to a high generalization gap when trained with a limited amount of labeled training data. A recent class of methods to address this problem uses various ways to construct a new training…

Machine Learning · Computer Science 2023-01-10 Mojtaba Faramarzi , Mohammad Amini , Akilesh Badrinaaraayanan , Vikas Verma , Sarath Chandar

Deep learning models suffer from opaqueness. For Convolutional Neural Networks (CNNs), current research strategies for explaining models focus on the target classes within the associated training dataset. As a result, the understanding of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Xuehao Liu , Sarah Jane Delany , Susan McKeever

Batch normalization (BN) is widely used in modern deep neural networks, which has been shown to represent the domain-related knowledge, and thus is ineffective for cross-domain tasks like unsupervised domain adaptation (UDA). Existing BN…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Zhiyong Huang , Kekai Sheng , Ke Li , Jian Liang , Taiping Yao , Weiming Dong , Dengwen Zhou , Xing Sun

While self-attention mechanism has shown promising results for many vision tasks, it only considers the current features at a time. We show that such a manner cannot take full advantage of the attention mechanism. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Xu Ma , Jingda Guo , Sihai Tang , Zhinan Qiao , Qi Chen , Qing Yang , Song Fu

This report contributes to the field of unsupervised domain adaptation by providing an analysis of existing methods, introducing a new approach, and demonstrating the potential for improving visual recognition tasks across different…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Artem Bituitskii

In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior. For…

Machine Learning · Computer Science 2021-04-01 Alana de Santana Correia , Esther Luna Colombini

Domain generalization (DG) task aims to learn a robust model from source domains that could handle the out-of-distribution (OOD) issue. In order to improve the generalization ability of the model in unseen domains, increasing the diversity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Shanshan Wang , ALuSi , Xun Yang , Ke Xu , Huibin Tan , Xingyi Zhang

Despite their success in many computer vision tasks, convolutional networks tend to require large amounts of labeled data to achieve generalization. Furthermore, the performance is not guaranteed on a sample from an unseen domain at test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Ozan Ciga , Jianan Chen , Anne Martel

The success of deep learning has set new benchmarks for many medical image analysis tasks. However, deep models often fail to generalize in the presence of distribution shifts between training (source) data and test (target) data. One…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Dwarikanath Mahapatra

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

The idea of using the recurrent neural network for visual attention has gained popularity in computer vision community. Although the recurrent attention model (RAM) leverages the glimpses with more large patch size to increasing its scope,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Gang Chen

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Enhancing the generalization capability of deep neural networks to unseen domains is crucial for safety-critical applications in the real world such as autonomous driving. To address this issue, this paper proposes a novel instance…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Sungha Choi , Sanghun Jung , Huiwon Yun , Joanne Kim , Seungryong Kim , Jaegul Choo