English
Related papers

Related papers: Informative Dropout for Robust Representation Lear…

200 papers

Convolutional neural networks (CNNs) learn to extract representations of complex features, such as object shapes and textures to solve image recognition tasks. Recent work indicates that CNNs trained on ImageNet are biased towards features…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Chaithanya Kumar Mummadi , Ranjitha Subramaniam , Robin Hutmacher , Julien Vitay , Volker Fischer , Jan Hendrik Metzen

Convolutional Neural Networks (CNNs) have become the state-of-the-art method to learn from image data. However, recent research shows that they may include a texture and colour bias in their representation, contrary to the intuition that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Francis Brochu

In convolutional neural network (CNN), dropout cannot work well because dropped information is not entirely obscured in convolutional layers where features are correlated spatially. Except randomly discarding regions or channels, many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Tianshu Xie , Minghui Liu , Jiali Deng , Xuan Cheng , Xiaomin Wang , Ming Liu

CNNs achieve remarkable performance by leveraging deep, over-parametrized architectures, trained on large datasets. However, they have limited generalization ability to data outside the training domain, and a lack of robustness to noise and…

Humans rely heavily on shape information to recognize objects. Conversely, convolutional neural networks (CNNs) are biased more towards texture. This is perhaps the main reason why CNNs are vulnerable to adversarial examples. Here, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Ali Borji

Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Satyam Mohla , Anshul Nasery , Biplab Banerjee

Convolutional neural networks (CNNs) have achieved remarkable success in image recognition. Although the internal patterns of the input images are effectively learned by the CNNs, these patterns only constitute a small proportion of useful…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhengsu Chen , Jianwei Niu , Xuefeng Liu , Shaojie Tang

Convolutional Neural Networks (CNNs) excel at image classification but remain vulnerable to common corruptions that humans handle with ease. A key reason for this fragility is their reliance on local texture cues rather than global object…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Robin Narsingh Ranabhat , Longwei Wang , Amit Kumar Patel , KC santosh

Convolutional Neural Networks (CNNs) are commonly thought to recognise objects by learning increasingly complex representations of object shapes. Some recent studies suggest a more important role of image textures. We here put these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Robert Geirhos , Patricia Rubisch , Claudio Michaelis , Matthias Bethge , Felix A. Wichmann , Wieland Brendel

Recent work has indicated that, unlike humans, ImageNet-trained CNNs tend to classify images by texture rather than by shape. How pervasive is this bias, and where does it come from? We find that, when trained on datasets of images with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Katherine L. Hermann , Ting Chen , Simon Kornblith

The hypothesis that Convolutional Neural Networks (CNNs) are inherently texture-biased has shaped much of the discourse on feature use in deep learning. We revisit this hypothesis by examining limitations in the cue-conflict experiment by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Tom Burgert , Oliver Stoll , Paolo Rota , Begüm Demir

Convolutional neural networks (CNNs) have demonstrated remarkable success in vision-related tasks. However, their susceptibility to failing when inputs deviate from the training distribution is well-documented. Recent studies suggest that…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Pradyumna Elavarthi , James Lee , Anca Ralescu

Dropout regularization has been widely used in deep learning but performs less effective for convolutional neural networks since the spatially correlated features allow dropped information to still flow through the networks. Some structured…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Hui Zhu , Xiaofang Zhao

There is an emerging sense that the vulnerability of Image Convolutional Neural Networks (CNN), i.e., sensitivity to image corruptions, perturbations, and adversarial attacks, is connected with Texture Bias. This relative lack of Shape Bias…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Maruthi Narayanan , Vickram Rajendran , Benjamin Kimia

This paper presents a new version of Dropout called Split Dropout (sDropout) and rotational convolution techniques to improve CNNs' performance on image classification. The widely used standard Dropout has advantage of preventing deep…

Computer Vision and Pattern Recognition · Computer Science 2015-08-03 Fa Wu , Peijun Hu , Dexing Kong

Deep neural networks are typically trained by uniformly sampling large datasets across epochs, despite evidence that not all samples contribute equally throughout learning. Recent work shows that progressively reducing the amount of…

Machine Learning · Computer Science 2026-04-15 Amar Gahir , Varshil Patel , Shreyank N Gowda

Despite the initial belief that Convolutional Neural Networks (CNNs) are driven by shapes to perform visual recognition tasks, recent evidence suggests that texture bias in CNNs provides higher performing models when learning on large…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Reza Azad , Abdur R Fayjie , Claude Kauffman , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Zhenlin Xu , Deyi Liu , Junlin Yang , Colin Raffel , Marc Niethammer

The big breakthrough on the ImageNet challenge in 2012 was partially due to the `dropout' technique used to avoid overfitting. Here, we introduce a new approach called `Spectral Dropout' to improve the generalization ability of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Salman Khan , Munawar Hayat , Fatih Porikli

Convolutional neural networks (CNNs) for image processing tend to focus on localized texture patterns, commonly referred to as texture bias. While most of the previous works in the literature focus on the task of image classification, we go…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Edgar Heinert , Matthias Rottmann , Kira Maag , Karsten Kahl
‹ Prev 1 2 3 10 Next ›