English
Related papers

Related papers: Why do deep convolutional networks generalize so p…

200 papers

Convolutional Neural Networks (CNNs) have demonstrated state-of-the-art performance on many visual recognition tasks. However, the combination of convolution and pooling operations only shows invariance to small local location changes in…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xu Shen , Xinmei Tian , Shaoyan Sun , Dacheng Tao

The deep Convolutional Neural Network (CNN) is the state-of-the-art solution for large-scale visual recognition. Following basic principles such as increasing the depth and constructing highway connections, researchers have manually…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Lingxi Xie , Alan Yuille

Convolutional Neural Networks (CNNs) rely on fixed-size kernels scanning local patches, which limits their ability to capture global context or long-range dependencies without very deep architectures. Vision Transformers (ViTs), in turn,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Gijs Joppe Moens , Regina Beets-Tan , Eduardo H. P. Pooch

Convolutional neural networks (CNNs) are the cutting edge model for supervised machine learning in computer vision. In recent years CNNs have outperformed traditional approaches in many computer vision tasks such as object detection, image…

Neural and Evolutionary Computing · Computer Science 2016-03-01 Nitzan Guberman

Motivated by the problem of learning with small sample sizes, this paper shows how to incorporate into support-vector machines (SVMs) those properties that have made convolutional neural networks (CNNs) successful. Particularly important is…

Machine Learning · Computer Science 2022-10-25 Tao Liu , P. R. Kumar , Ruida Zhou , Xi Liu

Deep convolutional neural networks (CNNs) are broadly considered to be state-of-the-art generic end-to-end image classification systems. However, they are known to underperform when training data are limited and thus require data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Mohammad Shifat E Rabbi , Yan Zhuang , Shiying Li , Abu Hasnat Mohammad Rubaiyat , Xuwang Yin , Gustavo K. Rohde

Many of our core assumptions about how neural networks operate remain empirically untested. One common assumption is that convolutional neural networks need to be stable to small translations and deformations to solve image recognition…

Computer Vision and Pattern Recognition · Computer Science 2018-05-28 Avraham Ruderman , Neil C. Rabinowitz , Ari S. Morcos , Daniel Zoran

Despite impressive performance on numerous visual tasks, Convolutional Neural Networks (CNNs) --- unlike brains --- are often highly sensitive to small perturbations of their input, e.g. adversarial noise leading to erroneous decisions. We…

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

In some important computer vision domains, such as medical or hyperspectral imaging, we care about the classification of tiny objects in large images. However, most Convolutional Neural Networks (CNNs) for image classification were…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Nick Pawlowski , Suvrat Bhooshan , Nicolas Ballas , Francesco Ciompi , Ben Glocker , Michal Drozdzal

Purpose: The aim of this work is to demonstrate that convolutional neural networks (CNN) can be applied to extremely sparse image libraries by subdivision of the original image datasets. Methods: Image datasets from a conventional digital…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Johan P. Boetker

Convolutional neural networks have shown great success on feature extraction from raw input data such as images. Although convolutional neural networks are invariant to translations on the inputs, they are not invariant to other…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Hongyang Gao , Shuiwang Ji

Recent progress in deep convolutional neural networks (CNNs) have enabled a simple paradigm of architecture design: larger models typically achieve better accuracy. Due to this, in modern CNN architectures, it becomes more important to…

Machine Learning · Computer Science 2019-05-14 Jongheon Jeong , Jinwoo Shin

Symmetry-based neural networks often constrain the architecture in order to achieve invariance or equivariance to a group of transformations. In this paper, we propose an alternative that avoids this architectural constraint by learning to…

Machine Learning · Computer Science 2023-07-10 Sékou-Oumar Kaba , Arnab Kumar Mondal , Yan Zhang , Yoshua Bengio , Siamak Ravanbakhsh

Deep learning algorithms offer a powerful means to automatically analyze the content of medical images. However, many biological samples of interest are primarily transparent to visible light and contain features that are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Roarke Horstmeyer , Richard Y. Chen , Barbara Kappes , Benjamin Judkewitz

While initially devised for image categorization, convolutional neural networks (CNNs) are being increasingly used for the pixelwise semantic labeling of images. However, the proper nature of the most common CNN architectures makes them…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Emmanuel Maggiori , Guillaume Charpiat , Yuliya Tarabalka , Pierre Alliez

This paper is focused on studying the view-manifold structure in the feature spaces implied by the different layers of Convolutional Neural Networks (CNN). There are several questions that this paper aims to answer: Does the learned CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Amr Bakry , Mohamed Elhoseiny , Tarek El-Gaaly , Ahmed Elgammal

Training vision transformer networks on small datasets poses challenges. In contrast, convolutional neural networks (CNNs) can achieve state-of-the-art performance by leveraging their architectural inductive bias. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jianqiao Zheng , Xueqian Li , Simon Lucey

Deep Convolutional Neural Networks (CNNs) are empirically known to be invariant to moderate translation but not to rotation in image classification. This paper proposes a deep CNN model, called CyCNN, which exploits polar mapping of input…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Jinpyo Kim , Wooekun Jung , Hyungmo Kim , Jaejin Lee

This thesis studies how the segmentation results, produced by convolutional neural networks (CNN), is different from each other when applied to small biomedical datasets. We use different architectures, parameters and hyper-parameters,…

Image and Video Processing · Electrical Eng. & Systems 2020-11-04 Vitaly Nikolaev