中文
相关论文

相关论文: Why do deep convolutional networks generalize so p…

200 篇论文

In recent years, Classical Convolutional Neural Networks (CNNs) have been applied for image recognition successfully. Quantum Convolutional Neural Networks (QCNNs) are proposed as a novel generalization to CNNs by using quantum mechanisms.…

量子物理 · 物理学 2023-12-04 Leting Zhouli , Peiyong Wang , Udaya Parampalli

Toward a deeper understanding on the inner work of deep neural networks, we investigate CNN (convolutional neural network) using DCN (deconvolutional network) and randomization technique, and gain new insights for the intrinsic property of…

计算机视觉与模式识别 · 计算机科学 2018-02-21 Kun He , Jingbo Wang , Haochuan Li , Yao Shu , Mengxiao Zhang , Man Zhu , Liwei Wang , John E. Hopcroft

Following the traditional paradigm of convolutional neural networks (CNNs), modern CNNs manage to keep pace with more recent, for example transformer-based, models by not only increasing model depth and width but also the kernel size. This…

计算机视觉与模式识别 · 计算机科学 2023-06-23 Paul Gavrikov , Janis Keuper

Thanks to the use of convolution and pooling layers, convolutional neural networks were for a long time thought to be shift-invariant. However, recent works have shown that the output of a CNN can change significantly with small shifts in…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Anadi Chaman , Ivan Dokmanić

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

Convolutional Neural Networks (ConvNets) have shown excellent results on many visual classification tasks. With the exception of ImageNet, these datasets are carefully crafted such that objects are well-aligned at similar scales. Naturally,…

计算机视觉与模式识别 · 计算机科学 2014-12-17 Angjoo Kanazawa , Abhishek Sharma , David Jacobs

Deep convolutional neural networks trained on large datsets have emerged as an intriguing alternative for compressing images and solving inverse problems such as denoising and compressive sensing. However, it has only recently been realized…

机器学习 · 计算机科学 2019-07-09 Reinhard Heckel

Convolutional neural networks (CNNs) have shown very promising performance in recent years for different problems, including object recognition, face recognition, medical image analysis, etc. However, generally the trained CNN models are…

计算机视觉与模式识别 · 计算机科学 2020-11-13 Roshan Reddy Yedla , Shiv Ram Dubey

Training deep networks that generalize to a wide range of variations in test data is essential to building accurate and robust image classifiers. One standard strategy is to apply data augmentation to synthetically enlarge the training set.…

计算机视觉与模式识别 · 计算机科学 2020-06-29 Yunhan Zhao , Ye Tian , Charless Fowlkes , Wei Shen , Alan Yuille

Despite the importance of image representations such as histograms of oriented gradients and deep Convolutional Neural Networks (CNN), our theoretical understanding of them remains limited. Aiming at filling this gap, we investigate three…

计算机视觉与模式识别 · 计算机科学 2015-06-23 Karel Lenc , Andrea Vedaldi

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Ilke Cugu , Emre Akbas

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of…

机器学习 · 统计学 2021-03-01 Song Mei , Theodor Misiakiewicz , Andrea Montanari

Convolutional neural networks (CNNs) are one of the most widely used neural network architectures, showcasing state-of-the-art performance in computer vision tasks. Although larger CNNs generally exhibit higher accuracy, their size can be…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Sukhbinder Singh , Saeed S. Jahromi , Roman Orus

Deep Neural Networks (DNNs) have shown unparalleled achievements in numerous applications, reflecting their proficiency in managing vast data sets. Yet, their static structure limits their adaptability in ever-changing environments. This…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Yunjie Zhu , Yunhao Chen

Despite their massive size, successful deep artificial neural networks can exhibit a remarkably small difference between training and test performance. Conventional wisdom attributes small generalization error either to properties of the…

机器学习 · 计算机科学 2017-02-28 Chiyuan Zhang , Samy Bengio , Moritz Hardt , Benjamin Recht , Oriol Vinyals

We study how effective data augmentation is at capturing the inductive bias of carefully designed network architectures for spatial translation invariance. We evaluate various image classification architectures (antialiased, convolutional,…

计算机视觉与模式识别 · 计算机科学 2022-11-15 Suriya Gunasekar

Understanding how convolutional neural networks (CNNs) can efficiently learn high-dimensional functions remains a fundamental challenge. A popular belief is that these models harness the local and hierarchical structure of natural data such…

机器学习 · 统计学 2023-06-02 Francesco Cagnetta , Alessandro Favero , Matthieu Wyart

Convolution Neural Networks (CNNs) are widely used in medical image analysis, but their performance degrade when the magnification of testing images differ from the training images. The inability of CNNs to generalize across magnification…

图像与视频处理 · 电气工程与系统科学 2023-02-23 Pranav Jeevan , Nikhil Cherian Kurian , Amit Sethi

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to…

机器学习 · 计算机科学 2020-12-02 Gregory Benton , Marc Finzi , Pavel Izmailov , Andrew Gordon Wilson

The convolutional neural network (CNN) remains an essential tool in solving computer vision problems. Standard convolutional architectures consist of stacked layers of operations that progressively downscale the image. Aliasing is a…

图像与视频处理 · 电气工程与系统科学 2021-02-16 Antônio H. Ribeiro , Thomas B. Schön