中文
相关论文

相关论文: When do Convolutional Neural Networks Stop Learnin…

200 篇论文

The use of Convolutional Neural Networks (CNN) in natural image classification systems has produced very impressive results. Combined with the inherent nature of medical images that make them ideal for deep-learning, further application of…

机器学习 · 计算机科学 2016-01-11 Junghwan Cho , Kyewook Lee , Ellie Shin , Garry Choy , Synho Do

Despite impressive performance on numerous visual tasks, Convolutional Neural Networks (CNNs) --- unlike brains --- are often highly sensitive to small perturbations of their input, e.g. adversarial noise leading to erroneous decisions. We…

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

计算机视觉与模式识别 · 计算机科学 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

Batch Normalization (BatchNorm) is commonly used in Convolutional Neural Networks (CNNs) to improve training speed and stability. However, there is still limited consensus on why this technique is effective. This paper uses concepts from…

神经与进化计算 · 计算机科学 2021-06-02 Elaina Chai , Mert Pilanci , Boris Murmann

In contrast to fully connected networks, Convolutional Neural Networks (CNNs) achieve efficiency by learning weights associated with local filters with a finite spatial extent. An implication of this is that a filter may know what it is…

计算机视觉与模式识别 · 计算机科学 2020-01-24 Md Amirul Islam , Sen Jia , Neil D. B. Bruce

The paper proposes an approach to training a convolutional neural network using information on the level of distortion of input data. The learning process is modified with an additional layer, which is subsequently deleted, so the…

计算机视觉与模式识别 · 计算机科学 2019-12-03 Igor Janiszewski , Dmitry Slugin , Vladimir V. Arlazarov

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

计算机视觉与模式识别 · 计算机科学 2016-07-15 Joel Moniz , Christopher Pal

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

Many neural networks exhibit stability in their activation patterns over time in response to inputs from sensors operating under real-world conditions. By capitalizing on this property of natural signals, we propose a Recurrent Neural…

神经与进化计算 · 计算机科学 2016-12-19 Daniel Neil , Jun Haeng Lee , Tobi Delbruck , Shih-Chii Liu

Convolution neural network (CNN), as one of the most powerful and popular technologies, has achieved remarkable progress for image and video classification since its invention in 1989. However, with the high definition video-data explosion,…

新兴技术 · 计算机科学 2021-08-04 Yue Jiang , Wenjia Zhang , Fan Yang , Zuyuan He

Convolutional Neural Network (CNN) has become the most used method for image classification tasks. During its training the learning rate and the gradient are two key factors to tune for influencing the convergence speed of the model. Usual…

机器学习 · 计算机科学 2020-03-24 Zilong Zhao , Sophie Cerf , Bogdan Robu , Nicolas Marchand

Purpose: The aim of this work is to develop a neural network training framework for continual training of small amounts of medical imaging data and create heuristics to assess training in the absence of a hold-out validation or test set.…

图像与视频处理 · 电气工程与系统科学 2023-09-27 Sohaib Naim , Brian Caffo , Haris I Sair , Craig K Jones

Understanding the per-layer learning dynamics of deep neural networks is of significant interest as it may provide insights into how neural networks learn and the potential for better training regimens. We investigate learning in Deep…

机器学习 · 计算机科学 2020-12-02 Ayush Manish Agrawal , Atharva Tendle , Harshvardhan Sikka , Sahib Singh , Amr Kayid

The convolutional layers are core building blocks of neural network architectures. In general, a convolutional filter applies to the entire frequency spectrum of the input data. We explore artificially constraining the frequency spectra of…

机器学习 · 计算机科学 2019-11-22 Adam Dziedzic , John Paparrizos , Sanjay Krishnan , Aaron Elmore , Michael Franklin

Convolutional Neural Networks (CNNs) are build specifically for computer vision tasks for which it is known that the input data is a hierarchical structure based on locally correlated elements. The question that naturally arises is what…

计算机视觉与模式识别 · 计算机科学 2019-07-26 Cristian Ivan

Hyperparameters tuning is a time-consuming approach, particularly when the architecture of the neural network is decided as part of this process. For instance, in convolutional neural networks (CNNs), the selection of the number and the…

机器学习 · 计算机科学 2020-07-31 Roberto L. Castro , Diego Andrade , Basilio Fraguela

Recent research shows that for training with $\ell_2$ loss, convolutional neural networks (CNNs) whose width (number of channels in convolutional layers) goes to infinity correspond to regression with respect to the CNN Gaussian Process…

机器学习 · 计算机科学 2019-11-05 Zhiyuan Li , Ruosong Wang , Dingli Yu , Simon S. Du , Wei Hu , Ruslan Salakhutdinov , Sanjeev Arora

We present an approach to utilize large amounts of web data for learning CNNs. Specifically inspired by curriculum learning, we present a two-step approach for CNN training. First, we use easy images to train an initial visual…

计算机视觉与模式识别 · 计算机科学 2015-10-09 Xinlei Chen , Abhinav Gupta

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

计算机视觉与模式识别 · 计算机科学 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

机器学习 · 计算机科学 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright