English
Related papers

Related papers: Arguments for the Unsuitability of Convolutional N…

200 papers

Deep learning has established many new state of the art solutions in the last decade in areas such as object, scene and speech recognition. In particular Convolutional Neural Network (CNN) is a category of deep learning which obtains…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Vincent Andrearczyk , Paul F. Whelan

Robustness of convolutional neural networks (CNNs) has gained in importance on account of adversarial examples, i.e., inputs added as well-designed perturbations that are imperceptible to humans but can cause the model to predict…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Tiange Luo , Tianle Cai , Mengxiao Zhang , Siyu Chen , Di He , Liwei Wang

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Recent progress in deep convolutional neural networks (CNNs) have enabled a simple paradigm of architecture design: larger models typically achieve better accuracy. Due to this, in modern CNN architectures, it becomes more important to…

Machine Learning · Computer Science 2019-05-14 Jongheon Jeong , Jinwoo Shin

This thesis studies how the segmentation results, produced by convolutional neural networks (CNN), is different from each other when applied to small biomedical datasets. We use different architectures, parameters and hyper-parameters,…

Image and Video Processing · Electrical Eng. & Systems 2020-11-04 Vitaly Nikolaev

Efficiently executing convolutional neural nets (CNNs) is important in many machine-learning tasks. Since the cost of moving a word of data, either between levels of a memory hierarchy or between processors over a network, is much higher…

Data Structures and Algorithms · Computer Science 2018-04-25 James Demmel , Grace Dinh

Recent advances in hardware and big data acquisition have accelerated the development of deep learning techniques. For an extended period of time, increasing the model complexity has led to performance improvements for various tasks.…

Machine Learning · Computer Science 2023-07-24 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

Convolutional neural networks (CNN) exhibit unmatched performance in a multitude of computer vision tasks. However, the advantage of using convolutional networks over fully-connected networks is not understood from a theoretical…

Machine Learning · Computer Science 2020-10-06 Eran Malach , Shai Shalev-Shwartz

Fully convolutional U-shaped neural networks have largely been the dominant approach for pixel-wise image segmentation. In this work, we tackle two defects that hinder their deployment in real-world applications: 1) Predictions lack…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Martin Ferianc , Divyansh Manocha , Hongxiang Fan , Miguel Rodrigues

In this survey paper, we review recent uses of convolution neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Michael T. McCann , Kyong Hwan Jin , Michael Unser

Deep neural network models have a complex architecture and are overparameterized. The number of parameters is more than the whole dataset, which is highly resource-consuming. This complicates their application and limits its usage on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Vasiliy Alekseev , Ilya Lukashevich , Ilia Zharikov , Ilya Vasiliev

Complex-valued neural networks are not a new concept, however, the use of real-valued models has often been favoured over complex-valued models due to difficulties in training and performance. When comparing real-valued versus…

Machine Learning · Computer Science 2018-11-30 Nils Mönning , Suresh Manandhar

Convolutional Neural Networks spread through computer vision like a wildfire, impacting almost all visual tasks imaginable. Despite this, few researchers dare to train their models from scratch. Most work builds on one of a handful of…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Philipp Krähenbühl , Carl Doersch , Jeff Donahue , Trevor Darrell

Convolutional Neural Networks (CNNs) have become the state of the art method for image classification in the last ten years. Despite the fact that they achieve superhuman classification accuracy on many popular datasets, they often perform…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Sebastian Stabinger , Peer David , Justus Piater , Antonio Rodríguez-Sánchez

The paper discusses the limitations of deep learning models in identifying and utilizing features that remain invariant under a bijective transformation on the data entries, which we refer to as combinatorial patterns. We argue that the…

Machine Learning · Computer Science 2023-03-30 Karen Sargsyan

Convolutional Neural Networks (CNNs) have been widely applied. But as the CNNs grow, the number of arithmetic operations and memory footprint also increase. Furthermore, typical non-linear activation functions do not allow associativity of…

Machine Learning · Computer Science 2021-11-10 Eduardo Vera Sousa , Leandro A. F. Fernandes , Cristina Nader Vasconcelos

Determining the material category of a surface from an image is a demanding task in perception that is drawing increasing attention. Following the recent remarkable results achieved for image classification and object detection utilising…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Grigorios Kalliatakis , Georgios Stamatiadis , Shoaib Ehsan , Ales Leonardis , Juergen Gall , Anca Sticlaru , Klaus D. McDonald-Maier

Land use mapping is a fundamental yet challenging task in geographic science. In contrast to land cover mapping, it is generally not possible using overhead imagery. The recent, explosive growth of online geo-referenced photo collections…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Yi Zhu , Shawn Newsam

Traditional 3D convolutions are computationally expensive, memory intensive, and due to large number of parameters, they often tend to overfit. On the other hand, 2D CNNs are less computationally expensive and less memory intensive than 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Gagan Kanojia , Sudhakar Kumawat , Shanmuganathan Raman