English
Related papers

Related papers: Zero Stability Well Predicts Performance of Convol…

200 papers

Convolutional neural networks (CNNs) are similar to "ordinary" neural networks in the sense that they are made up of hidden layers consisting of neurons with "learnable" parameters. These neurons receive inputs, performs a dot product, and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Abien Fred Agarap

Convolutional Neural Networks (CNNs) constitute a class of Deep Learning models which have been used in the recent past to resolve many problems in computer vision, in particular optical flow estimation. Measuring displacement and strain…

Image and Video Processing · Electrical Eng. & Systems 2020-09-10 S. Boukhtache , K. Abdelouahab , F. Berry , B. Blaysat , M. Grediac , F. Sur

Convolutional Neural Networks (CNNs) have shown remarkable performance in general object recognition tasks. In this paper, we propose a new model called EnsNet which is composed of one base CNN and multiple Fully Connected SubNetworks…

Machine Learning · Computer Science 2023-07-19 Daiki Hirata , Norikazu Takahashi

Deep neural networks, albeit their great success on feature learning in various computer vision tasks, are usually considered as impractical for online visual tracking because they require very long training time and a large number of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Hanxi Li , Yi Li , Fatih Porikli

Recent works show that Graph Neural Networks (GNNs) are highly non-robust with respect to adversarial attacks on both the graph structure and the node attributes, making their outcomes unreliable. We propose the first method for certifiable…

Machine Learning · Computer Science 2019-07-01 Daniel Zügner , Stephan Günnemann

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

Convolutional Neural Networks (CNN) possess many positive qualities when it comes to spatial raster data. Translation invariance enables CNNs to detect features regardless of their position in the scene. However, in some domains, like…

Machine Learning · Computer Science 2020-07-13 Arnas Uselis , Mantas Lukoševičius , Lukas Stasytis

Recent research has shown that supervised learning can be an effective tool for designing optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of these neural network (NN) controllers is still not…

Optimization and Control · Mathematics 2022-10-10 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Deep convolutional neural networks (CNN) brought revolution without any doubt to various challenging tasks, mainly in computer vision. However, their model designing still requires attention to reduce number of learnable parameters, with no…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Ihsan Ullah , Alfredo Petrosino

Existing convolutional neural network architectures frequently rely upon batch normalization (BatchNorm) to effectively train the model. BatchNorm, however, performs poorly with small batch sizes, and is inapplicable to differential…

Machine Learning · Computer Science 2024-03-06 Reza Nasirigerdeh , Reihaneh Torkzadehmahani , Daniel Rueckert , Georgios Kaissis

Convolutional neural networks (CNNs) have demonstrated remarkable results in image classification for benchmark tasks and practical applications. The CNNs with deeper architectures have achieved even higher performance recently thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Ryo Takahashi , Takashi Matsubara , Kuniaki Uehara

In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of: i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and…

Machine Learning · Computer Science 2021-07-08 Shengli Jiang , Victor M. Zavala

In this paper, we are concerned with image classification with deep convolutional neural networks (CNNs). We focus on the following question: given a set of candidate CNN models, how to select the right one with the best generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Bin Liu

Hierarchical feature learning based on convolutional neural networks (CNN) has recently shown significant potential in various computer vision tasks. While allowing high-quality discriminative feature learning, the downside of CNNs is the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Domen Tabernik , Matej Kristan , Jeremy L. Wyatt , Aleš Leonardis

Deep convolutional neural networks (CNNs) have been shown to predict poverty and development indicators from satellite images with surprising accuracy. This paper presents a first attempt at analyzing the CNNs responses in detail and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Hamid Sarmadi , Thorsteinn Rögnvaldsson , Nils Roger Carlsson , Mattias Ohlsson , Ibrahim Wahab , Ola Hall

Neural Networks are prone to having lesser accuracy in the classification of images with noise perturbation. Convolutional Neural Networks, CNNs are known for their unparalleled accuracy in the classification of benign images. But our study…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Durga Shree Nagabushanam , Steve Mathew , Chiranji Lal Chowdhary

Three important criteria of existing convolutional neural networks (CNNs) are (1) test-set accuracy; (2) out-of-distribution accuracy; and (3) explainability. While these criteria have been studied independently, their relationship is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Mehdi Nourelahi , Lars Kotthoff , Peijie Chen , Anh Nguyen

It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Max Welling

Very deep convolutional neural networks (CNNs) yield state of the art results on a wide variety of visual recognition problems. A number of state of the the art methods for image recognition are based on networks with well over 100 layers…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Joel Moniz , Christopher Pal