English
Related papers

Related papers: Zero Stability Well Predicts Performance of Convol…

200 papers

Coreset selection is among the most effective ways to reduce the training time of CNNs, however, only limited is known on how the resultant models will behave under variations of the coreset size, and choice of datasets and models.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Animesh Gupta , Irtiza Hasan , Dilip K. Prasad , Deepak K. Gupta

Deep Neural networks are efficient and flexible models that perform well for a variety of tasks such as image, speech recognition and natural language understanding. In particular, convolutional neural networks (CNN) generate a keen…

Machine Learning · Computer Science 2018-12-20 Yesmina Jaafra , Jean Luc Laurent , Aline Deruyver , Mohamed Saber Naceur

The Convolutional Neural Networks (CNNs), in domains like computer vision, mostly reduced the need for handcrafted features due to its ability to learn the problem-specific features from the raw input data. However, the selection of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 S. H. Shabbeer Basha , Shiv Ram Dubey , Viswanath Pulabaigari , Snehasis Mukherjee

This letter proposes a convolutional neural network (CNN)-based adaptive controller wtih three notable features: 1) it determines control input directly from historical sensor data (in an end-to-end process); 2) it learns the desired…

Systems and Control · Electrical Eng. & Systems 2024-03-07 Myeongseok Ryu , Kyunghwan Choi

Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 David M. Knigge , David W. Romero , Albert Gu , Efstratios Gavves , Erik J. Bekkers , Jakub M. Tomczak , Mark Hoogendoorn , Jan-Jakob Sonke

Learning models of dynamical systems characterized by specific stability properties is of crucial importance in applications. Existing results mainly focus on linear systems or some limited classes of nonlinear systems and stability…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Matteo Scandella , Michelangelo Bin , Thomas Parisini

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe distribution shifts…

Neural networks (NNs) have proven to be a viable alternative to traditional direct numerical algorithms, with the potential to accelerate computational time by several orders of magnitude. In the present paper we study the use of…

Machine Learning · Computer Science 2023-02-09 J. Quetzalcoatl Toledo-Marin , James A. Glazier , Geoffrey Fox

Graph Neural Networks (GNN) rely on graph convolutions to learn features from network data. GNNs are stable to different types of perturbations of the underlying graph, a property that they inherit from graph filters. In this paper we…

Machine Learning · Computer Science 2022-02-11 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Convolutional Neural Network (CNN) has gained state-of-the-art results in many pattern recognition and computer vision tasks. However, most of the CNN structures are manually designed by experienced researchers. Therefore, auto- matically…

Neural and Evolutionary Computing · Computer Science 2018-10-26 Guoqiang Zhong , Tao Li , Wenxue Liu , Yang Chen

Graph convolutional neural networks (GCNNs) have emerged as powerful tools for analyzing graph-structured data, achieving remarkable success across diverse applications. However, the theoretical understanding of the stability of these…

Machine Learning · Computer Science 2025-10-28 Ning Zhang , Henry Kenlay , Li Zhang , Mihai Cucuringu , Xiaowen Dong

Convolutional Neural Networks (CNNs) are a class of artificial neural networks whose computational blocks use convolution, together with other linear and non-linear operations, to perform classification or regression. This paper explores…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Victor Stamatescu , Mark D. McDonnell

Maintaining numerical stability in machine learning models is crucial for their reliability and performance. One approach to maintain stability of a network layer is to integrate the condition number of the weight matrix as a regularizing…

Machine Learning · Computer Science 2024-10-02 Rossen Nenov , Daniel Haider , Peter Balazs

This paper proposes a new topology optimization method that applies a convolutional neural network (CNN), which is one deep learning technique for topology optimization problems. Using this method, we acquire a structure with a little…

Machine Learning · Computer Science 2020-01-06 Yusuke Takahashi , Yoshiro Suzuki , Akira Todoroki

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

We propose a generalized convolutional neural network (CNN) architecture that first decomposes the input signal into subbands by an adaptive filter bank structure, and then uses convolutional layers to extract features from each subband…

Image and Video Processing · Electrical Eng. & Systems 2023-06-30 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Convolutional neural networks (CNNs) are currently among the most widely-used deep neural network (DNN) architectures available and achieve state-of-the-art performance for many problems. Originally applied to computer vision tasks, CNNs…

Machine Learning · Computer Science 2024-02-29 Inés Gonzalez Pepe , Yohan Chatelain , Gregory Kiar , Tristan Glatard

In this work, we build a generic architecture of Convolutional Neural Networks to discover empirical properties of neural networks. Our first contribution is to introduce a state-of-the-art framework that depends upon few hyper parameters…

Computer Vision and Pattern Recognition · Computer Science 2017-03-07 Edouard Oyallon