English
Related papers

Related papers: Non-linear Convolution Filters for CNN-based Learn…

200 papers

Recently, convolutional neural networks (CNNs) have been used as a powerful tool to solve many problems of machine learning and computer vision. In this paper, we aim to provide insight on the property of convolutional neural networks, as…

Machine Learning · Computer Science 2016-07-20 Wenling Shang , Kihyuk Sohn , Diogo Almeida , Honglak Lee

We propose the introduction of nonlinear operation into the feature generation process in convolutional neural networks. This nonlinearity can be implemented in various ways. First we discuss the use of nonlinearities in the process of data…

Machine Learning · Computer Science 2019-05-30 Gavneet Singh Chadha , Andreas Schwung

This paper introduces a novel representation of convolutional Neural Networks (CNNs) in terms of 2-D dynamical systems. To this end, the usual description of convolutional layers with convolution kernels, i.e., the impulse responses of…

Optimization and Control · Mathematics 2023-04-12 Dennis Gramlich , Patricia Pauli , Carsten W. Scherer , Frank Allgöwer , Christian Ebenbauer

In recent years, there has been a surge of interest in developing deep learning methods for non-Euclidean structured data such as graphs. In this paper, we propose Dual-Primal Graph CNN, a graph convolutional architecture that alternates…

Deep Convolutional Neural Networks (CNNs) are empirically known to be invariant to moderate translation but not to rotation in image classification. This paper proposes a deep CNN model, called CyCNN, which exploits polar mapping of input…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Jinpyo Kim , Wooekun Jung , Hyungmo Kim , Jaejin Lee

Image classification is a fundamental task in computer vision with diverse applications, ranging from autonomous systems to medical imaging. The CIFAR-10 dataset is a widely used benchmark to evaluate the performance of classification…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xiaoran Yang , Shuhan Yu , Wenxi Xu

Convolutional neural networks (CNNs) have had great success in many real-world applications and have also been used to model visual processing in the brain. However, these networks are quite brittle - small changes in the input image can…

Neurons and Cognition · Quantitative Biology 2018-10-30 Brian Hu , Stefan Mihalas

Deep Convolutional Neural Networks (CNNs) have been widely used in various domains due to their impressive capabilities. These models are typically composed of a large number of 2D convolutional (Conv2D) layers with numerous trainable…

Machine Learning · Computer Science 2022-02-01 Yinan Yu , Samuel Scheidegger , Tomas McKelvey

Texture classification is an important and challenging problem in many image processing applications. While convolutional neural networks (CNNs) achieved significant successes for image classification, texture classification remains a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Shin Fujieda , Kohei Takayama , Toshiya Hachisuka

The majority of medical images, especially those that resemble cells, have similar characteristics. These images, which occur in a variety of shapes, often show abnormalities in the organ or cell region. The convolution operation possesses…

Recent work suggests that changing Convolutional Neural Network (CNN) architecture by introducing a bottleneck in the second layer can yield changes in learned function. To understand this relationship fully requires a way of quantitatively…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Ethan Harris , Daniela Mihai , Jonathon Hare

We make an attempt to understanding convolutional neural network by exploring the relationship between (deep) convolutional neural networks and Volterra convolutions. We propose a novel approach to explain and study the overall…

Machine Learning · Computer Science 2025-11-12 Tenghui Li , Guoxu Zhou , Yuning Qiu , Qibin Zhao

Fourier-based wavefront sensors, such as the Pyramid Wavefront Sensor (PWFS), are the current preference for high contrast imaging due to their high sensitivity. However, these wavefront sensors have intrinsic nonlinearities that constrain…

Instrumentation and Methods for Astrophysics · Physics 2020-05-22 Rico Landman , Sebastiaan Haffert

Neural networks in the real domain have been studied for a long time and achieved promising results in many vision tasks for recent years. However, the extensions of the neural network models in other number fields and their potential…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Xuanyu Zhu , Yi Xu , Hongteng Xu , Changjian Chen

Currently, many theoretical as well as practically relevant questions towards the transferability and robustness of Convolutional Neural Networks (CNNs) remain unsolved. While ongoing research efforts are engaging these problems from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Paul Gavrikov , Janis Keuper

We propose a new method for creating computationally efficient convolutional neural networks (CNNs) by using low-rank representations of convolutional filters. Rather than approximating filters in previously-trained networks with more…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Yani Ioannou , Duncan Robertson , Jamie Shotton , Roberto Cipolla , Antonio Criminisi

Deep learning methods are powerful tools but often suffer from expensive computation and limited flexibility. An alternative is to combine light-weight models with deep representations. As successful cases exist in several visual problems,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Bin Yang , Junjie Yan , Zhen Lei , Stan Z. Li

This study investigates the behavior of Causal Convolutional Neural Networks (CNNs) with quasi-linear activation functions when applied to time-series data characterized by multimodal frequency content. We demonstrate that, once trained,…

Machine Learning · Computer Science 2025-10-29 Kiran Bacsa , Wei Liu , Xudong Jian , Huangbin Liang , Eleni Chatzi

Convolutional neural networks are witnessing wide adoption in computer vision systems with numerous applications across a range of visual recognition tasks. Much of this progress is fueled through advances in convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis