English
Related papers

Related papers: Convexified Convolutional Neural Networks

200 papers

Convolutional Neural Networks (CNNs) have been successfully applied to many computer vision tasks, such as image classification. By performing linear combinations and element-wise nonlinear operations, these networks can be thought of as…

Computer Vision and Pattern Recognition · Computer Science 2017-03-21 Kaicheng Yu , Mathieu Salzmann

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

In this era of artificial intelligence, deep neural networks like Convolutional Neural Networks (CNNs) have emerged as front-runners, often surpassing human capabilities. These deep networks are often perceived as the panacea for all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Neeraj Kumar Singh , Nikhil R. Pal

This work introduces the Topological CNN (TCNN), which encompasses several topologically defined convolutional methods. Manifolds with important relationships to the natural image space are used to parameterize image filters which are used…

Machine Learning · Computer Science 2021-03-05 Ephy R. Love , Benjamin Filippenko , Vasileios Maroulas , Gunnar Carlsson

Filters in a Convolutional Neural Network (CNN) contain model parameters learned from enormous amounts of data. In this paper, we suggest to decompose convolutional filters in CNN as a truncated expansion with pre-fixed bases, namely the…

Machine Learning · Statistics 2018-07-31 Qiang Qiu , Xiuyuan Cheng , Robert Calderbank , Guillermo Sapiro

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

Convolutional neural networks (CNNs) have had great success in many real-world applications and have also been used to model visual processing in the brain. However, these networks are quite brittle - small changes in the input image can…

Neurons and Cognition · Quantitative Biology 2018-10-30 Brian Hu , Stefan Mihalas

Convolutional neural networks are witnessing wide adoption in computer vision systems with numerous applications across a range of visual recognition tasks. Much of this progress is fueled through advances in convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Felix Juefei-Xu , Vishnu Naresh Boddeti , Marios Savvides

Analysis of over-parameterized neural networks has drawn significant attention in recentyears. It was shown that such systems behave like convex systems under various restrictedsettings, such as for two-level neural networks, and when…

Machine Learning · Computer Science 2019-11-19 Cong Fang , Yihong Gu , Weizhong Zhang , Tong Zhang

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Convolutional Neural Network (CNNs) are typically associated with Computer Vision. CNNs are responsible for major breakthroughs in Image Classification and are the core of most Computer Vision systems today. More recently CNNs have been…

Computation and Language · Computer Science 2017-03-10 Marc Moreno Lopez , Jugal Kalita

Deep learning algorithms offer a powerful means to automatically analyze the content of medical images. However, many biological samples of interest are primarily transparent to visible light and contain features that are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Roarke Horstmeyer , Richard Y. Chen , Barbara Kappes , Benjamin Judkewitz

In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of: i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and…

Machine Learning · Computer Science 2021-07-08 Shengli Jiang , Victor M. Zavala

In this survey paper, we review recent uses of convolution neural networks (CNNs) to solve inverse problems in imaging. It has recently become feasible to train deep CNNs on large databases of images, and they have shown outstanding…

Image and Video Processing · Electrical Eng. & Systems 2018-09-11 Michael T. McCann , Kyong Hwan Jin , Michael Unser

Convolutional Neural Networks (CNNs) are known to be significantly over-parametrized, and difficult to interpret, train and adapt. In this paper, we introduce a structural regularization across convolutional kernels in a CNN. In our…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu

With the impressive capability to capture visual content, deep convolutional neural networks (CNN) have demon- strated promising performance in various vision-based ap- plications, such as classification, recognition, and objec- t…

Computer Vision and Pattern Recognition · Computer Science 2015-09-16 Zhen Liu

Analyzing multivariate time series data is important for many applications such as automated control, fault diagnosis and anomaly detection. One of the key challenges is to learn latent features automatically from dynamically changing…

Machine Learning · Computer Science 2018-06-01 Subin Yi , Janghoon Ju , Man-Ki Yoon , Jaesik Choi

This paper introduces a novel representation of convolutional Neural Networks (CNNs) in terms of 2-D dynamical systems. To this end, the usual description of convolutional layers with convolution kernels, i.e., the impulse responses of…

Optimization and Control · Mathematics 2023-04-12 Dennis Gramlich , Patricia Pauli , Carsten W. Scherer , Frank Allgöwer , Christian Ebenbauer