English
Related papers

Related papers: On Lipschitz Bounds of General Convolutional Neura…

200 papers

The usage of convolutional neural networks (CNNs) for unsupervised image segmentation was investigated in this study. In the proposed approach, label prediction and network parameter learning are alternately iterated to meet the following…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Wonjik Kim , Asako Kanezaki , Masayuki Tanaka

Designing neural networks with bounded Lipschitz constant is a promising way to obtain certifiably robust classifiers against adversarial examples. However, the relevant progress for the important $\ell_\infty$ perturbation setting is…

Machine Learning · Computer Science 2022-10-28 Bohang Zhang , Du Jiang , Di He , Liwei Wang

Our main focus is on the generalization bound, which serves as an upper limit for the generalization error. Our analysis delves into regression and classification tasks separately to ensure a thorough examination. We assume the target…

Machine Learning · Statistics 2024-07-30 Wen-Liang Hwang

Convolutional neural networks (CNNs) based solutions have achieved state-of-the-art performances for many computer vision tasks, including classification and super-resolution of images. Usually the success of these methods comes with a cost…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Yawei Li , Shuhang Gu , Luc Van Gool , Radu Timofte

This paper presents a framework for bounding the approximation error in imitation model predictive controllers utilizing neural networks. Leveraging the Lipschitz properties of these neural networks, we derive a bound that guides dataset…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Hendrik Alsmeier , Lukas Theiner , Anton Savchenko , Ali Mesbah , Rolf Findeisen

Convolutional Neural Networks (CNNs) dominate various computer vision tasks since Alex Krizhevsky showed that they can be trained effectively and reduced the top-5 error from 26.2 % to 15.3 % on the ImageNet large scale visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Martin Thoma

Convolutional Neural Network (CNN) image classifiers are traditionally designed to have sequential convolutional layers with a single output layer. This is based on the assumption that all target classes should be treated equally and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-06 Xinqi Zhu , Michael Bain

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

Hypergraph neural networks have been promising tools for handling learning tasks involving higher-order data, with notable applications in web graphs, such as modeling multi-way hyperlink structures and complex user interactions. Yet, their…

Machine Learning · Computer Science 2025-01-28 Yifan Wang , Gonzalo R. Arce , Guangmo Tong

Convolutional Neural Networks (CNN) have been pivotal to the success of many state-of-the-art classification problems, in a wide variety of domains (for e.g. vision, speech, graphs and medical imaging). A commonality within those domains is…

Machine Learning · Computer Science 2019-12-02 Rohan Ghosh , Anupam K. Gupta , Mehul Motani

In this paper, we determine analytical bounds on the local Lipschitz constants of of affine functions composed with rectified linear units (ReLUs). Affine-ReLU functions represent a widely used layer in deep neural networks, due to the fact…

Machine Learning · Computer Science 2020-08-17 Trevor Avant , Kristi A. Morgansen

Recently, deep Convolutional Neural Networks (CNNs) have proven to be successful when employed in areas such as reduced order modeling of parametrized PDEs. Despite their accuracy and efficiency, the approaches available in the literature…

Numerical Analysis · Mathematics 2023-01-26 Nicola Rares Franco , Stefania Fresca , Andrea Manzoni , Paolo Zunino

In this paper, we introduce convolutional proximal neural networks (cPNNs), which are by construction averaged operators. For filters of full length, we propose a stochastic gradient descent algorithm on a submanifold of the Stiefel…

Optimization and Control · Mathematics 2024-08-13 Johannes Hertrich , Sebastian Neumayer , Gabriele Steidl

This paper proposes a novel regularization approach to bias Convolutional Neural Networks (CNNs) toward utilizing edge and line features in their hidden layers. Rather than learning arbitrary kernels, we constrain the convolution layers to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Christoph Linse , Beatrice Brückner , Thomas Martinetz

Convolutional neural networks (CNNs) have been successful in representing the fully-connected inferencing ability perceived to be seen in the human brain: they take full advantage of the hierarchy-style patterns commonly seen in complex…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Joshua Ball

Convolutional Neural Network (CNN) is the state-of-the-art for image classification task. Here we have briefly discussed different components of CNN. In this paper, We have explained different CNN architectures for image classification.…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Farhana Sultana , A. Sufian , Paramartha Dutta

While initially devised for image categorization, convolutional neural networks (CNNs) are being increasingly used for the pixelwise semantic labeling of images. However, the proper nature of the most common CNN architectures makes them…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Emmanuel Maggiori , Guillaume Charpiat , Yuliya Tarabalka , Pierre Alliez

We study the family of functions that are represented by a linear convolutional neural network (LCN). These functions form a semi-algebraic subset of the set of linear maps from input space to output space. In contrast, the families of…

Machine Learning · Computer Science 2022-06-09 Kathlén Kohn , Thomas Merkh , Guido Montúfar , Matthew Trager

The convolutional neural network (CNN) has become a basic model for solving many computer vision problems. In recent years, a new class of CNNs, recurrent convolution neural network (RCNN), inspired by abundant recurrent connections in the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Jianfeng Wang , Xiaolin Hu

In this paper we propose cross-modal convolutional neural networks (X-CNNs), a novel biologically inspired type of CNN architectures, treating gradient descent-specialised CNNs as individual units of processing in a larger-scale network…

Machine Learning · Statistics 2017-09-26 Petar Veličković , Duo Wang , Nicholas D. Lane , Pietro Liò