English
Related papers

Related papers: Scalable Lipschitz Estimation for CNNs

200 papers

The use of neural networks for diagnosis classification is becoming more and more prevalent in the medical imaging community. However, deep learning method outputs remain hard to explain. Another difficulty is to choose among the large…

Image and Video Processing · Electrical Eng. & Systems 2020-02-11 Elina Thibeau Sutre , Olivier Colliot , Didier Dormont , Ninon Burgos

Backpropagation (BP) is the standard algorithm for training the deep neural networks that power modern artificial intelligence including large language models. However, BP is energy inefficient and unlikely to be implemented by the brain.…

Machine Learning · Computer Science 2025-10-30 Francesco Innocenti

Partition-wise models offer a flexible approach for modeling complex and multidimensional data that are capable of producing interpretable results. They are based on partitioning the observed data into regions, each of which is modeled with…

Methodology · Statistics 2017-06-07 Rex C. Y. Cheung , Alexander Aue , Thomas C. M. Lee

Steerable convolutional neural networks (SCNNs) enhance task performance by modelling geometric symmetries through equivariance constraints on weights. Yet, unknown or varying symmetries can lead to overconstrained weights and decreased…

Machine Learning · Computer Science 2025-05-09 Lars Veefkind , Gabriele Cesa

Empirical studies have widely demonstrated that neural networks are highly sensitive to small, adversarial perturbations of the input. The worst-case robustness against these so-called adversarial examples can be quantified by the Lipschitz…

Machine Learning · Statistics 2025-07-03 Paul Geuchen , Dominik Stöger , Thomas Telaar , Felix Voigtlaender

We study the effect of injecting local scale equivariance into Convolutional Neural Networks. This is done by applying each convolutional filter at multiple scales. The output is a vector field encoding for the maximally activating scale…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Diego Marcos , Benjamin Kellenberger , Sylvain Lobry , Devis Tuia

Deep convolutional neural networks (CNNs) are usually over-parameterized, which cannot be easily deployed on edge devices such as mobile phones and smart cameras. Existing works used to decrease the number or size of requested convolution…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Kai Han , Yunhe Wang , Yixing Xu , Chunjing Xu , Dacheng Tao , Chang Xu

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

Image and Video Processing · Electrical Eng. & Systems 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang

Leveraging large data sets, deep Convolutional Neural Networks (CNNs) achieve state-of-the-art recognition accuracy. Due to the substantial compute and memory operations, however, they require significant execution time. The massive…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-13 Chao Li , Yi Yang , Min Feng , Srimat Chakradhar , Huiyang Zhou

Convolutional neural networks (CNNs) have a large number of variables and hence suffer from a complexity problem for their implementation. Different methods and techniques have developed to alleviate the problem of CNN's complexity, such as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Kamran Chitsaz , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

Graph neural networks (GNNs) have recently been demonstrated to perform well on a variety of network-based tasks such as decentralized control and resource allocation, and provide computationally efficient methods for these tasks which have…

Machine Learning · Computer Science 2021-12-15 Raghu Arghal , Eric Lei , Shirin Saeedi Bidokhti

Deep convolutional neural networks (CNNs) are broadly considered to be state-of-the-art generic end-to-end image classification systems. However, they are known to underperform when training data are limited and thus require data…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Mohammad Shifat E Rabbi , Yan Zhuang , Shiying Li , Abu Hasnat Mohammad Rubaiyat , Xuwang Yin , Gustavo K. Rohde

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

In most computer vision applications, convolutional neural networks (CNNs) operate on dense image data generated by ordinary cameras. Designing CNNs for sparse and irregularly spaced input data is still an open problem with numerous…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Abdelrahman Eldesokey , Michael Felsberg , Fahad Shahbaz Khan

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

We examine the impact of learning Lipschitz continuous models in the context of model-based reinforcement learning. We provide a novel bound on multi-step prediction error of Lipschitz models where we quantify the error using the…

Machine Learning · Computer Science 2018-07-30 Kavosh Asadi , Dipendra Misra , Michael L. Littman

In this work we establish the relation between optimal control and training deep Convolution Neural Networks (CNNs). We show that the forward propagation in CNNs can be interpreted as a time-dependent nonlinear differential equation and…

Neural and Evolutionary Computing · Computer Science 2017-06-23 Eldad Haber , Lars Ruthotto , Elliot Holtham , Seong-Hwan Jun

Deepfake detection methods based on convolutional neural networks (CNN) have demonstrated high accuracy. \textcolor{black}{However, these methods often suffer from decreased performance when faced with unknown forgery methods and common…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Sitong Liu , Zhichao Lian , Siqi Gu , Liang Xiao

Deep Convolutional Neural Networks (CNNs) have demonstrated excellent performance in image classification, but still show room for improvement in object-detection tasks with many categories, in particular for cluttered scenes and occlusion.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-24 Nikolaos Karianakis , Thomas J. Fuchs , Stefano Soatto

Many state-of-the-art computer vision algorithms use large scale convolutional neural networks (CNNs) as basic building blocks. These CNNs are known for their huge number of parameters, high redundancy in weights, and tremendous computing…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Qiangui Huang , Kevin Zhou , Suya You , Ulrich Neumann