中文
相关论文

相关论文: Scalable Lipschitz Estimation for CNNs

200 篇论文

In this paper, we introduce convolutional proximal neural networks (cPNNs), which are by construction averaged operators. For filters of full length, we propose a stochastic gradient descent algorithm on a submanifold of the Stiefel…

最优化与控制 · 数学 2024-08-13 Johannes Hertrich , Sebastian Neumayer , Gabriele Steidl

We introduce Parseval networks, a form of deep neural networks in which the Lipschitz constant of linear, convolutional and aggregation layers is constrained to be smaller than 1. Parseval networks are empirically and theoretically…

机器学习 · 统计学 2017-08-08 Moustapha Cisse , Piotr Bojanowski , Edouard Grave , Yann Dauphin , Nicolas Usunier

Robustness certification against bounded input noise or adversarial perturbations is increasingly important for deployment recurrent neural networks (RNNs) in safety-critical control applications. To address this challenge, we present…

系统与控制 · 电气工程与系统科学 2025-09-23 Paul Hamelbeck , Johannes Schiffer

In this paper we present a methodology that uses convolutional neural networks (CNNs) for segmentation by iteratively growing predicted mask regions in each coordinate direction. The CNN is used to predict class probability scores in a…

图像与视频处理 · 电气工程与系统科学 2020-09-25 John Lagergren , Erica Rutter , Kevin Flores

Convolutional neural networks (CNNs) have been shown to achieve optimal approximation and estimation error rates (in minimax sense) in several function classes. However, previous analyzed optimal CNNs are unrealistically wide and difficult…

机器学习 · 统计学 2023-08-15 Kenta Oono , Taiji Suzuki

Recently, Convolutional Neural Networks (CNNs) have been widely used to solve the illuminant estimation problem and have often led to state-of-the-art results. Standard approaches operate directly on the input image. In this paper, we argue…

图像与视频处理 · 电气工程与系统科学 2021-11-11 Firas Laakom , Jenni Raitoharju , Jarno Nikkanen , Alexandros Iosifidis , Moncef Gabbouj

Conventional deep convolutional neural networks (CNNs) apply convolution operators uniformly in space across all feature maps for hundreds of layers - this incurs a high computational cost for real-time applications. For many problems such…

计算机视觉与模式识别 · 计算机科学 2018-06-08 Mengye Ren , Andrei Pokrovsky , Bin Yang , Raquel Urtasun

The Lipschitz bound, a technique from robust statistics, can limit the maximum changes in the output concerning the input, taking into account associated irrelevant biased factors. It is an efficient and provable method for examining the…

机器学习 · 计算机科学 2023-12-13 Yaning Jia , Chunhui Zhang

The usage of convolutional neural networks (CNNs) for unsupervised image segmentation was investigated in this study. In the proposed approach, label prediction and network parameter learning are alternately iterated to meet the following…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Wonjik Kim , Asako Kanezaki , Masayuki Tanaka

Convolutional neural network (CNN) approaches available in the current literature are designed to work primarily with low-resolution images. When applied on very large images, challenges related to GPU memory, smaller receptive field than…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Deepak K. Gupta , Udbhav Bamba , Abhishek Thakur , Akash Gupta , Suraj Sharan , Ertugrul Demir , Dilip K. Prasad

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

计算机视觉与模式识别 · 计算机科学 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

Deeper and wider CNNs are known to provide improved performance for deep learning tasks. However, most such networks have poor performance gain per parameter increase. In this paper, we investigate whether the gain observed in deeper models…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Arnav Chavan , Udbhav Bamba , Rishabh Tiwari , Deepak Gupta

Convolutional neural networks (CNNs) show outstanding performance in many image processing problems, such as image recognition, object detection and image segmentation. Semantic segmentation is a very challenging task that requires…

计算机视觉与模式识别 · 计算机科学 2019-07-12 Fan Jia , Jun Liu , Xue-cheng Tai

Convolutional neural networks (CNN) are capable of learning robust representation with different regularization methods and activations as convolutional layers are spatially correlated. Based on this property, a large variety of regional…

计算机视觉与模式识别 · 计算机科学 2020-04-07 Devesh Walawalkar , Zhiqiang Shen , Zechun Liu , Marios Savvides

Convolutional Neural Network(CNN) has been widely used for image recognition with great success. However, there are a number of limitations of the current CNN based image recognition paradigm. First, the receptive field of CNN is generally…

计算机视觉与模式识别 · 计算机科学 2018-03-28 Dong-Qing Zhang

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

机器学习 · 计算机科学 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

Despite the significant success of deep learning in computer vision tasks, cross-domain tasks still present a challenge in which the model's performance will degrade when the training set and the test set follow different distributions.…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Lei Qi , Dongjia Zhao , Yinghuan Shi , Xin Geng

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

神经与进化计算 · 计算机科学 2019-10-16 Filip Badan , Lukas Sekanina

Deep Convolutional Neural Networks (CNN) have been successfully applied to many real-life problems. However, the huge memory cost of deep CNN models poses a great challenge of deploying them on memory-constrained devices (e.g., mobile…

计算机视觉与模式识别 · 计算机科学 2020-10-07 Weichao Lan , Liang Lan

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

机器学习 · 计算机科学 2024-01-17 Soyed Tuhin Ahmed