English
Related papers

Related papers: Absum: Simple Regularization Method for Reducing S…

200 papers

With the development of technology rapidly, applications of convolutional neural networks have improved the convenience of our life. However, in image classification field, it has been found that when some perturbations are added to images,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Yating Ma , Zhichao Lian

Convolution neural networks have achieved remarkable performance in many tasks of computing vision. However, CNN tends to bias to low frequency components. They prioritize capturing low frequency patterns which lead them fail when suffering…

Machine Learning · Computer Science 2020-07-08 Weiyu Guo , Yidong Ouyang

Neural networks can be fragile to input noise and adversarial attacks. In this work, we consider Convolutional Neural Ordinary Differential Equations (NODEs), a family of continuous-depth neural networks represented by dynamical systems,…

Machine Learning · Computer Science 2025-08-18 Muhammad Zakwan , Liang Xu , Giancarlo Ferrari-Trecate

Convolutional neural networks (CNNs), one of the key architectures of deep learning models, have achieved superior performance on many machine learning tasks such as image classification, video recognition, and power systems. Despite their…

Machine Learning · Computer Science 2024-07-17 Hanxiao Lu , Zeyu Huang , Ren Wang

Pruning is a well-known mechanism for reducing the computational cost of deep convolutional networks. However, studies have shown the potential of pruning as a form of regularization, which reduces overfitting and improves generalization.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Artur Jordao , Helio Pedrini

Whereas adversarial training is employed as the main defence strategy against specific adversarial samples, it has limited generalization capability and incurs excessive time complexity. In this paper, we propose an attack-agnostic defence…

Machine Learning · Computer Science 2020-05-07 Guanlin Li , Shuya Ding , Jun Luo , Chang Liu

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Convolutional Neural Networks (CNN) are known to exhibit poor generalization performance under distribution shifts. Their generalization have been studied extensively, and one line of work approaches the problem from a frequency-centric…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mehmet Kerim Yucel , Ramazan Gokberk Cinbis , Pinar Duygulu

Deep Neural Networks (DNNs) have revolutionized a wide range of industries, from healthcare and finance to automotive, by offering unparalleled capabilities in data analysis and decision-making. Despite their transforming impact, DNNs face…

Machine Learning · Computer Science 2024-02-08 Zhenyu Liu , Garrett Gagnon , Swagath Venkataramani , Liu Liu

Convolutional Neural Networks (CNNs) achieve strong image classification performance but lack interpretability and are vulnerable to adversarial attacks. Neuro-fuzzy hybrids such as DCNFIS replace fully connected CNN classifiers with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Kaaustaaub Shankar , Bharadwaj Dogga , Kelly Cohen

With the tremendous advances in the architecture and scale of convolutional neural networks (CNNs) over the past few decades, they can easily reach or even exceed the performance of humans in certain tasks. However, a recently discovered…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Yanxi Li , Zhaohui Yang , Yunhe Wang , Chang Xu

Regularization techniques are widely used to improve the generality, robustness, and efficiency of deep convolutional neural networks (DCNNs). In this paper, we propose a novel approach of regulating DCNN convolutional kernels by a…

Machine Learning · Computer Science 2019-11-28 Seyed Mehdi Ayyoubzadeh , Xiaolin Wu

Despite impressive performance on numerous visual tasks, Convolutional Neural Networks (CNNs) --- unlike brains --- are often highly sensitive to small perturbations of their input, e.g. adversarial noise leading to erroneous decisions. We…

Robustness of neural networks has recently been highlighted by the adversarial examples, i.e., inputs added with well-designed perturbations which are imperceptible to humans but can cause the network to give incorrect outputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Tiange Luo , Tianle Cai , Mengxiao Zhang , Siyu Chen , Liwei Wang

The vulnerability of neural network classifiers to adversarial attacks is a major obstacle to their deployment in safety-critical applications. Regularization of network parameters during training can be used to improve adversarial…

Machine Learning · Computer Science 2024-05-28 Sheng Yang , Jacob A. Zavatone-Veth , Cengiz Pehlevan

Convolutional neural networks (CNNs) often perform well, but their stability is poorly understood. To address this problem, we consider the simple prototypical problem of signal denoising, where classical approaches such as nonlinear…

Machine Learning · Computer Science 2020-06-09 Tobias Alt , Joachim Weickert , Pascal Peter

Deep neural networks are often not robust to semantically-irrelevant changes in the input. In this work we address the issue of robustness of state-of-the-art deep convolutional neural networks (CNNs) against commonly occurring distortions…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Nikhil Kapoor , Chun Yuan , Jonas Löhdefink , Roland Zimmermann , Serin Varghese , Fabian Hüger , Nico Schmidt , Peter Schlicht , Tim Fingscheidt

The convolutional neural network (CNN) is vulnerable to degraded images with even very small variations (e.g. corrupted and adversarial samples). One of the possible reasons is that CNN pays more attention to the most discriminative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Haozhe Liu , Haoqian Wu , Weicheng Xie , Feng Liu , Linlin Shen

Despite the considerable success of neural networks in security settings such as malware detection, such models have proved vulnerable to evasion attacks, in which attackers make slight changes to inputs (e.g., malware) to bypass detection.…

Machine Learning · Computer Science 2021-06-09 Netanel Raviv , Aidan Kelley , Michael Guo , Yevgeny Vorobeychik

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks. However, the phenomenon of robust overfitting, i.e., the robustness starts to decrease significantly…

Machine Learning · Computer Science 2021-12-23 Jihoon Tack , Sihyun Yu , Jongheon Jeong , Minseon Kim , Sung Ju Hwang , Jinwoo Shin