English
Related papers

Related papers: Suppressing the Unusual: towards Robust CNNs using…

200 papers

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

Machine Learning · Computer Science 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

Capsule network has shown various advantages over convolutional neural network (CNN). It keeps more precise spatial information than CNN and uses equivariance instead of invariance during inference and highly potential to be a new effective…

Machine Learning · Computer Science 2019-05-06 Zonglin Yang , Xinggang Wang

We theoretically discuss why deep neural networks (DNNs) performs better than other models in some cases by investigating statistical properties of DNNs for non-smooth functions. While DNNs have empirically shown higher performance than…

Machine Learning · Statistics 2018-07-10 Masaaki Imaizumi , Kenji Fukumizu

Deep neural networks (DNNs) are increasingly being used in a variety of traditional radiofrequency (RF) problems. Previous work has shown that while DNN classifiers are typically more accurate than traditional signal processing algorithms,…

Cryptography and Security · Computer Science 2022-02-24 Roman A. Sandler , Peter K. Relich , Cloud Cho , Sean Holloway

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Convolutional Neural Networks (CNNs) define an exceptionally powerful class of models for image classification, but the theoretical background and the understanding of how invariances to certain transformations are learned is limited. In a…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Charlotte Bunne , Lukas Rahmann , Thomas Wolf

Deep convolutional neural network (DCNN for short) models are vulnerable to examples with small perturbations. Adversarial training (AT for short) is a widely used approach to enhance the robustness of DCNN models by data augmentation. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Jin Ding , Jie-Chao Zhao , Yong-Zhi Sun , Ping Tan , Ji-En Ma , You-Tong Fang

Robustness of neural networks has recently been highlighted by the adversarial examples, i.e., inputs added with well-designed perturbations which are imperceptible to humans but can cause the network to give incorrect outputs. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Tiange Luo , Tianle Cai , Mengxiao Zhang , Siyu Chen , Liwei Wang

Deep neural networks (DNNs), particularly those using Rectified Linear Unit (ReLU) activation functions, have achieved remarkable success across diverse machine learning tasks, including image recognition, audio processing, and language…

Machine Learning · Computer Science 2026-03-26 Emi Zeger , Mert Pilanci

Radio spectrum monitoring in contested environments motivates the need for reliable automatic signal classification technology. Prior work highlights deep learning as a promising approach, but existing models depend on brute-force Doppler…

Signal Processing · Electrical Eng. & Systems 2025-11-19 Avi Bagchi , Dwight Hutchenson

We propose Absum, which is a regularization method for improving adversarial robustness of convolutional neural networks (CNNs). Although CNNs can accurately recognize images, recent studies have shown that the convolution operations in…

Machine Learning · Statistics 2019-09-20 Sekitoshi Kanai , Yasutoshi Ida , Yasuhiro Fujiwara , Masanori Yamada , Shuichi Adachi

Deep learning models are widely employed in safety-critical applications yet remain susceptible to adversarial attacks -- imperceptible perturbations that can significantly degrade model performance. Conventional defense mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Eylon Mizrahi , Raz Lapid , Moshe Sipper

Convolution neural networks have achieved remarkable performance in many tasks of computing vision. However, CNN tends to bias to low frequency components. They prioritize capturing low frequency patterns which lead them fail when suffering…

Machine Learning · Computer Science 2020-07-08 Weiyu Guo , Yidong Ouyang

Deep neural networks (DNN) have been shown to be useful in a wide range of applications. However, they are also known to be vulnerable to adversarial samples. By transforming a normal sample with some carefully crafted human imperceptible…

Machine Learning · Computer Science 2019-11-22 Jingyi Wang , Guoliang Dong , Jun Sun , Xinyu Wang , Peixin Zhang

Deep neural networks are often not robust to semantically-irrelevant changes in the input. In this work we address the issue of robustness of state-of-the-art deep convolutional neural networks (CNNs) against commonly occurring distortions…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Nikhil Kapoor , Chun Yuan , Jonas Löhdefink , Roland Zimmermann , Serin Varghese , Fabian Hüger , Nico Schmidt , Peter Schlicht , Tim Fingscheidt

To improve the robustness of subband adaptive filter (SAF) against impulsive interferences, we propose two modified SAF algorithms with an individual scale function for each subband, which are derived by maximizing correntropy-based cost…

Other Computer Science · Computer Science 2017-06-30 Yi Yu , Haiquan Zhao , Badong Chen , Zhengyou He

Convolutional Neural Networks (CNNs) have made significant progress on several computer vision benchmarks, but are fraught with numerous non-human biases such as vulnerability to adversarial samples. Their lack of explainability makes…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Malhar Jere , Maghav Kumar , Farinaz Koushanfar

Deep neural networks (DNNs) excel on clean images but struggle with corrupted ones. Incorporating specific corruptions into the data augmentation pipeline can improve robustness to those corruptions but may harm performance on clean images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Trung Trinh , Markus Heinonen , Luigi Acerbi , Samuel Kaski

Complex-valued neural networks (CVNNs) are a powerful modeling tool for domains where data can be naturally interpreted in terms of complex numbers. However, several analytical properties of the complex domain (e.g., holomorphicity) make…

Neural and Evolutionary Computing · Computer Science 2018-02-23 Simone Scardapane , Steven Van Vaerenbergh , Amir Hussain , Aurelio Uncini