English
Related papers

Related papers: Suppressing the Unusual: towards Robust CNNs using…

200 papers

In Neural Networks (NN), Adaptive Activation Functions (AAF) have parameters that control the shapes of activation functions. These parameters are trained along with other parameters in the NN. AAFs have improved performance of Neural…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Le Hou , Dimitris Samaras , Tahsin M. Kurc , Yi Gao , Joel H. Saltz

Deep neural nets (DNNs) compression is crucial for adaptation to mobile devices. Though many successful algorithms exist to compress naturally trained DNNs, developing efficient and stable compression algorithms for robustly trained DNNs…

Machine Learning · Computer Science 2020-03-03 Thu Dinh , Bao Wang , Andrea L. Bertozzi , Stanley J. Osher

Supervised super-resolution deep convolutional neural networks (CNNs) have gained significant attention for their potential in reconstructing velocity and scalar fields in turbulent flows. Despite their popularity, CNNs currently lack the…

Robustness of convolutional neural networks (CNNs) has gained in importance on account of adversarial examples, i.e., inputs added as well-designed perturbations that are imperceptible to humans but can cause the model to predict…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Tiange Luo , Tianle Cai , Mengxiao Zhang , Siyu Chen , Di He , Liwei Wang

Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are useful for many practical tasks in machine learning. Synaptic weights, as well as neuron activation functions within the deep network are typically stored with…

Machine Learning · Computer Science 2017-11-15 Moritz B. Milde , Daniel Neil , Alessandro Aimar , Tobi Delbruck , Giacomo Indiveri

Convolutional neural networks (CNNs) are being applied to an increasing number of problems and fields due to their superior performance in classification and regression tasks. Since two of the key operations that CNNs implement are…

Machine Learning · Computer Science 2018-02-27 Fernando Gama , Geert Leus , Antonio G. Marques , Alejandro Ribeiro

Convolutional neural networks (CNNs) perform well on problems such as handwriting recognition and image classification. However, the performance of the networks is often limited by budget and time constraints, particularly when trying to…

Computer Vision and Pattern Recognition · Computer Science 2014-09-23 Benjamin Graham

The existence of adversarial attacks on convolutional neural networks (CNN) questions the fitness of such models for serious applications. The attacks manipulate an input image such that misclassification is evoked while still looking…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Mohammadreza Amirian , Friedhelm Schwenker , Thilo Stadelmann

Although convolutional neural network (CNN) has made great progress, large redundant parameters restrict its deployment on embedded devices, especially mobile devices. The recent compression works are focused on real-value convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Jiasong Wu , Hongshan Ren , Youyong Kong , Chunfeng Yang , Lotfi Senhadji , Huazhong Shu

While Convolutional Neural Networks (CNNs) trained for image and video super-resolution (SR) regularly achieve new state-of-the-art performance, they also suffer from significant drawbacks. One of their limitations is their lack of…

Image and Video Processing · Electrical Eng. & Systems 2020-06-16 Alice Lucas , Santiago Lopez-Tapia , Rafael Molina , Aggelos K. Katsaggelos

Convolutional Neural Networks (CNNs) have been widely applied. But as the CNNs grow, the number of arithmetic operations and memory footprint also increase. Furthermore, typical non-linear activation functions do not allow associativity of…

Machine Learning · Computer Science 2021-11-10 Eduardo Vera Sousa , Leandro A. F. Fernandes , Cristina Nader Vasconcelos

Convolutional neural networks (CNNs) are similar to "ordinary" neural networks in the sense that they are made up of hidden layers consisting of neurons with "learnable" parameters. These neurons receive inputs, performs a dot product, and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Abien Fred Agarap

This paper proposes an efficient unsupervised method for detecting relevant changes between two temporally different images of the same scene. A convolutional neural network (CNN) for semantic segmentation is implemented to extract…

Neural and Evolutionary Computing · Computer Science 2019-03-22 Kevin Louis de Jong , Anna Sergeevna Bosman

Deep Neural Networks (DNNs) have shown remarkable performance in a diverse range of machine learning applications. However, it is widely known that DNNs are vulnerable to simple adversarial perturbations, which causes the model to…

Machine Learning · Computer Science 2021-07-23 Gihyuk Ko , Gyumin Lim

Interferometric Synthetic Aperture Radar (InSAR) imagery based on microwaves reflected off ground targets is becoming increasingly important in remote sensing for ground movement estimation. However, the reflections are contaminated by…

Image and Video Processing · Electrical Eng. & Systems 2020-01-22 Subhayan Mukherjee , Aaron Zimmer , Xinyao Sun , Parwant Ghuman , Irene Cheng

State of the art Deep Neural Networks (DNN) can now achieve above human level accuracy on image classification tasks. However their outstanding performances come along with a complex inference mechanism making them arduously interpretable…

Machine Learning · Computer Science 2019-11-07 Fei Wu , Thomas Michel , Alexandre Briot

The Convolutional Neural Networks (CNNs) have emerged as a very powerful data dependent hierarchical feature extraction method. It is widely used in several computer vision problems. The CNNs learn the important visual features from…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jayendra Kantipudi , Shiv Ram Dubey , Soumendu Chakraborty

Recently, the generalization behavior of Convolutional Neural Networks (CNN) is gradually transparent through explanation techniques with the frequency components decomposition. However, the importance of the phase spectrum of the image for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Guangyao Chen , Peixi Peng , Li Ma , Jia Li , Lin Du , Yonghong Tian

In recent years, Graph Neural Networks (GNNs) have made significant advancements, particularly in tasks such as node classification, link prediction, and graph representation. However, challenges arise from biases that can be hidden not…

Machine Learning · Computer Science 2024-04-10 Mahdi Tavassoli Kejani , Fadi Dornaika , Jean-Michel Loubes

Simplicity bias is the concerning tendency of deep networks to over-depend on simple, weakly predictive features, to the exclusion of stronger, more complex features. This is exacerbated in real-world applications by limited training data…

Machine Learning · Computer Science 2023-06-07 Rishabh Tiwari , Pradeep Shenoy