English
Related papers

Related papers: Suppressing the Unusual: towards Robust CNNs using…

200 papers

Due to the veracity and heterogeneity in network traffic, detecting anomalous events is challenging. The computational load on global servers is a significant challenge in terms of efficiency, accuracy, and scalability. Our primary…

Machine Learning · Computer Science 2023-03-15 William Marfo , Deepak K. Tosh , Shirley V. Moore

Deep neural networks have achieved human-level accuracy on almost all perceptual benchmarks. It is interesting that these advances were made using two ideas that are decades old: (a) an artificial neuron based on a linear summator and (b)…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Sergey Bochkanov

Facial attributes, emerging soft biometrics, must be automatically and reliably extracted from images in order to be usable in stand-alone systems. While recent methods extract facial attributes using deep neural networks (DNNs) trained on…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Andras Rozsa , Manuel Günther , Ethan M. Rudd , Terrance E. Boult

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

Machine Learning · Computer Science 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

We propose a detector of adversarial samples that is based on the view of neural networks as discrete dynamic systems. The detector tells clean inputs from abnormal ones by comparing the discrete vector fields they follow through the…

Machine Learning · Computer Science 2023-06-09 Skander Karkar , Patrick Gallinari , Alain Rakotomamonjy

Perturbations targeting the graph structure have proven to be extremely effective in reducing the performance of Graph Neural Networks (GNNs), and traditional defenses such as adversarial training do not seem to be able to improve…

Machine Learning · Computer Science 2020-10-30 Simon Geisler , Daniel Zügner , Stephan Günnemann

Convolutional neural networks (CNNs) achieve translational invariance by using pooling operations. However, the operations do not preserve the spatial relationships in the learned representations. Hence, CNNs cannot extrapolate to various…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Jindong Gu , Volker Tresp

We show that the representation of an image in a deep neural network (DNN) can be manipulated to mimic those of other natural images, with only minor, imperceptible perturbations to the original image. Previous methods for generating…

Computer Vision and Pattern Recognition · Computer Science 2016-03-07 Sara Sabour , Yanshuai Cao , Fartash Faghri , David J. Fleet

Deep convolutional neural networks (CNNs) have been successful in many tasks in machine vision, however, millions of weights in the form of thousands of convolutional filters in CNNs makes them difficult for human intepretation or…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Reza Abbasi-Asl , Bin Yu

Defect detection is a critical research area in artificial intelligence. Recently, synthetic data-based self-supervised learning has shown great potential on this task. Although many sophisticated synthesizing strategies exist, little…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yuxuan Cai , Dingkang Liang , Dongliang Luo , Xinwei He , Xin Yang , Xiang Bai

While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hong Wang , Yuefan Deng , Shinjae Yoo , Yuewei Lin

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

We propose reproducing activation functions (RAFs) to improve deep learning accuracy for various applications ranging from computer vision to scientific computing. The idea is to employ several basic functions and their learnable linear…

Machine Learning · Computer Science 2021-02-23 Senwei Liang , Liyao Lyu , Chunmei Wang , Haizhao Yang

Recent studies suggest that artificial neural networks (ANNs) that match the spectral properties of the mammalian visual cortex -- namely, the $\sim 1/n$ eigenspectrum of the covariance matrix of neural activities -- achieve higher object…

Machine Learning · Computer Science 2022-08-24 Richard C. Gerum , Cassidy Pirlot , Alona Fyshe , Joel Zylberberg

Adjoint operators have been found to be effective in the exploration of CNN's inner workings [1]. However, the previous no-bias assumption restricted its generalization. We overcome the restriction via embedding input images into an…

Machine Learning · Computer Science 2023-11-10 Qing Wan , Siu Wun Cheung , Yoonsuck Choe

Deep convolutional neural networks achieve excellent image up-sampling performance. However, CNN-based methods tend to restore high-resolution results highly depending on traditional interpolations (e.g. bicubic). In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Bolun Cai , Xiangmin Xu , Kailing Guo , Kui Jia , Dacheng Tao

Despite the success of convolutional neural networks (CNNs) in many computer vision and image analysis tasks, they remain vulnerable against so-called adversarial attacks: Small, crafted perturbations in the input images can lead to false…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Paula Harder , Franz-Josef Pfreundt , Margret Keuper , Janis Keuper

Deep neural networks are susceptible to \emph{adversarial} attacks. In computer vision, well-crafted perturbations to images can cause neural networks to make mistakes such as confusing a cat with a computer. Previous adversarial attacks…

Machine Learning · Computer Science 2019-09-12 Gamaleldin F. Elsayed , Ian Goodfellow , Jascha Sohl-Dickstein

Deep convolutional neural networks (CNNs) have delivered superior performance in many computer vision tasks. In this paper, we propose a novel deep fully convolutional network model for accurate salient object detection. The key…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Pingping Zhang , Dong Wang , Huchuan Lu , Hongyu Wang , Baocai Yin

We introduce a novel scheme to train binary convolutional neural networks (CNNs) -- CNNs with weights and activations constrained to {-1,+1} at run-time. It has been known that using binary weights and activations drastically reduce memory…

Machine Learning · Computer Science 2017-12-01 Xiaofan Lin , Cong Zhao , Wei Pan