English
Related papers

Related papers: Towards Frequency-Based Explanation for Robust CNN

200 papers

Despite the enormous success of artificial neural networks (ANNs) in many disciplines, the characterization of their computations and the origin of key properties such as generalization and robustness remain open questions. Recent…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Nikos Karantzas , Emma Besier , Josue Ortega Caro , Xaq Pitkow , Andreas S. Tolias , Ankit B. Patel , Fabio Anselmi

Convolutional neural networks (CNN) are generally designed with a heuristic initialization of network architecture and trained for a certain task. This often leads to overparametrization after learning and induces redundancy in the…

Machine Learning · Computer Science 2019-06-11 Rachana Sathish , Debdoot Sheet

Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly…

Image and Video Processing · Electrical Eng. & Systems 2018-09-27 Yunzhe Li , Yujia Xue , Lei Tian

Though Convolutional Neural Networks (CNNs) have surpassed human-level performance on tasks such as object classification and face verification, they can easily be fooled by adversarial attacks. These attacks add a small perturbation to the…

Machine Learning · Computer Science 2018-03-26 Rajeev Ranjan , Swami Sankaranarayanan , Carlos D. Castillo , Rama Chellappa

Although many fields have witnessed the superior performance brought about by deep learning, the robustness of neural networks remains an open issue. Specifically, a small adversarial perturbation on the input may cause the model to produce…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Binxiao Huang , Chaofan Tao , Rui Lin , Ngai Wong

We have developed an image-based convolutional neural network (CNN) that is applicable for quantitative time-resolved measurements of the fragmentation behavior of opaque brittle materials using ultra-high speed optical imaging. This model…

Materials Science · Physics 2024-07-19 Erwin Cazares , Brian E. Schuster

While convolutional neural networks (CNNs) have found wide adoption as state-of-the-art models for image-related tasks, their predictions are often highly sensitive to small input perturbations, which the human vision is robust against.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Stefan Sietzen , Mathias Lechner , Judy Borowski , Ramin Hasani , Manuela Waldner

Recent studies have shown that Deep Neural Networks (DNNs) are susceptible to adversarial attacks, with frequency-domain analysis underscoring the significance of high-frequency components in influencing model predictions. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Juanjuan Weng , Zhiming Luo , Shaozi Li

The paper presents a novel deep learning approach, which extracts latent information from trained Deep Neural Networks (DNNs) and derives concise representations that are analyzed in an effective, unified way for prediction purposes. It is…

Machine Learning · Computer Science 2020-09-22 D. Kollias , N. Bouas , Y. Vlaxos , V. Brillakis , M. Seferis , I. Kollia , L. Sukissian , J. Wingate , S. Kollias

Deep convolutional neural networks are susceptible to adversarial attacks. They can be easily deceived to give an incorrect output by adding a tiny perturbation to the input. This presents a great challenge in making CNNs robust against…

Machine Learning · Computer Science 2021-04-21 Yunrui Yu , Xitong Gao , Cheng-Zhong Xu

Transformer emerges as a powerful tool for visual recognition. In addition to demonstrating competitive performance on a broad range of visual benchmarks, recent works also argue that Transformers are much more robust than Convolutions…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Yutong Bai , Jieru Mei , Alan Yuille , Cihang Xie

We study performance characteristics of convolutional neural networks (CNN) for mobile computer vision systems. CNNs have proven to be a powerful and efficient approach to implement such systems. However, the system performance depends…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jussi Hanhirova , Teemu Kämäräinen , Sipi Seppälä , Matti Siekkinen , Vesa Hirvisalo , Antti Ylä-Jääski

We here present a stepping stone towards a deeper understanding of convolutional neural networks (CNNs) in the form of a theory of learning in linear CNNs. Through analyzing the gradient descent equations, we discover that the evolution of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Hannah Pinson , Joeri Lenaerts , Vincent Ginis

Deep convolutional neural networks (DCNNs) have rivaled humans on many visual tasks, yet they remain vulnerable to near-imperceptible perturbations generated by adversarial attacks. Recent work shows that aligning DCNN representations with…

Neurons and Cognition · Quantitative Biology 2026-05-07 Zhenan Shao , Tianyu Ren , Chengxiao Wang , Leyla Isik , Diane M. Beck

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

We propose a general framework called Network Dissection for quantifying the interpretability of latent representations of CNNs by evaluating the alignment between individual hidden units and a set of semantic concepts. Given any CNN model,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 David Bau , Bolei Zhou , Aditya Khosla , Aude Oliva , Antonio Torralba

Computer vision systems in real-world applications need to be robust to partial occlusion while also being explainable. In this work, we show that black-box deep convolutional neural networks (DCNNs) have only limited robustness to partial…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Adam Kortylewski , Qing Liu , Angtian Wang , Yihong Sun , Alan Yuille

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

2D convolution (Conv2d), which is responsible for extracting features from the input image, is one of the key modules of a convolutional neural network (CNN). However, Conv2d is vulnerable to image corruptions and adversarial samples. It is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Lida Li , Shuai Li , Kun Wang , Xiangchu Feng , Lei Zhang

Convolutional neural network (CNN) is one of the most widely-used successful architectures in the era of deep learning. However, the high-computational cost of CNN still hampers more universal uses to light devices. Fortunately, the Fourier…

Networking and Internet Architecture · Computer Science 2021-08-13 Xiaohan Zhu , Zhen Cui , Tong Zhang , Yong Li , Jian Yang