English
Related papers

Related papers: Adversarial Attacks on the Interpretation of Neuro…

200 papers

Mathematical optimization is widely used in various research fields. With a carefully-designed objective function, mathematical optimization can be quite helpful in solving many problems. However, objective functions are usually…

Machine Learning · Computer Science 2019-05-27 Younghan Jeon , Minsik Lee , Jin Young Choi

Opponent modeling is necessary in multi-agent settings where secondary agents with competing goals also adapt their strategies, yet it remains challenging because strategies interact with each other and change. Most previous work focuses on…

Machine Learning · Computer Science 2016-09-20 He He , Jordan Boyd-Graber , Kevin Kwok , Hal Daumé

Previous studies have found that an adversary attacker can often infer unintended input information from intermediate-layer features. We study the possibility of preventing such adversarial inference, yet without too much accuracy…

Machine Learning · Computer Science 2020-01-15 Liyao Xiang , Haotian Ma , Hao Zhang , Yifan Zhang , Jie Ren , Quanshi Zhang

In communication systems, there are many tasks, like modulation recognition, which rely on Deep Neural Networks (DNNs) models. However, these models have been shown to be susceptible to adversarial perturbations, namely imperceptible…

Signal Processing · Electrical Eng. & Systems 2021-05-31 Javier Maroto , Gérôme Bovet , Pascal Frossard

Interpretability aims to explain the behavior of deep neural networks. Despite rapid growth, there is mounting concern that much of this work has not translated into practical impact, raising questions about its relevance and utility. This…

DNN is presenting human-level performance for many complex intelligent tasks in real-world applications. However, it also introduces ever-increasing security concerns. For example, the emerging adversarial attacks indicate that even very…

Machine Learning · Computer Science 2018-03-21 Qi Liu , Tao Liu , Zihao Liu , Yanzhi Wang , Yier Jin , Wujie Wen

In recent years, deep learning has shown itself to be an incredibly valuable tool in cybersecurity as it helps network intrusion detection systems to classify attacks and detect new ones. Adversarial learning is the process of utilizing…

Cryptography and Security · Computer Science 2022-06-30 Jared Mathews , Prosenjit Chatterjee , Shankar Banik , Cory Nance

Deep learning has made tremendous advances in computer vision tasks such as image classification. However, recent studies have shown that deep learning models are vulnerable to specifically crafted adversarial inputs that are…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Kirthi Shankar Sivamani

Signalized intersections are managed by controllers that assign right of way (green, yellow, and red lights) to non-conflicting directions. Optimizing the actuation policy of such controllers is expected to alleviate traffic congestion and…

Machine Learning · Computer Science 2020-02-28 James Ault , Josiah P. Hanna , Guni Sharon

Reliable deployment of machine learning models such as neural networks continues to be challenging due to several limitations. Some of the main shortcomings are the lack of interpretability and the lack of robustness against adversarial…

Machine Learning · Computer Science 2025-02-18 Jon Vadillo , Roberto Santana , Jose A. Lozano

In human perception and cognition, a fundamental operation that brains perform is interpretation: constructing coherent neural states from noisy, incomplete, and intrinsically ambiguous evidence. The problem of interpretation is well…

Machine Learning · Computer Science 2019-09-30 Michael Iuzzolino , Yoram Singer , Michael C. Mozer

Model interpretability is a requirement in many applications in which crucial decisions are made by users relying on a model's outputs. The recent movement for "algorithmic fairness" also stipulates explainability, and therefore…

Machine Learning · Computer Science 2018-08-21 Xuan Liu , Xiaoguang Wang , Stan Matwin

We propose a general framework called Network Dissection for quantifying the interpretability of latent representations of CNNs by evaluating the alignment between individual hidden units and a set of semantic concepts. Given any CNN model,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 David Bau , Bolei Zhou , Aditya Khosla , Aude Oliva , Antonio Torralba

Recent studies have shown that deep neural networks (DNNs) are vulnerable to adversarial attacks. To this end, many defense approaches that attempt to improve the robustness of DNNs have been proposed. In a separate and yet related area,…

Machine Learning · Computer Science 2019-12-20 Adnan Siraj Rakin , Jinfeng Yi , Boqing Gong , Deliang Fan

Several machine learning models, including neural networks, consistently misclassify adversarial examples---inputs formed by applying small but intentionally worst-case perturbations to examples from the dataset, such that the perturbed…

Machine Learning · Statistics 2015-03-24 Ian J. Goodfellow , Jonathon Shlens , Christian Szegedy

The predictive power of neural networks often costs model interpretability. Several techniques have been developed for explaining model outputs in terms of input features; however, it is difficult to translate such interpretations into…

Machine Learning · Computer Science 2017-08-17 Benjamin J. Lengerich , Sandeep Konam , Eric P. Xing , Stephanie Rosenthal , Manuela Veloso

Graph neural networks (GNNs) have attracted increasing interests. With broad deployments of GNNs in real-world applications, there is an urgent need for understanding the robustness of GNNs under adversarial attacks, especially in realistic…

Machine Learning · Computer Science 2021-06-22 Jiaqi Ma , Junwei Deng , Qiaozhu Mei

Deep Neural Networks (DNNs) are commonly used for various traffic analysis problems, such as website fingerprinting and flow correlation, as they outperform traditional (e.g., statistical) techniques by large margins. However, deep neural…

Cryptography and Security · Computer Science 2020-02-18 Milad Nasr , Alireza Bahramali , Amir Houmansadr

Deep Learning algorithms have achieved the state-of-the-art performance for Image Classification and have been used even in security-critical applications, such as biometric recognition systems and self-driving cars. However, recent works…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Gabriel Resende Machado , Eugênio Silva , Ronaldo Ribeiro Goldschmidt

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso