English
Related papers

Related papers: Why You Should Not Trust Interpretations in Machin…

200 papers

Adversarial machine learning is a fast growing research area, which considers the scenarios when machine learning systems may face potential adversarial attackers, who intentionally synthesize input data to make a well-trained model to make…

Machine Learning · Computer Science 2018-10-24 Guofu Li , Pengjia Zhu , Jin Li , Zhemin Yang , Ning Cao , Zhiyi Chen

The rise of deep learning technique has raised new privacy concerns about the training data and test data. In this work, we investigate the model inversion problem in the adversarial settings, where the adversary aims at inferring…

Cryptography and Security · Computer Science 2019-02-25 Ziqi Yang , Ee-Chien Chang , Zhenkai Liang

Deep neural networks have demonstrated cutting edge performance on various tasks including classification. However, it is well known that adversarially designed imperceptible perturbation of the input can mislead advanced classifiers. In…

Machine Learning · Computer Science 2020-01-07 Mehdi Jafarnia-Jahromi , Tasmin Chowdhury , Hsin-Tai Wu , Sayandev Mukherjee

One major factor impeding more widespread adoption of deep neural networks (DNNs) is their lack of robustness, which is essential for safety-critical applications such as autonomous driving. This has motivated much recent work on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Abdullah Hamdi , Matthias Müller , Bernard Ghanem

Deep neural networks have been widely used in various downstream tasks, especially those safety-critical scenario such as autonomous driving, but deep networks are often threatened by adversarial samples. Such adversarial attacks can be…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yutong Zhang , Yao Li , Yin Li , Zhichang Guo

Interpretable machine learning models offer understandable reasoning behind their decision-making process, though they may not always match the performance of their black-box counterparts. This trade-off between interpretability and model…

Artificial Intelligence · Computer Science 2025-03-12 Pranjal Atrey , Michael P. Brundage , Min Wu , Sanghamitra Dutta

Adversarial imitation learning has become a popular framework for imitation in continuous control. Over the years, several variations of its components were proposed to enhance the performance of the learned policies as well as the sample…

Models can expose sensitive information about their training data. In an attribute inference attack, an adversary has partial knowledge of some training records and access to a model trained on those records, and infers the unknown values…

Cryptography and Security · Computer Science 2022-09-07 Bargav Jayaraman , David Evans

Attribution methods have been developed to explain the decision of a machine learning model on a given input. We use the Integrated Gradient method for finding attributions to define the causal neighborhood of an input by incrementally…

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

Machine Learning · Computer Science 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

Research has shown that widely used deep neural networks are vulnerable to carefully crafted adversarial perturbations. Moreover, these adversarial perturbations often transfer across models. We hypothesize that adversarial weakness is…

Machine Learning · Statistics 2019-06-24 Horace He , Aaron Lou , Qingxuan Jiang , Isay Katsman , Serge Belongie , Ser-Nam Lim

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

Adversarial machine learning is a well-studied field of research where an adversary causes predictable errors in a machine learning algorithm through precise manipulation of the input. Numerous techniques have been proposed to harden…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Pratik Vaishnavi , Kevin Eykholt , Atul Prakash , Amir Rahmati

Deep neural networks (DNNs) have demonstrated impressive performance on a wide array of tasks, but they are usually considered opaque since internal structure and learned parameters are not interpretable. In this paper, we re-examine the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Yinpeng Dong , Hang Su , Jun Zhu , Fan Bao

Understanding the actions of both humans and artificial intelligence (AI) agents is important before modern AI systems can be fully integrated into our daily life. In this paper, we show that, despite their current huge success, deep…

Artificial Intelligence · Computer Science 2021-01-19 Nodens Koren , Qiuhong Ke , Yisen Wang , James Bailey , Xingjun Ma

Reinforcement learning policies based on deep neural networks are vulnerable to imperceptible adversarial perturbations to their inputs, in much the same way as neural network image classifiers. Recent work has proposed several methods to…

Machine Learning · Computer Science 2021-08-31 Ezgi Korkmaz

DL-based automatic modulation classification (AMC) models are highly susceptible to adversarial attacks, where even minimal input perturbations can cause severe misclassifications. While adversarially training an AMC model based on an…

Machine Learning · Computer Science 2025-01-06 Amirmohammad Bamdad , Ali Owfi , Fatemeh Afghah

Adversarial attacks on machine learning algorithms have been a key deterrent to the adoption of AI in many real-world use cases. They significantly undermine the ability of high-performance neural networks by forcing misclassifications.…

Machine Learning · Computer Science 2024-04-04 Nandish Chattopadhyay , Atreya Goswami , Anupam Chattopadhyay

Interpretable machine learning has become a strong competitor for traditional black-box models. However, the possible loss of the predictive performance for gaining interpretability is often inevitable, putting practitioners in a dilemma of…

Machine Learning · Computer Science 2019-05-13 Tong Wang , Qihang Lin

Explainability is motivated by the lack of transparency of black-box Machine Learning approaches, which do not foster trust and acceptance of Machine Learning algorithms. This also happens in the Predictive Process Monitoring field, where…

Artificial Intelligence · Computer Science 2025-07-25 Williams Rizzi , Marco Comuzzi , Chiara Di Francescomarino , Chiara Ghidini , Suhwan Lee , Fabrizio Maria Maggi , Alexander Nolte
‹ Prev 1 8 9 10 Next ›