中文
相关论文

相关论文: Regularized adversarial examples for model interpr…

200 篇论文

Neural networks are known to be vulnerable to adversarial examples, inputs that have been intentionally perturbed to remain visually similar to the source input, but cause a misclassification. It was recently shown that given a dataset and…

密码学与安全 · 计算机科学 2018-01-08 Jamie Hayes , George Danezis

The trade-off between accuracy and interpretability has long been a challenge in machine learning (ML). This tension is particularly significant for emerging interpretable-by-design methods, which aim to redesign ML algorithms for…

机器学习 · 计算机科学 2025-05-28 Geyu Liang , Senne Michielssen , Salar Fattahi

Neural Image Classifiers are effective but inherently hard to interpret and susceptible to adversarial attacks. Solutions to both problems exist, among others, in the form of counterfactual examples generation to enhance explainability or…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Rafael Bischof , Florian Scheidegger , Michael A. Kraus , A. Cristiano I. Malossi

Attribution methods have been developed to explain the decision of a machine learning model on a given input. We use the Integrated Gradient method for finding attributions to define the causal neighborhood of an input by incrementally…

The popularity of machine learning has increased the risk of unfair models getting deployed in high-stake applications, such as justice system, drug/vaccination design, and medical diagnosis. Although there are effective methods to train…

机器学习 · 计算机科学 2022-07-14 Mohit Bajaj , Lingyang Chu , Vittorio Romaniello , Gursimran Singh , Jian Pei , Zirui Zhou , Lanjun Wang , Yong Zhang

Counterfactual explanations (CEs) are a practical tool for demonstrating why machine learning classifiers make particular decisions. For CEs to be useful, it is important that they are easy for users to interpret. Existing methods for…

机器学习 · 计算机科学 2021-03-17 Lisa Schut , Oscar Key , Rory McGrath , Luca Costabello , Bogdan Sacaleanu , Medb Corcoran , Yarin Gal

While recent works have been considerably improving the quality of the natural language explanations (NLEs) generated by a model to justify its predictions, there is very limited research in detecting and alleviating inconsistencies among…

It has been observed that deep learning architectures tend to make erroneous decisions with high reliability for particularly designed adversarial instances. In this work, we show that the perturbation analysis of these architectures…

机器学习 · 计算机科学 2018-12-05 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

Over the last few years, the phenomenon of adversarial examples --- maliciously constructed inputs that fool trained machine learning models --- has captured the attention of the research community, especially when the adversary is…

机器学习 · 计算机科学 2019-01-31 Nic Ford , Justin Gilmer , Nicolas Carlini , Dogus Cubuk

Neural networks have demonstrated state-of-the-art performance in various machine learning fields. However, the introduction of malicious perturbations in input data, known as adversarial examples, has been shown to deceive neural network…

机器学习 · 计算机科学 2023-02-06 Dennis Y. Menn , Tzu-hsun Feng , Hung-yi Lee

Neural networks are known to be vulnerable to adversarial examples: inputs that are close to natural inputs but classified incorrectly. In order to better understand the space of adversarial examples, we survey ten recent proposals that are…

机器学习 · 计算机科学 2017-11-02 Nicholas Carlini , David Wagner

This thesis explores the generation of local explanations for already deployed machine learning models, aiming to identify optimal conditions for producing meaningful explanations considering both data and user requirements. The primary…

人工智能 · 计算机科学 2024-02-19 julien Delaunay

Adversarial examples are carefully crafted attack points that are supposed to fool machine learning classifiers. In the last years, the field of adversarial machine learning, especially the study of perturbation-based adversarial examples,…

机器学习 · 计算机科学 2023-09-19 Roland Rauter , Martin Nocker , Florian Merkle , Pascal Schöttle

Adversarial examples are typically constructed by perturbing an existing data point within a small matrix norm, and current defense methods are focused on guarding against this type of attack. In this paper, we propose unrestricted…

机器学习 · 计算机科学 2018-12-04 Yang Song , Rui Shu , Nate Kushman , Stefano Ermon

Counterfactual explanations promote explainability in machine learning models by answering the question "how should an input instance be perturbed to obtain a desired predicted label?". The comparison of this instance before and after…

机器学习 · 计算机科学 2022-11-09 Jing Ma , Ruocheng Guo , Saumitra Mishra , Aidong Zhang , Jundong Li

There has been an increased interest in the application of convolutional neural networks for image based malware classification, but the susceptibility of neural networks to adversarial examples allows malicious actors to evade classifiers.…

密码学与安全 · 计算机科学 2020-06-24 Daniel Park , Haidar Khan , Bülent Yener

Understanding adversarial examples is crucial for improving model robustness, as they introduce imperceptible perturbations to deceive models. Effective adversarial examples, therefore, offer the potential to train more robust models by…

机器学习 · 计算机科学 2025-04-15 Xinheng Xie , Yue Wu , Cuiyu He

With the recent advances of open-domain story generation, the lack of reliable automatic evaluation metrics becomes an increasingly imperative issue that hinders the fast development of story generation. According to conducted researches in…

计算与语言 · 计算机科学 2021-05-27 Sarik Ghazarian , Zixi Liu , Akash SM , Ralph Weischedel , Aram Galstyan , Nanyun Peng

Adversarial evaluation stress tests a model's understanding of natural language. While past approaches expose superficial patterns, the resulting adversarial examples are limited in complexity and diversity. We propose human-in-the-loop…

计算与语言 · 计算机科学 2019-07-17 Eric Wallace , Pedro Rodriguez , Shi Feng , Ikuya Yamada , Jordan Boyd-Graber

It is well known that carefully crafted imperceptible perturbations can cause state-of-the-art deep learning classification models to misclassify. Understanding and analyzing these adversarial perturbations play a crucial role in the design…

图像与视频处理 · 电气工程与系统科学 2023-08-08 P Charantej Reddy , Aditya Siripuram , Sumohana S. Channappayya