中文
相关论文

相关论文: Explainability-Guided Defense: Attribution-Aware M…

200 篇论文

Adversarial robust models have been shown to learn more robust and interpretable features than standard trained models. As shown in [\cite{tsipras2018robustness}], such robust models inherit useful interpretable properties where the…

计算机视觉与模式识别 · 计算机科学 2020-05-05 Gunjan Aggarwal , Abhishek Sinha , Nupur Kumari , Mayank Singh

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

机器学习 · 计算机科学 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Interpretability is an emerging area of research in trustworthy machine learning. Safe deployment of machine learning system mandates that the prediction and its explanation be reliable and robust. Recently, it has been shown that the…

计算机视觉与模式识别 · 计算机科学 2020-07-21 Mayank Singh , Nupur Kumari , Puneet Mangla , Abhishek Sinha , Vineeth N Balasubramanian , Balaji Krishnamurthy

Previous adversarial training raises model robustness under the compromise of accuracy on natural data. In this paper, we reduce natural accuracy degradation. We use the model logits from one clean model to guide learning of another one…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Jiequan Cui , Shu Liu , Liwei Wang , Jiaya Jia

Adversarial training and its variants have become de facto standards for learning robust deep neural networks. In this paper, we explore the landscape around adversarial training in a bid to uncover its limits. We systematically study the…

机器学习 · 统计学 2021-03-31 Sven Gowal , Chongli Qin , Jonathan Uesato , Timothy Mann , Pushmeet Kohli

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

机器学习 · 计算机科学 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

Deep Learning models are highly susceptible to adversarial manipulations that can lead to catastrophic consequences. One of the most effective methods to defend against such disturbances is adversarial training but at the cost of…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Samuel Henrique Silva , Arun Das , Ian Scarff , Peyman Najafirad

Deep neural networks for medical image classification often fail to generalize consistently in clinical practice due to violations of the i.i.d. assumption and opaque decision-making. This paper examines interpretability in deep neural…

Adversarial attacks exploit the vulnerabilities of convolutional neural networks by introducing imperceptible perturbations that lead to misclassifications, exposing weaknesses in feature representations and decision boundaries. This paper…

机器学习 · 计算机科学 2024-12-30 Longwei Wang , Navid Nayyem , Abdullah Rakin

Local explanation methods such as LIME have become popular in MIR as tools for generating post-hoc, model-agnostic explanations of a model's classification decisions. The basic idea is to identify a small set of human-understandable…

音频与语音处理 · 电气工程与系统科学 2021-09-07 Verena Praher , Katharina Prinz , Arthur Flexer , Gerhard Widmer

Pretrained models from self-supervision are prevalently used in fine-tuning downstream tasks faster or for better accuracy. However, gaining robustness from pretraining is left unexplored. We introduce adversarial training into…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Tianlong Chen , Sijia Liu , Shiyu Chang , Yu Cheng , Lisa Amini , Zhangyang Wang

Deep neural networks are known to be vulnerable to adversarial attacks. Current methods of defense from such attacks are based on either implicit or explicit regularization, e.g., adversarial training. Randomized smoothing, the averaging of…

The phenomenon of adversarial examples in deep learning models has caused substantial concern over their reliability. While many deep neural networks have shown impressive performance in terms of predictive accuracy, it has been shown that…

机器学习 · 计算机科学 2021-06-28 Sadia Chowdhury , Ruth Urner

Active learning has long been a topic of study in machine learning. However, as increasingly complex and opaque models have become standard practice, the process of active learning, too, has become more opaque. There has been little…

机器学习 · 统计学 2018-06-26 Richard L. Phillips , Kyu Hyun Chang , Sorelle A. Friedler

While deep learning makes significant achievements in Artificial Intelligence (AI), the lack of transparency has limited its broad application in various vertical domains. Explainability is not only a gateway between AI and real world, but…

机器学习 · 计算机科学 2020-04-28 Sheng Shi , Yangzhou Du , Wei Fan

The robustness of Vision-Language Models (VLMs) such as CLIP is critical for their deployment in safety-critical applications like autonomous driving, healthcare diagnostics, and security systems, where accurate interpretation of visual and…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Yuhan Liang , Yijun Li , Yumeng Niu , Qianhe Shen , Hangyu Liu

Despite their appealing flexibility, deep neural networks (DNNs) are vulnerable against adversarial examples. Various adversarial defense strategies have been proposed to resolve this problem, but they typically demonstrate restricted…

机器学习 · 计算机科学 2021-06-01 Zhijie Deng , Xiao Yang , Shizhen Xu , Hang Su , Jun Zhu

Locally interpretable model agnostic explanations (LIME) method is one of the most popular methods used to explain black-box models at a per example level. Although many variants have been proposed, few provide a simple way to produce high…

机器学习 · 计算机科学 2023-10-04 Amit Dhurandhar , Karthikeyan Ramamurthy , Kartik Ahuja , Vijay Arya

Attribution methods have been developed to explain the decision of a machine learning model on a given input. We use the Integrated Gradient method for finding attributions to define the causal neighborhood of an input by incrementally…

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

机器学习 · 计算机科学 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan