中文
相关论文

相关论文: "Is your explanation stable?": A Robustness Evalua…

200 篇论文

Facial attributes, emerging soft biometrics, must be automatically and reliably extracted from images in order to be usable in stand-alone systems. While recent methods extract facial attributes using deep neural networks (DNNs) trained on…

计算机视觉与模式识别 · 计算机科学 2018-04-23 Andras Rozsa , Manuel Günther , Ethan M. Rudd , Terrance E. Boult

Counterfactual explanations are widely used to interpret machine learning predictions by identifying minimal changes to input features that would alter a model's decision. However, most existing counterfactual methods have not been tested…

机器学习 · 计算机科学 2026-02-03 Leonidas Christodoulou , Chang Sun

In the field of Explainable AI, multiples evaluation metrics have been proposed in order to assess the quality of explanation methods w.r.t. a set of desired properties. In this work, we study the articulation between the stability,…

计算机视觉与模式识别 · 计算机科学 2023-11-23 Romain Xu-Darme , Jenny Benois-Pineau , Romain Giot , Georges Quénot , Zakaria Chihani , Marie-Christine Rousset , Alexey Zhukov

Explanation methods for machine learning models tend not to provide any formal guarantees and may not reflect the underlying decision-making process. In this work, we analyze stability as a property for reliable feature attribution methods.…

机器学习 · 计算机科学 2023-10-30 Anton Xue , Rajeev Alur , Eric Wong

Widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models on the one hand and a number of crucial issues pertaining to them warrant the need for explainable artificial intelligence (XAI). A key…

人工智能 · 计算机科学 2023-12-13 Jinqiang Yu , Graham Farr , Alexey Ignatiev , Peter J. Stuckey

In safety-critical deep learning applications robustness measurement is a vital pre-deployment phase. However, existing robustness verification methods are not sufficiently practical for deploying machine learning systems in the real world.…

机器学习 · 计算机科学 2022-07-06 Tianle Zhang , Wenjie Ruan , Jonathan E. Fieldsend

State-of-the-art text classification models are becoming increasingly reliant on deep neural networks (DNNs). Due to their black-box nature, faithful and robust explanation methods need to accompany classifiers for deployment in real-life…

机器学习 · 计算机科学 2022-06-08 Adam Ivankay , Ivan Girardi , Chiara Marchiori , Pascal Frossard

Attribution maps are popular tools for explaining neural networks predictions. By assigning an importance value to each input dimension that represents its impact towards the outcome, they give an intuitive explanation of the decision…

机器学习 · 计算机科学 2022-03-09 Adam Ivankay , Ivan Girardi , Chiara Marchiori , Pascal Frossard

Post-hoc feature attribution methods are widely deployed in safety-critical vision systems, yet their stability under realistic input perturbations remains poorly characterized. Existing metrics evaluate explanations primarily under…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Kamalasankari Subramaniakuppusamy , Jugal Gajjar

While machine learning models have achieved unprecedented success in real-world applications, they might make biased/unfair decisions for specific demographic groups and hence result in discriminative outcomes. Although research efforts…

机器学习 · 计算机科学 2022-12-08 Yuying Zhao , Yu Wang , Tyler Derr

The expansion of explainable artificial intelligence as a field of research has generated numerous methods of visualizing and understanding the black box of a machine learning model. Attribution maps are generally used to highlight the…

Recent years have witnessed the widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models. Despite their tremendous success, a number of vital problems like ML model brittleness, their fairness, and the lack…

人工智能 · 计算机科学 2023-08-29 Jinqiang Yu , Alexey Ignatiev , Peter J. Stuckey

Recent research has developed a number of eXplainable AI (XAI) techniques, such as gradient-based approaches, input perturbation-base methods, and black-box explanation methods. While these XAI techniques can extract meaningful insights…

机器学习 · 计算机科学 2025-03-10 Xu Zheng , Farhad Shirani , Zhuomin Chen , Chaohao Lin , Wei Cheng , Wenbo Guo , Dongsheng Luo

Part-prototype networks (e.g., ProtoPNet, ProtoTree, and ProtoPool) have attracted broad research interest for their intrinsic interpretability and comparable accuracy to non-interpretable counterparts. However, recent works find that the…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Qihan Huang , Mengqi Xue , Wenqi Huang , Haofei Zhang , Jie Song , Yongcheng Jing , Mingli Song

Ensuring the trustworthiness and interpretability of machine learning models is critical to their deployment in real-world applications. Feature attribution methods have gained significant attention, which provide local explanations of…

机器学习 · 计算机科学 2023-09-20 Md Abdul Kadir , Gowtham Krishna Addluri , Daniel Sonntag

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

Neural network models have become the leading solution for a large variety of tasks, such as classification, language processing, protein folding, and others. However, their reliability is heavily plagued by adversarial inputs: small input…

机器学习 · 计算机科学 2022-10-04 Natan Levy , Guy Katz

Different users of machine learning methods require different explanations, depending on their goals. To make machine learning accountable to society, one important goal is to get actionable options for recourse, which allow an affected…

机器学习 · 统计学 2023-12-21 Hidde Fokkema , Rianne de Heide , Tim van Erven

Truly intelligent systems are expected to make critical decisions with incomplete and uncertain data. Active feature acquisition (AFA), where features are sequentially acquired to improve the prediction, is a step towards this goal.…

机器学习 · 计算机科学 2021-07-12 Yang Li , Siyuan Shan , Qin Liu , Junier B. Oliva

While unbiased machine learning models are essential for many applications, bias is a human-defined concept that can vary across tasks. Given only input-label pairs, algorithms may lack sufficient information to distinguish stable (causal)…

机器学习 · 计算机科学 2022-06-28 Yujia Bao , Shiyu Chang , Regina Barzilay