中文
相关论文

相关论文: SHLIME: Foiling adversarial attacks fooling SHAP a…

200 篇论文

Machine learning is used more and more often for sensitive applications, sometimes replacing humans in critical decision-making processes. As such, interpretability of these algorithms is a pressing need. One popular algorithm to provide…

机器学习 · 计算机科学 2020-01-14 Damien Garreau , Ulrike von Luxburg

Post-hoc saliency methods are widely used to interpret deep neural networks, but their faithfulness is difficult to evaluate reliably. Existing evaluations mask features according to saliency-induced feature ordering and measure performance…

机器学习 · 计算机科学 2026-05-19 Chia-Ying Hsieh , Hsin-Yuan Fang , Chun-Shu Wei

Post-hoc explanations are widely used to justify, contest, and review automated decisions in high-stakes domains such as lending, employment, and healthcare. Among these methods, SHAP is often treated as providing a reliable account of…

机器学习 · 计算机科学 2026-01-27 Hyunseung Hwang , Seungeun Lee , Lucas Rosenblatt , Steven Euijong Whang , Julia Stoyanovich

In artificial intelligence (AI), the complexity of many models and processes surpasses human understanding, making it challenging to determine why a specific prediction is made. This lack of transparency is particularly problematic in…

机器学习 · 统计学 2025-06-30 Alexandra Stadler , Werner G. Müller , Radoslav Harman

The benefit of locality is one of the major premises of LIME, one of the most prominent methods to explain black-box machine learning models. This emphasis relies on the postulate that the more locally we look at the vicinity of an…

机器学习 · 计算机科学 2022-08-03 Romaric Gaudel , Luis Galárraga , Julien Delaunay , Laurence Rozé , Vaishnavi Bhargava

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

机器学习 · 计算机科学 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

Applications of multilevel models usually result in binary classification within groups or hierarchies based on a set of input features. For transparent and ethical applications of such models, sound audit frameworks need to be developed.…

计算机与社会 · 计算机科学 2022-07-18 Debarati Bhaumik , Diptish Dey , Subhradeep Kayal

Explainability is a gateway between Artificial Intelligence and society as the current popular deep learning models are generally weak in explaining the reasoning process and prediction results. Local Interpretable Model-agnostic…

机器学习 · 计算机科学 2020-02-19 Sheng Shi , Xinfeng Zhang , Wei Fan

Post-hoc explainability is essential for understanding black-box machine learning models. Surrogate-based techniques are widely used for local and global model-agnostic explanations but have significant limitations. Local surrogates capture…

机器学习 · 计算机科学 2026-03-19 Simone Piaggesi , Riccardo Guidotti , Fosca Giannotti , Dino Pedreschi

Large Language Model (LLM) cascade systems are designed to balance efficiency and performance by processing queries with lightweight models while selectively escalating complex cases to more powerful ones. Such systems seek to reduces…

密码学与安全 · 计算机科学 2026-05-19 Zehan Sun , Dingfan Chen , Songze Li

LIME (Local Interpretable Model-agnostic Explanations) is a popular XAI framework for unraveling decision-making processes in vision machine-learning models. The technique utilizes image segmentation methods to identify fixed regions for…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Patrick Knab , Sascha Marton , Christian Bartelt

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

人工智能 · 计算机科学 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

As machine learning black boxes are increasingly being deployed in real-world applications, there has been a growing interest in developing post hoc explanations that summarize the behaviors of these black boxes. However, existing…

机器学习 · 计算机科学 2020-11-13 Himabindu Lakkaraju , Nino Arsov , Osbert Bastani

Large Language Models (LLMs) can achieve inflated scores on multiple-choice tasks by exploiting inherent biases in option positions or labels, rather than demonstrating genuine understanding. This study introduces SCOPE, an evaluation…

计算与语言 · 计算机科学 2025-08-05 Wonjun Jeong , Dongseok Kim , Taegkeun Whangbo

Large Language Models (LLMs) represent valuable intellectual property (IP), reflecting significant investments in training data, compute, and expertise. Deploying these models on partially trusted or insecure devices introduces substantial…

密码学与安全 · 计算机科学 2025-10-30 Racchit Jain , Satya Lokam , Yehonathan Refael , Adam Hakim , Lev Greenberg , Jay Tenenbaum

Recent studies on the safety alignment of large language models (LLMs) have revealed that existing approaches often operate superficially, leaving models vulnerable to various adversarial attacks. Despite their significance, these studies…

密码学与安全 · 计算机科学 2025-06-02 Jianwei Li , Jung-Eun Kim

In the context of human-in-the-loop Machine Learning applications, like Decision Support Systems, interpretability approaches should provide actionable insights without making the users wait. In this paper, we propose Accelerated…

机器学习 · 计算机科学 2021-12-24 David Dandolo , Chiara Masiero , Mattia Carletti , Davide Dalle Pezze , Gian Antonio Susto

In this paper, we investigate the impact of adversarial attacks on the explainability of deep learning models, which are commonly criticized for their black-box nature despite their capacity for autonomous feature extraction. This black-box…

机器学习 · 计算机科学 2024-12-17 Gazi Nazia Nur , Mohammad Ahnaf Sadat

Monumental advancements in artificial intelligence (AI) have lured the interest of doctors, lenders, judges, and other professionals. While these high-stakes decision-makers are optimistic about the technology, those familiar with AI…

人工智能 · 计算机科学 2023-04-13 Zachariah Carmichael , Walter J Scheirer

Given the pressing need for assuring algorithmic transparency, Explainable AI (XAI) has emerged as one of the key areas of AI research. In this paper, we develop a novel Bayesian extension to the LIME framework, one of the most widely used…

人工智能 · 计算机科学 2021-06-01 Xingyu Zhao , Wei Huang , Xiaowei Huang , Valentin Robu , David Flynn