中文
相关论文

相关论文: Post-Hoc Explanations Fail to Achieve their Purpos…

200 篇论文

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

人工智能 · 计算机科学 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

Machine learning algorithms generally suffer from a problem of explainability. Given a classification result from a model, it is typically hard to determine what caused the decision to be made, and to give an informative explanation. We…

机器学习 · 计算机科学 2019-06-26 Jonathan Moore , Nils Hammerla , Chris Watkins

The paper offers a contribution to the interdisciplinary constructs of analyzing fairness issues in automatic algorithmic decisions. Section 1 shows that technical choices in supervised learning have social implications that need to be…

计算机与社会 · 计算机科学 2022-06-08 Thierry Kirat , Olivia Tambou , Virginie Do , Alexis Tsoukiàs

The recent adoption of machine learning as a tool in real world decision making has spurred interest in understanding how these decisions are being made. Counterfactual Explanations are a popular interpretable machine learning technique…

机器学习 · 计算机科学 2021-10-05 Andrew O'Brien , Edward Kim

State-of-the-art recommender systems have the ability to generate high-quality recommendations, but usually cannot provide intuitive explanations to humans due to the usage of black-box prediction models. The lack of transparency has…

信息检索 · 计算机科学 2021-02-24 Shuyuan Xu , Yunqi Li , Shuchang Liu , Zuohui Fu , Xu Chen , Yongfeng Zhang

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

机器学习 · 计算机科学 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

AI models need to be unlearned to fulfill the requirements of legal acts such as the AI Act or GDPR, and also because of the need to remove toxic content, debiasing, the impact of malicious instances, or changes in the data distribution…

机器学习 · 计算机科学 2025-07-16 Patryk Jasiorski , Marek Klonowski , Michał Woźniak

eXplainable AI focuses on generating explanations for the output of an AI algorithm to a user, usually a decision-maker. Such user needs to interpret the AI system in order to decide whether to trust the machine outcome. When addressing…

人机交互 · 计算机科学 2020-05-28 Irene Celino

As AI becomes an integral part of our lives, the development of explainable AI, embodied in the decision-making process of an AI or robotic agent, becomes imperative. For a robotic teammate, the ability to generate explanations to justify…

人工智能 · 计算机科学 2020-09-01 Mehrdad Zakershahrak , Ze Gong , Nikhillesh Sadassivam , Yu Zhang

While AI algorithms have shown remarkable success in various fields, their lack of transparency hinders their application to real-life tasks. Although explanations targeted at non-experts are necessary for user trust and human-AI…

人工智能 · 计算机科学 2024-02-12 Jasmina Gajcin , Ivana Dusparic

Providing explanations is considered an imperative ability for an AI agent in a human-robot teaming framework. The right explanation provides the rationale behind an AI agent's decision-making. However, to maintain the human teammate's…

人工智能 · 计算机科学 2021-03-01 Mehrdad Zakershahrak , Samira Ghodratnama

Predictive machine learning models are becoming increasingly deployed in high-stakes contexts involving sensitive personal data; in these contexts, there is a trade-off between model explainability and data privacy. In this work, we push…

密码学与安全 · 计算机科学 2024-07-29 Catherine Huang , Martin Pawelczyk , Himabindu Lakkaraju

Transparency is an essential requirement of machine learning based decision making systems that are deployed in real world. Often, transparency of a given system is achieved by providing explanations of the behavior and predictions of the…

机器学习 · 计算机科学 2021-05-18 André Artelt , Barbara Hammer

As machine learning models are increasingly being employed in various high-stakes settings, it becomes important to ensure that predictions of these models are not only adversarially robust, but also readily explainable to relevant…

机器学习 · 计算机科学 2024-07-25 Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

In this work, we empirically examine human-AI decision-making in the presence of explanations based on predicted outcomes. This type of explanation provides a human decision-maker with expected consequences for each decision alternative at…

人机交互 · 计算机科学 2022-08-31 Johannes Jakubik , Jakob Schöffer , Vincent Hoge , Michael Vössing , Niklas Kühl

With the broader and highly successful usage of machine learning in industry and the sciences, there has been a growing demand for Explainable AI. Interpretability and explanation methods for gaining a better understanding about the problem…

The need for systems to explain behavior to users has become more evident with the rise of complex technology like machine learning or self-adaptation. In general, the need for an explanation arises when the behavior of a system does not…

软件工程 · 计算机科学 2021-08-16 Mersedeh Sadeghi , Verena Klös , Andreas Vogelsang

Recent papers in explainable AI have made a compelling case for counterfactual modes of explanation. While counterfactual explanations appear to be extremely effective in some instances, they are formally equivalent to adversarial examples.…

人工智能 · 计算机科学 2020-12-21 Kieran Browne , Ben Swift

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

人机交互 · 计算机科学 2019-05-09 Martin Schuessler , Philipp Weiß