中文
相关论文

相关论文: "Why did you do that?": Explaining black box model…

200 篇论文

With the increasing adoption of predictive models trained using machine learning across a wide range of high-stakes applications, e.g., health care, security, criminal justice, finance, and education, there is a growing need for effective…

机器学习 · 计算机科学 2020-08-04 Aria Khademi , Vasant Honavar

Risk scoring systems have been widely deployed in many applications, which assign risk scores to users according to their behavior sequences. Though many deep learning methods with sophisticated designs have achieved promising results, the…

机器学习 · 计算机科学 2022-08-17 Yao Zhang , Yun Xiong , Yiheng Sun , Caihua Shan , Tian Lu , Hui Song , Yangyong Zhu

The fundamental challenge in causal induction is to infer the underlying graph structure given observational and/or interventional data. Most existing causal induction algorithms operate by generating candidate graphs and evaluating them…

Machine learning is currently undergoing an explosion in capability, popularity, and sophistication. However, one of the major barriers to widespread acceptance of machine learning (ML) is trustworthiness: most ML models operate as black…

Being able to provide counterfactual interventions - sequences of actions we would have had to take for a desirable outcome to happen - is essential to explain how to change an unfavourable decision by a black-box machine learning model…

机器学习 · 计算机科学 2023-02-08 Giovanni De Toni , Bruno Lepri , Andrea Passerini

Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a…

机器学习 · 计算机科学 2016-08-10 Marco Tulio Ribeiro , Sameer Singh , Carlos Guestrin

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

机器学习 · 计算机科学 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

The widespread adoption of black-box models in Artificial Intelligence has enhanced the need for explanation methods to reveal how these obscure models reach specific decisions. Retrieving explanations is fundamental to unveil possible…

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

人工智能 · 计算机科学 2020-09-30 Kary Främling

In AI and law, systems that are designed for decision support should be explainable when pursuing justice. In order for these systems to be fair and responsible, they should make correct decisions and make them using a sound and transparent…

人工智能 · 计算机科学 2021-05-17 Cor Steging , Silja Renooij , Bart Verheij

Many of the computing systems programmed using Machine Learning are opaque: it is difficult to know why they do what they do or how they work. The Explainable Artificial Intelligence research program aims to develop analytic techniques with…

综合文献 · 计算机科学 2019-07-08 Carlos Zednik

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

人工智能 · 计算机科学 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

Despite outstanding contribution to the significant progress of Artificial Intelligence (AI), deep learning models remain mostly black boxes, which are extremely weak in explainability of the reasoning process and prediction results.…

机器学习 · 计算机科学 2020-02-11 Sheng Shi , Xinfeng Zhang , Wei Fan

Local Interpretable Model-Agnostic Explanations (LIME) is a popular technique used to increase the interpretability and explainability of black box Machine Learning (ML) algorithms. LIME typically generates an explanation for a single…

机器学习 · 计算机科学 2019-06-26 Muhammad Rehman Zafar , Naimul Mefraz Khan

The decision-making process of many state-of-the-art machine learning models is inherently inscrutable to the extent that it is impossible for a human to interpret the model directly: they are black box models. This has led to a call for…

信息检索 · 计算机科学 2019-07-09 Ilse van der Linden , Hinda Haned , Evangelos Kanoulas

Recent developments in Artificial Intelligence (AI) and their applications in critical industries such as healthcare, fin-tech and cybersecurity have led to a surge in research in explainability in AI. Innovative research methods are being…

人工智能 · 计算机科学 2025-08-26 Aoun E Muhammad , Kin-Choong Yow , Nebojsa Bacanin-Dzakula , Muhammad Attique Khan

Explaining and reasoning about processes which underlie observed black-box phenomena enables the discovery of causal mechanisms, derivation of suitable abstract representations and the formulation of more robust predictions. We propose to…

人工智能 · 计算机科学 2017-08-02 Svetlin Penkov , Subramanian Ramamoorthy

Black-box explanation is the problem of explaining how a machine learning model -- whose internal logic is hidden to the auditor and generally complex -- produces its outcomes. Current approaches for solving this problem include model…

机器学习 · 计算机科学 2019-05-16 Ulrich Aïvodji , Hiromi Arai , Olivier Fortineau , Sébastien Gambs , Satoshi Hara , Alain Tapp

For many use-cases, it is often important to explain the prediction of a black-box model by identifying the most influential training data samples. Existing approaches lack customization for user intent and often provide a homogeneous set…

机器学习 · 计算机科学 2024-08-09 Ikhtiyor Nematov , Dimitris Sacharidis , Tomer Sagi , Katja Hose

This paper investigates the prospect of developing human-interpretable, explainable artificial intelligence (AI) systems based on active inference and the free energy principle. We first provide a brief overview of active inference, and in…