English
Related papers

Related papers: CXPlain: Causal Explanations for Model Interpretat…

200 papers

Most machine learning techniques are based upon statistical learning theory, often simplified for the sake of computing speed. This paper is focused on the uncertainty aspect of mathematical modeling in machine learning. Regression analysis…

Machine Learning · Computer Science 2022-06-07 Valentin Arkov

Machine learning systems have become popular in fields such as marketing, financing, or data mining. While they are highly accurate, complex machine learning systems pose challenges for engineers and users. Their inherent complexity makes…

Computers and Society · Computer Science 2019-07-31 Andrea Papenmeier , Gwenn Englebienne , Christin Seifert

Game-theoretic formulations of feature importance have become popular as a way to "explain" machine learning models. These methods define a cooperative game between the features of a model and distribute influence among these input elements…

Artificial Intelligence · Computer Science 2020-07-01 I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , Sorelle Friedler

There has been a large number of studies in interpretable and explainable ML for cybersecurity, in particular, for intrusion detection. Many of these studies have significant amount of overlapping and repeated evaluations and analysis. At…

Cryptography and Security · Computer Science 2024-07-08 Omer Subasi , Johnathan Cree , Joseph Manzano , Elena Peterson

Explanations are hypothesized to improve human understanding of machine learning models and achieve a variety of desirable outcomes, ranging from model debugging to enhancing human decision making. However, empirical studies have found…

Artificial Intelligence · Computer Science 2023-05-02 Chacha Chen , Shi Feng , Amit Sharma , Chenhao Tan

Deep learning approaches have recently been extensively explored for the prognostics of industrial assets. However, they still suffer from a lack of interpretability, which hinders their adoption in safety-critical applications. To improve…

Machine Learning · Computer Science 2024-05-29 Florent Forest , Katharina Rombach , Olga Fink

Explainable AI (XAI) methods identify which features are relevant to a model's predictions but often fail to clarify why certain decisions are made. In this work, we present a novel method that integrates causality with argument-based…

Artificial Intelligence · Computer Science 2026-05-22 Henry Salgado , Meagan R. Kendall , Martine Ceberio

Recent legislative regulations have underlined the need for accountable and transparent artificial intelligence systems and have contributed to a growing interest in the Explainable Artificial Intelligence (XAI) field. Nonetheless, the lack…

Machine Learning · Computer Science 2025-10-14 Ilaria Vascotto , Alex Rodriguez , Alessandro Bonaita , Luca Bortolussi

With the growing pervasiveness of artificial intelligence, the ability to explain the inferences made by machine learning models has become increasingly important. Numerous techniques for model explainability have been proposed, with…

Human-Computer Interaction · Computer Science 2026-04-08 Nicola Rossberg , Bennett Kleinberg , Barry O'Sullivan , Luca Longo , Andrea Visentin

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

Shapley values have become one of the go-to methods to explain complex models to end-users. They provide a model agnostic post-hoc explanation with foundations in game theory: what is the worth of a player (in machine learning, a feature…

Machine Learning · Computer Science 2023-06-21 Joran Michiels , Maarten De Vos , Johan Suykens

Industrial Cyber-Physical Systems (CPS) are sensitive infrastructure from both safety and economics perspectives, making their reliability critically important. Machine Learning (ML), specifically deep learning, is increasingly integrated…

Machine Learning · Computer Science 2026-04-09 Annemarie Jutte , Uraz Odyurt

Interpretation of a machine learning induced models is critical for feature engineering, debugging, and, arguably, compliance. Yet, best of breed machine learning models tend to be very complex. This paper presents a method for model…

Machine Learning · Computer Science 2018-02-27 Noa Avigdor-Elgrabli , Alex Libov , Michael Viderman , Ran Wolff

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

Interpretable models are designed to make decisions in a human-interpretable manner. Representatively, Concept Bottleneck Models (CBM) follow a two-step process of concept prediction and class prediction based on the predicted concepts. CBM…

Machine Learning · Computer Science 2023-06-05 Eunji Kim , Dahuin Jung , Sangha Park , Siwon Kim , Sungroh Yoon

Complex machine learning algorithms are used more and more often in critical tasks involving text data, leading to the development of interpretability methods. Among local methods, two families have emerged: those computing importance…

Machine Learning · Computer Science 2025-10-22 Gianluigi Lopardo , Damien Garreau

The increasing number of regulations and expectations of predictive machine learning models, such as so called right to explanation, has led to a large number of methods promising greater interpretability. High demand has led to a…

Explaining the decision-making process of machine learning models is crucial for ensuring their reliability and transparency for end users. One popular explanation form highlights key input features, such as i) tokens (e.g., Shapley Values…

Computation and Language · Computer Science 2025-02-10 Jingyi Sun , Pepa Atanasova , Isabelle Augenstein

Predictive Process Monitoring (PPM) often uses deep learning models to predict the future behavior of ongoing processes, such as predicting process outcomes. While these models achieve high accuracy, their lack of interpretability…

Artificial Intelligence · Computer Science 2025-06-23 Soobin Chae , Suhwan Lee , Hanna Hauptmann , Hajo A. Reijers , Xixi Lu

Deep learning has achieved remarkable success in processing and managing unstructured data. However, its "black box" nature imposes significant limitations, particularly in sensitive application domains. While existing interpretable machine…

Machine Learning · Computer Science 2025-02-11 Wen-Dong Jiang , Chih-Yung Chang , Show-Jane Yen , Diptendu Sinha Roy