English
Related papers

Related papers: Robustness and Usefulness in AI Explanation Method…

200 papers

In the current landscape of explanation methodologies, most predominant approaches, such as SHAP and LIME, employ removal-based techniques to evaluate the impact of individual features by simulating various scenarios with specific features…

Machine Learning · Computer Science 2023-10-23 Yifan Zhang , Haowei He , Zhiquan Tan , Yang Yuan

Formal explainability guarantees the rigor of computed explanations, and so it is paramount in domains where rigor is critical, including those deemed high-risk. Unfortunately, since its inception formal explainability has been hampered by…

Artificial Intelligence · Computer Science 2024-12-04 Xuanxiang Huang , Joao Marques-Silva

The growing need for trustworthy machine learning has led to the blossom of interpretability research. Numerous explanation methods have been developed to serve this purpose. However, these methods are deficiently and inappropriately…

Machine Learning · Computer Science 2022-03-29 Yipei Wang , Xiaoqian Wang

Predictive process analytics focuses on predicting the future states of running instances of a business process. While advanced machine learning techniques have been used to increase accuracy of predictions, the resulting predictive models…

Artificial Intelligence · Computer Science 2020-12-09 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Machine learning models are used in many sensitive areas where besides predictive accuracy their comprehensibility is also important. Interpretability of prediction models is necessary to determine their biases and causes of errors, and is…

Machine Learning · Computer Science 2021-01-29 Domen Vreš , Marko Robnik Šikonja

The recent enthusiasm for artificial intelligence (AI) is due principally to advances in deep learning. Deep learning methods are remarkably accurate, but also opaque, which limits their potential use in safety-critical applications. To…

In geophysics, hydrocarbon prospect risking involves assessing the risks associated with hydrocarbon exploration by integrating data from various sources. Machine learning-based classifiers trained on tabular data have been recently used to…

Machine Learning · Computer Science 2026-02-17 Prithwijit Chowdhury , Ahmad Mustafa , Mohit Prabhushankar , Ghassan AlRegib

Large Language Models (LLMs) are increasingly used to generate natural-language explanations in recommender systems, acting as explanation agents that reason over user behavior histories. While prior work has focused on explanation fluency…

Information Retrieval · Computer Science 2026-02-04 Guilin Zhang , Kai Zhao , Jeffrey Friedman , Xu Chu

There have been several research works proposing new Explainable AI (XAI) methods designed to generate model explanations having specific properties, or desiderata, such as fidelity, robustness, or human-interpretability. However,…

Artificial Intelligence · Computer Science 2021-01-25 Sérgio Jesus , Catarina Belém , Vladimir Balayan , João Bento , Pedro Saleiro , Pedro Bizarro , João Gama

Post-hoc explainability methods aim to clarify predictions of black-box machine learning models. However, it is still largely unclear how well users comprehend the provided explanations and whether these increase the users ability to…

Machine Learning · Computer Science 2023-09-22 Anahid Jalali , Bernhard Haslhofer , Simone Kriglstein , Andreas Rauber

In recent years, explaining decisions made by complex machine learning models has become essential in high-stakes domains such as energy systems, healthcare, finance, and autonomous systems. However, the reliability of these explanations,…

Machine Learning · Computer Science 2026-02-06 Poushali Sengupta , Sabita Maharjan , Frank Eliassen , Shashi Raj Pandey , Yan Zhang

Deep learning models for learning analytics have become increasingly popular over the last few years; however, these approaches are still not widely adopted in real-world settings, likely due to a lack of trust and transparency. In this…

Computers and Society · Computer Science 2023-03-08 Vinitra Swamy , Sijia Du , Mirko Marras , Tanja Käser

In the field of Explainable AI, multiples evaluation metrics have been proposed in order to assess the quality of explanation methods w.r.t. a set of desired properties. In this work, we study the articulation between the stability,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Romain Xu-Darme , Jenny Benois-Pineau , Romain Giot , Georges Quénot , Zakaria Chihani , Marie-Christine Rousset , Alexey Zhukov

Explainable Artificial Intelligence (XAI)has received a great deal of attention recently. Explainability is being presented as a remedy for the distrust of complex and opaque models. Model agnostic methods such as LIME, SHAP, or Break Down…

Machine Learning · Computer Science 2020-05-11 Alicja Gosiewska , Przemyslaw Biecek

Artificial Intelligence (AI) increasingly shows its potential to outperform predicate logic algorithms and human control alike. In automatically deriving a system model, AI algorithms learn relations in data that are not detectable for…

Artificial Intelligence · Computer Science 2022-10-12 Simon Daniel Duque Anton , Daniel Schneider , Hans Dieter Schotten

As attribution-based explanation methods are increasingly used to establish model trustworthiness in high-stakes situations, it is critical to ensure that these explanations are stable, e.g., robust to infinitesimal perturbations to an…

The use of Artificial Intelligence (AI) models in real-world and high-risk applications has intensified the discussion about their trustworthiness and ethical usage, from both a technical and a legislative perspective. The field of…

Machine Learning · Computer Science 2025-12-17 Ilaria Vascotto , Alex Rodriguez , Alessandro Bonaita , Luca Bortolussi

Interpretability analysis methods for artificial intelligence models, such as LIME and SHAP, are widely used, though they primarily serve as post-model for analyzing model outputs. While it is commonly believed that the transparency and…

General Finance · Quantitative Finance 2025-02-28 Yan Zhang , Lin Chen , Yixiang Tian

This text discusses several popular explanatory methods that go beyond the error measurements and plots traditionally used to assess machine learning models. Some of the explanatory methods are accepted tools of the trade while others are…

Machine Learning · Statistics 2020-06-02 Patrick Hall

Explainability has been widely stated as a cornerstone of the responsible and trustworthy use of machine learning models. With the ubiquitous use of Deep Neural Network (DNN) models expanding to risk-sensitive and safety-critical domains,…