English
Related papers

Related papers: Uncovering Bugs in Formal Explainers: A Case Study…

200 papers

In recent years, Explainable AI (xAI) attracted a lot of attention as various countries turned explanations into a legal right. xAI allows for improving models beyond the accuracy metric by, e.g., debugging the learned pattern and…

Software Engineering · Computer Science 2022-10-05 Mohamed Karim Belaid , Eyke Hüllermeier , Maximilian Rabus , Ralf Krestel

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

In recent years, there has been an explosion of AI research on counterfactual explanations as a solution to the problem of eXplainable AI (XAI). These explanations seem to offer technical, psychological and legal benefits over other…

Machine Learning · Computer Science 2021-05-03 Mark T Keane , Eoin M Kenny , Eoin Delaney , Barry Smyth

Explainable Artificial Intelligence (XAI) has emerged as a critical area of research to unravel the opaque inner logic of (deep) machine learning models. Among the various XAI techniques proposed in the literature, counterfactual…

Artificial Intelligence · Computer Science 2025-01-28 Flavio Giorgi , Cesare Campagnano , Fabrizio Silvestri , Gabriele Tolomei

A fundamental research goal for Explainable AI (XAI) is to build models that are capable of reasoning through the generation of natural language explanations. However, the methodologies to design and evaluate explanation-based inference…

Artificial Intelligence · Computer Science 2022-05-06 Marco Valentino , André Freitas

The advances in Machine Learning (ML) in recent years have been both impressive and far-reaching. However, the deployment of ML models is still impaired by a lack of trust in how the best-performing ML models make predictions. The issue of…

Artificial Intelligence · Computer Science 2023-06-06 Joao Marques-Silva

Interactive Artificial Intelligence (AI) agents are becoming increasingly prevalent in society. However, application of such systems without understanding them can be problematic. Black-box AI systems can lead to liability and…

Computers and Society · Computer Science 2023-01-16 Pradyumna Tambwekar , Matthew Gombolay

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

Explainable AI (XAI) aims to provide interpretations for predictions made by learning machines, such as deep neural networks, in order to make the machines more transparent for the user and furthermore trustworthy also for applications in…

Machine Learning · Computer Science 2020-06-17 Kirill Bykov , Marina M. -C. Höhne , Klaus-Robert Müller , Shinichi Nakajima , Marius Kloft

Regulators have signalled an interest in adopting explainable AI(XAI) techniques to handle the diverse needs for model governance, operational servicing, and compliance in the financial services industry. In this short overview, we review…

Machine Learning · Computer Science 2021-08-13 Jiahao Chen , Victor Storchan

Artificial intelligence is reshaping science and industry, yet many users still regard its models as opaque "black boxes". Conventional explainable artificial-intelligence methods clarify individual predictions but overlook the upstream…

Machine Learning · Computer Science 2025-08-18 George Paterakis , Andrea Castellani , George Papoutsoglou , Tobias Rodemann , Ioannis Tsamardinos

In recent years, the impact of machine learning (ML) and artificial intelligence (AI) in society has been absolutely remarkable. This impact is expected to continue in the foreseeable future. However,the adoption of AI/ML is also a cause of…

Artificial Intelligence · Computer Science 2024-06-19 Joao Marques-Silva

Explainable Artificial Intelligence (XAI) has become increasingly significant for improving the interpretability and trustworthiness of machine learning models. While saliency maps have stolen the show for the last few years in the XAI…

Artificial Intelligence · Computer Science 2023-09-08 Antonin Poché , Lucas Hervier , Mohamed-Chafik Bakkay

We are witnessing the emergence of an AI economy and society where AI technologies are increasingly impacting health care, business, transportation and many aspects of everyday life. Many successes have been reported where AI systems even…

Machine Learning · Computer Science 2022-12-27 D. Petkovic

Artificial intelligence (AI) is being applied in almost every field. At the same time, the currently dominant deep learning methods are fundamentally black-box systems that lack explanations for their inferences, significantly limiting…

Artificial Intelligence · Computer Science 2025-10-06 Martina Mattioli , Eike Petersen , Aasa Feragen , Marcello Pelillo , Siavash A. Bigdeli

Explainable AI (XAI) helps users interpret model behavior and identify potential faults. Agentic XAI systems use Large Language Models (LLMs) to make explanations more accessible through natural-language interaction, but they can also…

Artificial Intelligence · Computer Science 2026-05-28 Jaechang Kim , Sunung Mun , Seungjoon Lee , Jaewoong Cho , Jungseul Ok

Understanding when and why to apply any given eXplainable Artificial Intelligence (XAI) technique is not a straightforward task. There is no single approach that is best suited for a given context. This paper aims to address the challenge…

Artificial Intelligence · Computer Science 2023-12-14 Leila Methnani , Virginia Dignum , Andreas Theodorou

Explainable AI (XAI) is paramount in industry-grade AI; however existing methods fail to address this necessity, in part due to a lack of standardisation of explainability methods. The purpose of this paper is to offer a perspective on the…

Machine Learning · Computer Science 2020-10-26 Othman Benchekroun , Adel Rahimi , Qini Zhang , Tetiana Kodliuk

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The explainable AI (XAI)…

Artificial Intelligence · Computer Science 2024-09-30 Sergei Nirenburg , Marjorie McShane , Kenneth W. Goodman , Sanjay Oruganti