English
Related papers

Related papers: Interpretability is not Explainability: New Quanti…

200 papers

Explainable AI (XAI) is widely viewed as a sine qua non for ever-expanding AI research. A better understanding of the needs of XAI users, as well as human-centered evaluations of explainable models are both a necessity and a challenge. In…

Artificial Intelligence · Computer Science 2024-10-17 Yao Rong , Tobias Leemann , Thai-trang Nguyen , Lisa Fiedler , Peizhu Qian , Vaibhav Unhelkar , Tina Seidel , Gjergji Kasneci , Enkelejda Kasneci

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified…

Machine Learning · Computer Science 2025-07-16 Rahul Sharma , Sergey Redyuk , Sumantrak Mukherjee , Andrea Šipka , Eyke Hüllermeier , Sebastian Vollmer , David Selby

Recent success in Artificial Intelligence (AI) and Machine Learning (ML) allow problem solving automatically without any human intervention. Autonomous approaches can be very convenient. However, in certain domains, e.g., in the medical…

Artificial Intelligence · Computer Science 2021-03-03 Andreas Holzinger , André Carrington , Heimo Müller

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

Computation and Language · Computer Science 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Evaluating the quality of explanations in Explainable Artificial Intelligence (XAI) is to this day a challenging problem, with ongoing debate in the research community. While some advocate for establishing standardized offline metrics,…

Human-Computer Interaction · Computer Science 2024-09-27 Teodor Chiaburu , Frank Haußer , Felix Bießmann

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Utilizing potent representations of the large vision-language models (VLMs) to accomplish various downstream tasks has attracted increasing attention. Within this research field, soft prompt learning has become a representative approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Yequan Bie , Luyang Luo , Zhixuan Chen , Hao Chen

Explainable AI (XAI) aims to support appropriate human-AI reliance by increasing the interpretability of complex model decisions. Despite the proliferation of proposed methods, there is mixed evidence surrounding the effects of different…

Human-Computer Interaction · Computer Science 2024-10-29 Emma Casolin , Flora D. Salim , Ben Newell

Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements…

Human-Computer Interaction · Computer Science 2024-10-17 Tobias Labarta , Elizaveta Kulicheva , Ronja Froelian , Christian Geißler , Xenia Melman , Julian von Klitzing

The rapid growth of research in explainable artificial intelligence (XAI) follows on two substantial developments. First, the enormous application success of modern machine learning methods, especially deep and reinforcement learning, which…

Artificial Intelligence · Computer Science 2020-05-06 S. Atakishiyev , H. Babiker , N. Farruque , R. Goebel1 , M-Y. Kima , M. H. Motallebi , J. Rabelo , T. Syed , O. R. Zaïane

In this paper, we investigate the practical relevance of explainable artificial intelligence (XAI) with a special focus on the producing industries and relate them to the current state of academic XAI research. Our findings are based on an…

Machine Learning · Computer Science 2023-10-13 Thomas Decker , Ralf Gross , Alexander Koebler , Michael Lebacher , Ronald Schnitzer , Stefan H. Weber

The remarkable advancements in Deep Learning (DL) algorithms have fueled enthusiasm for using Artificial Intelligence (AI) technologies in almost every domain; however, the opaqueness of these algorithms put a question mark on their…

Machine Learning · Computer Science 2021-01-12 F. Hussain , R. Hussain , E. Hossain

The rapidly advancing domain of Explainable Artificial Intelligence (XAI) has sparked significant interests in developing techniques to make AI systems more transparent and understandable. Nevertheless, in real-world contexts, the methods…

Artificial Intelligence · Computer Science 2023-09-08 Yulu Pi

Explainable AI (XAI) techniques are increasingly important for the validation and responsible use of modern deep learning models, but are difficult to evaluate due to the lack of good ground-truth to compare against. We propose a framework…

Artificial Intelligence · Computer Science 2026-05-19 Amritpal Singh , Andrey Barsky , Mohamed Ali Souibgui , Ernest Valveny , Dimosthenis Karatzas

Explainable AI (XAI) interfaces seek to make large language models more transparent, yet explanation alone does not produce understanding. Explaining a system's behavior is not the same as being able to engage with it, to probe and…

Human-Computer Interaction · Computer Science 2026-03-18 Gabrielle Benabdallah

Artificial intelligence is creating one of the biggest revolution across technology driven application fields. For the finance sector, it offers many opportunities for significant market innovation and yet broad adoption of AI systems…

Risk Management · Quantitative Finance 2022-12-07 Marc Wildi , Branka Hadji Misheva

Current Explainable AI (ExAI) methods, especially in the NLP field, are conducted on various datasets by employing different metrics to evaluate several aspects. The lack of a common evaluation framework is hindering the progress tracking…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mohamad Mansour , Basel Mousi , Mariette Awad

Despite its technological breakthroughs, eXplainable Artificial Intelligence (XAI) research has limited success in producing the {\em effective explanations} needed by users. In order to improve XAI systems' usability, practical…

Human-Computer Interaction · Computer Science 2024-03-22 Thu Nguyen , Alessandro Canossa , Jichen Zhu

Explainable AI (XAI) is a necessity in safety-critical systems such as in clinical diagnostics due to a high risk for fatal decisions. Currently, however, XAI resembles a loose collection of methods rather than a well-defined process. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Lukas Klein , Mennatallah El-Assady , Paul F. Jäger

Artificial Intelligence in Medicine has made significant progress with emerging applications in medical imaging, patient care, and other areas. While these applications have proven successful in retrospective studies, very few of them were…

Artificial Intelligence · Computer Science 2023-08-11 Nicoletta Prentzas , Antonis Kakas , Constantinos S. Pattichis