English
Related papers

Related papers: Pitfalls of Explainable ML: An Industry Perspectiv…

200 papers

Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses…

Artificial Intelligence · Computer Science 2025-03-14 Melkamu Mersha , Khang Lam , Joseph Wood , Ali AlShami , Jugal Kalita

We often use "explainable" Artificial Intelligence (XAI)" and "interpretable AI (IAI)" interchangeably when we apply various XAI tools for a given dataset to explain the reasons that underpin machine learning (ML) outputs. However, these…

Artificial Intelligence · Computer Science 2024-08-23 Caesar Wu , Rajkumar Buyya , Yuan Fang Li , Pascal Bouvry

Explainable Artificial Intelligence (XAI) is an emerging area of research in the field of Artificial Intelligence (AI). XAI can explain how AI obtained a particular solution (e.g., classification or object detection) and can also answer…

Machine Learning · Computer Science 2021-07-16 Prashant Gohel , Priyanka Singh , Manoranjan Mohanty

The implementation of Artificial Intelligence (AI) systems in the manufacturing domain enables higher production efficiency, outstanding performance, and safer operations, leveraging powerful tools such as deep learning and reinforcement…

Artificial Intelligence · Computer Science 2021-07-07 Georgios Sofianidis , Jože M. Rožanec , Dunja Mladenić , Dimosthenis Kyriazis

Artificial Intelligence (AI) and its data-centric branch of machine learning (ML) have greatly evolved over the last few decades. However, as AI is used increasingly in real world use cases, the importance of the interpretability of and…

Machine Learning · Computer Science 2022-12-01 N. Ranasinghe , A. Ramanan , S. Fernando , P. N. Hameed , D. Herath , T. Malepathirana , P. Suganthan , M. Niranjan , S. Halgamuge

Explainable Artificial Intelligence (XAI) has re-emerged in response to the development of modern AI and ML systems. These systems are complex and sometimes biased, but they nevertheless make decisions that impact our lives. XAI systems are…

Artificial Intelligence · Computer Science 2021-02-10 Shane T. Mueller , Elizabeth S. Veinott , Robert R. Hoffman , Gary Klein , Lamia Alam , Tauseef Mamun , William J. Clancey

Recent success in Artificial Intelligence (AI) and Machine Learning (ML) allow problem solving automatically without any human intervention. Autonomous approaches can be very convenient. However, in certain domains, e.g., in the medical…

Artificial Intelligence · Computer Science 2021-03-03 Andreas Holzinger , André Carrington , Heimo Müller

Companies' adoption of artificial intelligence (AI) is increasingly becoming an essential element of business success. However, using AI poses new requirements for companies and their employees, including transparency and comprehensibility…

Human-Computer Interaction · Computer Science 2023-06-05 Katharina Weitz , Chi Tai Dang , Elisabeth André

Automated decision making is used routinely throughout our everyday life. Recommender systems decide which jobs, movies, or other user profiles might be interesting to us. Spell checkers help us to make good use of language. Fraud detection…

Machine Learning · Computer Science 2020-07-15 Alexander Jung , Pedro H. J. Nardelli

The complex nature of disease mechanisms and the variability of patient symptoms pose significant challenges in developing effective diagnostic tools. Although machine learning (ML) has made substantial advances in medical diagnosis, the…

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

Computation and Language · Computer Science 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

This paper examines two different yet related questions related to explainable AI (XAI) practices. Machine learning (ML) is increasingly important in financial services, such as pre-approval, credit underwriting, investments, and various…

Machine Learning · Computer Science 2022-09-21 Swati Tyagi

Explainable AI (XAI) is paramount in industry-grade AI; however existing methods fail to address this necessity, in part due to a lack of standardisation of explainability methods. The purpose of this paper is to offer a perspective on the…

Machine Learning · Computer Science 2020-10-26 Othman Benchekroun , Adel Rahimi , Qini Zhang , Tetiana Kodliuk

The application of Artificial Intelligence (AI) tools in different domains are becoming mandatory for all companies wishing to excel in their industries. One major challenge for a successful application of AI is to combine the machine…

Human-Computer Interaction · Computer Science 2020-03-02 Juliana Jansen Ferreira , Mateus de Souza Monteiro

XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have…

Over the last few years there has been rapid research growth into eXplainable Artificial Intelligence (XAI) and the closely aligned Interpretable Machine Learning (IML). Drivers for this growth include recent legislative changes and…

Artificial Intelligence · Computer Science 2021-07-08 Richard Dazeley , Peter Vamplew , Cameron Foale , Charlotte Young , Sunil Aryal , Francisco Cruz

The increasing use of Machine Learning (ML) in sensitive domains such as healthcare, finance, and public policy has raised concerns about the transparency of automated decisions. Explainable AI (XAI) addresses this by clarifying how models…

Artificial Intelligence · Computer Science 2026-02-13 Natalia Abarca , Andrés Carvallo , Claudia López Moncada , Felipe Bravo-Marquez

The past decade has seen significant progress in artificial intelligence (AI), which has resulted in algorithms being adopted for resolving a variety of problems. However, this success has been met by increasing model complexity and…

Machine Learning · Computer Science 2021-11-15 Waddah Saeed , Christian Omlin

Explanation is key to people having confidence in high-stakes AI systems. However, machine-learning-based systems -- which account for almost all current AI -- can't explain because they are usually black boxes. The explainable AI (XAI)…

Artificial Intelligence · Computer Science 2024-09-30 Sergei Nirenburg , Marjorie McShane , Kenneth W. Goodman , Sanjay Oruganti