English
Related papers

Related papers: Pitfalls of Explainable ML: An Industry Perspectiv…

200 papers

As large language models (LLMs) are increasingly deployed in sensitive domains such as healthcare, law, and education, the demand for transparent, interpretable, and accountable AI systems becomes more urgent. Explainable AI (XAI) acts as a…

Computers and Society · Computer Science 2025-05-28 Francisco Herrera

Explainable Artificial Intelligence (XAI), i.e., the development of more transparent and interpretable AI models, has gained increased traction over the last few years. This is due to the fact that, in conjunction with their growth into…

Machine Learning · Computer Science 2020-05-14 Erika Puiutta , Eric MSP Veith

As a field of AI, Machine Reasoning (MR) uses largely symbolic means to formalize and emulate abstract reasoning. Studies in early MR have notably started inquiries into Explainable AI (XAI) -- arguably one of the biggest concerns today for…

Recently, artificial intelligence and machine learning in general have demonstrated remarkable performances in many tasks, from image processing to natural language processing, especially with the advent of deep learning. Along with…

Machine Learning · Computer Science 2020-10-23 Erico Tjoa , Cuntai Guan

Explainability is becoming an important requirement for organizations that make use of automated decision-making due to regulatory initiatives and a shift in public awareness. Various and significantly different algorithmic methods to…

Machine Learning · Computer Science 2021-07-12 Tom Vermeire , Thibault Laugel , Xavier Renard , David Martens , Marcin Detyniecki

Industrial Cyber-Physical Systems (CPS) are sensitive infrastructure from both safety and economics perspectives, making their reliability critically important. Machine Learning (ML), specifically deep learning, is increasingly integrated…

Machine Learning · Computer Science 2026-04-09 Annemarie Jutte , Uraz Odyurt

The lack of transparency and explainability hinders the clinical adoption of Machine learning (ML) algorithms. While explainable artificial intelligence (XAI) methods have been proposed, little research has focused on the agreement between…

Machine Learning · Computer Science 2023-11-29 Aida Brankovic , Wenjie Huang , David Cook , Sankalp Khanna , Konstanty Bialkowski

Many ML models are opaque to humans, producing decisions too complex for humans to easily understand. In response, explainable artificial intelligence (XAI) tools that analyze the inner workings of a model have been created. Despite these…

Computers and Society · Computer Science 2021-06-17 Kiana Alikhademi , Brianna Richardson , Emma Drobina , Juan E. Gilbert

The uses of machine learning (ML) have snowballed in recent years. In many cases, ML models are highly complex, and their operation is beyond the understanding of human decision-makers. Nevertheless, some uses of ML models involve…

Machine Learning · Computer Science 2024-12-25 Yacine Izza , Xuanxiang Huang , Antonio Morgado , Jordi Planes , Alexey Ignatiev , Joao Marques-Silva

Explainable Artificial Intelligence (XAI) techniques are frequently required by users in many AI systems with the goal of understanding complex models, their associated predictions, and gaining trust. While suitable for some specific tasks…

Human-Computer Interaction · Computer Science 2023-03-22 Savio Rozario , George Čevora

The need for interpretable and accountable intelligent systems grows along with the prevalence of artificial intelligence applications used in everyday life. Explainable intelligent systems are designed to self-explain the reasoning behind…

Human-Computer Interaction · Computer Science 2020-08-06 Sina Mohseni , Niloofar Zarei , Eric D. Ragan

The increasing complexity of AI systems has led to the growth of the field of Explainable Artificial Intelligence (XAI), which aims to provide explanations and justifications for the outputs of AI algorithms. While there is considerable…

Artificial Intelligence · Computer Science 2024-06-21 Maryam Hashemi , Ali Darejeh , Francisco Cruz

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

Computation and Language · Computer Science 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

Context: In recent years, leveraging machine learning (ML) techniques has become one of the main solutions to tackle many software engineering (SE) tasks, in research studies (ML4SE). This has been achieved by utilizing state-of-the-art…

Software Engineering · Computer Science 2023-02-14 Ahmad Haji Mohammadkhani , Nitin Sai Bommi , Mariem Daboussi , Onkar Sabnis , Chakkrit Tantithamthavorn , Hadi Hemmati

Machine learning (ML) is becoming increasingly popular in meteorological decision-making. Although the literature on explainable artificial intelligence (XAI) is growing steadily, user-centered XAI studies have not extend to this domain…

Artificial Intelligence · Computer Science 2025-04-02 Soyeon Kim , Junho Choi , Yeji Choi , Subeen Lee , Artyom Stitsyuk , Minkyoung Park , Seongyeop Jeong , Youhyun Baek , Jaesik Choi

Artificial Intelligence/Machine Learning techniques have been widely used in software engineering to improve developer productivity, the quality of software systems, and decision-making. However, such AI/ML models for software engineering…

Software Engineering · Computer Science 2020-12-04 Chakkrit Tantithamthavorn , Jirayus Jiarpakdee , John Grundy

Explainable AI (XAI) is a necessity in safety-critical systems such as in clinical diagnostics due to a high risk for fatal decisions. Currently, however, XAI resembles a loose collection of methods rather than a well-defined process. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Lukas Klein , Mennatallah El-Assady , Paul F. Jäger

Explainability is highly-desired in Machine Learning (ML) systems supporting high-stakes policy decisions in areas such as health, criminal justice, education, and employment. While the field of explainable ML has expanded in recent years,…

Machine Learning · Computer Science 2023-02-21 Kasun Amarasinghe , Kit Rodolfa , Hemank Lamba , Rayid Ghani