English
Related papers

Related papers: TED: Teaching AI to Explain its Decisions

200 papers

A multitude of explainability methods and associated fidelity performance metrics have been proposed to help better understand how modern AI systems make decisions. However, much of the current work has remained theoretical -- without much…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Julien Colin , Thomas Fel , Remi Cadene , Thomas Serre

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

In recent years, Artificial Intelligence technology has excelled in various applications across all domains and fields. However, the various algorithms in neural networks make it difficult to understand the reasons behind decisions. For…

Artificial Intelligence · Computer Science 2025-05-13 Bowen Long , Enjie Liu , Renxi Qiu , Yanqing Duan

The need for transparency of predictive systems based on Machine Learning algorithms arises as a consequence of their ever-increasing proliferation in the industry. Whenever black-box algorithmic predictions influence human affairs, the…

Machine Learning · Computer Science 2020-02-11 Kacper Sokol , Peter Flach

Explainability and comprehensibility of AI are important requirements for intelligent systems deployed in real-world domains. Users want and frequently need to understand how decisions impacting them are made. Similarly it is important to…

Computers and Society · Computer Science 2019-07-10 Roman V. Yampolskiy

In AI and law, systems that are designed for decision support should be explainable when pursuing justice. In order for these systems to be fair and responsible, they should make correct decisions and make them using a sound and transparent…

Artificial Intelligence · Computer Science 2021-05-17 Cor Steging , Silja Renooij , Bart Verheij

The explanation dimension of Artificial Intelligence (AI) based system has been a hot topic for the past years. Different communities have raised concerns about the increasing presence of AI in people's everyday tasks and how it can affect…

Human-Computer Interaction · Computer Science 2021-02-23 Juliana Jansen Ferreira , Mateus Monteiro

Automated decision systems (ADS) are increasingly used for consequential decision-making. These systems often rely on sophisticated yet opaque machine learning models, which do not allow for understanding how a given decision was arrived…

Human-Computer Interaction · Computer Science 2022-05-13 Jakob Schoeffer , Niklas Kuehl , Yvette Machowski

Explainability has been a goal for Artificial Intelligence (AI) systems since their conception, with the need for explainability growing as more complex AI models are increasingly used in critical, high-stakes settings such as healthcare.…

Artificial Intelligence · Computer Science 2020-10-06 Shruthi Chari , Oshani Seneviratne , Daniel M. Gruen , Morgan A. Foreman , Amar K. Das , Deborah L. McGuinness

Research in human-centered AI has shown the benefits of systems that can explain their predictions. Methods that allow an AI to take advice from humans in response to explanations are similarly useful. While both capabilities are…

Information Retrieval · Computer Science 2023-01-19 Benjamin Charles Germain Lee , Doug Downey , Kyle Lo , Daniel S. Weld

The integration of artificial intelligence into business processes has significantly enhanced decision-making capabilities across various industries such as finance, healthcare, and retail. However, explaining the decisions made by these AI…

Artificial Intelligence · Computer Science 2024-10-29 Arne Grobrugge , Nidhi Mishra , Johannes Jakubik , Gerhard Satzger

The current literature on AI-advised decision making -- involving explainable AI systems advising human decision makers -- presents a series of inconclusive and confounding results. To synthesize these findings, we propose a simple theory…

Artificial Intelligence · Computer Science 2024-02-05 Raymond Fok , Daniel S. Weld

Explainable Artificial Intelligence (XAI) aims to create transparency in modern AI models by offering explanations of the models to human users. There are many ways in which researchers have attempted to evaluate the quality of these XAI…

Human-Computer Interaction · Computer Science 2025-11-07 Joe Shymanski , Jacob Brue , Sandip Sen

Artificial Intelligence (AI) is being increasingly deployed in practical applications. However, there is a major concern whether AI systems will be trusted by humans. In order to establish trust in AI systems, there is a need for users to…

Artificial Intelligence · Computer Science 2021-02-16 Quratul-ain Mahesar , Simon Parsons

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

Artificial Intelligence · Computer Science 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

Artificial intelligence now outperforms humans in several scientific and engineering tasks, yet its internal representations often remain opaque. In this Perspective, we argue that explainable artificial intelligence (XAI), combined with…

Artificial Intelligence · Computer Science 2026-02-17 Ricardo Vinuesa , Steven L. Brunton , Gianmarco Mengaldo

Artificial Intelligence (AI) is one of the major technological advancements of this century, bearing incredible potential for users through AI-powered applications and tools in numerous domains. Being often black-box (i.e., its…

Human-Computer Interaction · Computer Science 2026-03-18 Eleonora Cappuccio , Andrea Esposito , Francesco Greco , Giuseppe Desolda , Rosa Lanzilotti , Salvatore Rinzivillo

Explainable AI (XAI) aims to make AI systems more transparent, yet many practices emphasise mathematical rigour over practical user needs. We propose an alternative to this model-centric approach by following a design thinking process for…

Human-Computer Interaction · Computer Science 2025-11-03 Elisa Nguyen , Johannes Bertram , Evgenii Kortukov , Jean Y. Song , Seong Joon Oh

Autonomous AI systems will be entering human society in the near future to provide services and work alongside humans. For those systems to be accepted and trusted, the users should be able to understand the reasoning process of the system,…

Machine Learning · Computer Science 2018-09-18 Rahul Iyer , Yuezhang Li , Huao Li , Michael Lewis , Ramitha Sundar , Katia Sycara