English
Related papers

Related papers: How to Answer Why -- Evaluating the Explanations o…

200 papers

As AI systems become more advanced and widely deployed, there will likely be increasing debate over whether AI systems could have conscious experiences, desires, or other states of potential moral significance. It is important to inform…

Machine Learning · Computer Science 2023-11-16 Ethan Perez , Robert Long

The mental models that humans form of other agents---encapsulating human beliefs about agent goals, intentions, capabilities, and more---create an underlying basis for interaction. These mental models have the potential to affect both the…

Robotics · Computer Science 2020-01-07 Connor Brooks , Daniel Szafir

Artificial Intelligence (AI) is being increasingly deployed in practical applications. However, there is a major concern whether AI systems will be trusted by humans. In order to establish trust in AI systems, there is a need for users to…

Artificial Intelligence · Computer Science 2021-02-16 Quratul-ain Mahesar , Simon Parsons

Due to the black-box nature of deep learning models, methods for explaining the models' results are crucial to gain trust from humans and support collaboration between AIs and humans. In this paper, we consider several model-agnostic and…

Computation and Language · Computer Science 2019-08-30 Piyawat Lertvittayakumjorn , Francesca Toni

Computational modeling plays an increasingly important role in neuroscience, highlighting the philosophical question of how computational models explain. In the context of neural network models for neuroscience, concerns have been raised…

Neurons and Cognition · Quantitative Biology 2021-04-15 Rosa Cao , Daniel Yamins

Human attention modelling has proven, in recent years, to be particularly useful not only for understanding the cognitive processes underlying visual exploration, but also for providing support to artificial intelligence models that aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Giuseppe Cartella , Marcella Cornia , Vittorio Cuculo , Alessandro D'Amelio , Dario Zanca , Giuseppe Boccignone , Rita Cucchiara

Despite the proliferation of explainable AI (XAI) methods, little is understood about end-users' explainability needs and behaviors around XAI explanations. To address this gap and contribute to understanding how explainability can support…

Human-Computer Interaction · Computer Science 2023-02-20 Sunnie S. Y. Kim , Elizabeth Anne Watkins , Olga Russakovsky , Ruth Fong , Andrés Monroy-Hernández

Many high-performance models suffer from a lack of interpretability. There has been an increasing influx of work on explainable artificial intelligence (XAI) in order to disentangle what is meant and expected by XAI. Nevertheless, there is…

Machine Learning · Computer Science 2019-10-23 Adrien Bennetot , Jean-Luc Laurent , Raja Chatila , Natalia Díaz-Rodríguez

Automated rationale generation is an approach for real-time explanation generation whereby a computational model learns to translate an autonomous agent's internal state and action data representations into natural language. Training on…

Artificial Intelligence · Computer Science 2019-01-15 Upol Ehsan , Pradyumna Tambwekar , Larry Chan , Brent Harrison , Mark Riedl

Displaying confidence scores in human-AI interaction has been shown to help build trust between humans and AI systems. However, most existing research uses only the confidence score as a form of communication. As confidence scores are just…

Artificial Intelligence · Computer Science 2023-03-13 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

We present a new explainable AI (XAI) framework aimed at increasing justified human trust and reliance in the AI machine through explanations. We pose explanation as an iterative communication process, i.e. dialog, between the machine and…

Artificial Intelligence · Computer Science 2019-09-17 Arjun R. Akula , Changsong Liu , Sari Saba-Sadiya , Hongjing Lu , Sinisa Todorovic , Joyce Y. Chai , Song-Chun Zhu

Explanation is necessary for humans to understand and accept decisions made by an AI system when the system's goal is known. It is even more important when the AI system makes decisions in multi-agent environments where the human does not…

Artificial intelligence (AI) tools are being incorporated into scientific research workflows with the potential to enhance efficiency in tasks such as document analysis, question answering (Q&A), and literature search. However, system…

Artificial Intelligence · Computer Science 2026-05-13 Anthea Dathe , Kiran Hoffmann , Aline Mangold

Smart home systems are gaining popularity as homeowners strive to enhance their living and working environments while minimizing energy consumption. However, the adoption of artificial intelligence (AI)-enabled decision-making models in…

Human-Computer Interaction · Computer Science 2024-07-30 Md Shajalal , Alexander Boden , Gunnar Stevens , Delong Du , Dean-Robin Kern

People's decision-making abilities often fail to improve or may even erode when they rely on AI for decision-support, even when the AI provides informative explanations. We argue this is partly because people intuitively seek contrastive…

Human-Computer Interaction · Computer Science 2025-03-20 Zana Buçinca , Siddharth Swaroop , Amanda E. Paluch , Finale Doshi-Velez , Krzysztof Z. Gajos

As AI models become ever more complex and intertwined in humans' daily lives, greater levels of interactivity of explainable AI (XAI) methods are needed. In this paper, we propose the use of belief change theory as a formal foundation for…

Artificial Intelligence · Computer Science 2024-08-15 Antonio Rago , Maria Vanina Martinez

Human-AI decision making is becoming increasingly ubiquitous, and explanations have been proposed to facilitate better Human-AI interactions. Recent research has investigated the positive impact of explanations on decision subjects'…

Human-Computer Interaction · Computer Science 2023-05-02 Mireia Yurrita , Agathe Balayn , Ujwal Gadiraju

Deep learning models for natural language processing (NLP) are increasingly adopted and deployed by analysts without formal training in NLP or machine learning (ML). However, the documentation intended to convey the model's details and…

Human-Computer Interaction · Computer Science 2022-05-09 Anamaria Crisan , Margaret Drouhard , Jesse Vig , Nazneen Rajani

The increasing prevalence of Artificial Intelligence (AI) in safety-critical contexts such as air-traffic control leads to systems that are practical and efficient, and to some extent explainable to humans to be trusted and accepted. The…

Computers and Society · Computer Science 2023-06-28 Sabine Theis , Sophie Jentzsch , Fotini Deligiannaki , Charles Berro , Arne Peter Raulf , Carmen Bruder

Explainability is one of the key ethical concepts in the design of AI systems. However, attempts to operationalize this concept thus far have tended to focus on approaches such as new software for model interpretability or guidelines with…

Computers and Society · Computer Science 2020-10-06 Ben Zevenbergen , Allison Woodruff , Patrick Gage Kelley