English
Related papers

Related papers: Plan Explanations as Model Reconciliation -- An Em…

200 papers

In order to engender trust in AI, humans must understand what an AI system is trying to achieve, and why. To overcome this problem, the underlying AI process must produce justifications and explanations that are both transparent and…

Artificial Intelligence · Computer Science 2018-10-16 Rita Borgo , Michael Cashmore , Daniele Magazzeni

Machine learning models are increasingly integrated into societally critical applications such as recidivism prediction and medical diagnosis, thanks to their superior predictive power. In these applications, however, full automation is…

Human-Computer Interaction · Computer Science 2020-03-18 Vivian Lai , Samuel Carton , Chenhao Tan

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Explanation generation frameworks aim to make AI systems' decisions transparent and understandable to human users. However, generating explanations in uncertain environments characterized by incomplete information and probabilistic models…

Artificial Intelligence · Computer Science 2025-09-04 Stylianos Loukas Vasileiou , William Yeoh , Alessandro Previti , Tran Cao Son

This paper introduces a system designed to generate explanations for the actions performed by an autonomous robot in Human-Robot Interaction (HRI). Explainability in robotics, encapsulated within the concept of an eXplainable Autonomous…

Recent work on interpretability in machine learning and AI has focused on the building of simplified models that approximate the true criteria used to make decisions. These models are a useful pedagogical device for teaching trained…

Artificial Intelligence · Computer Science 2018-11-06 Brent Mittelstadt , Chris Russell , Sandra Wachter

Automated rationale generation is an approach for real-time explanation generation whereby a computational model learns to translate an autonomous agent's internal state and action data representations into natural language. Training on…

Artificial Intelligence · Computer Science 2019-01-15 Upol Ehsan , Pradyumna Tambwekar , Larry Chan , Brent Harrison , Mark Riedl

Explainable artificial intelligence is a research field that tries to provide more transparency for autonomous intelligent systems. Explainability has been used, particularly in reinforcement learning and robotic scenarios, to better…

Artificial Intelligence · Computer Science 2022-07-08 Francisco Cruz , Charlotte Young , Richard Dazeley , Peter Vamplew

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

As AI is increasingly being adopted into application solutions, the challenge of supporting interaction with humans is becoming more apparent. Partly this is to support integrated working styles, in which humans and intelligent systems…

Artificial Intelligence · Computer Science 2017-10-02 Maria Fox , Derek Long , Daniele Magazzeni

AI and ML models have already found many applications in critical domains, such as healthcare and criminal justice. However, fully automating such high-stakes applications can raise ethical or fairness concerns. Instead, in such cases,…

Artificial Intelligence · Computer Science 2023-04-28 Ioannis Papantonis , Vaishak Belle

There is a growing interest in designing autonomous agents that can work alongside humans. Such agents will undoubtedly be expected to explain their behavior and decisions. While generating explanations is an actively researched topic, most…

Artificial Intelligence · Computer Science 2021-06-24 Utkarsh Soni , Sarath Sreedharan , Subbarao Kambhampati

In order to have effective human-AI collaboration, it is necessary to address how the AI agent's behavior is being perceived by the humans-in-the-loop. When the agent's task plans are generated without such considerations, they may often…

Artificial Intelligence · Computer Science 2019-03-15 Anagha Kulkarni , Yantian Zha , Tathagata Chakraborti , Satya Gautam Vadlamudi , Yu Zhang , Subbarao Kambhampati

Human collaborators can effectively communicate with their partners to finish a common task by inferring each other's mental states (e.g., goals, beliefs, and desires). Such mind-aware communication minimizes the discrepancy among…

Artificial Intelligence · Computer Science 2020-07-28 Xiaofeng Gao , Ran Gong , Yizhou Zhao , Shu Wang , Tianmin Shu , Song-Chun Zhu

The need for explanations in AI has, by and large, been driven by the desire to increase the transparency of black-box machine learning models. However, such explanations, which focus on the internal mechanisms that lead to a specific…

Artificial Intelligence · Computer Science 2025-07-30 Laura Spillner , Nima Zargham , Mihai Pomarlan , Robert Porzel , Rainer Malaka

Ensuring fairness of machine learning systems is a human-in-the-loop process. It relies on developers, users, and the general public to identify fairness problems and make improvements. To facilitate the process we need effective, unbiased,…

Human-Computer Interaction · Computer Science 2019-01-24 Jonathan Dodge , Q. Vera Liao , Yunfeng Zhang , Rachel K. E. Bellamy , Casey Dugan

The continued development of robots has enabled their wider usage in human surroundings. Robots are more trusted to make increasingly important decisions with potentially critical outcomes. Therefore, it is essential to consider the ethical…

Artificial Intelligence · Computer Science 2022-06-22 Benjamin Krarup , Felix Lindner , Senka Krivic , Derek Long

Social AI agents interact with members of a community, thereby changing the behavior of the community. For example, in online learning, an AI social assistant may connect learners and thereby enhance social interaction. These social AI…

Computation and Language · Computer Science 2025-01-27 Rhea Basappa , Mustafa Tekman , Hong Lu , Benjamin Faught , Sandeep Kakar , Ashok K. Goel

Explanations have gained an increasing level of interest in the AI and Machine Learning (ML) communities in order to improve model transparency and allow users to form a mental model of a trained ML model. However, explanations can go…

Machine Learning · Computer Science 2022-10-11 Stefano Teso , Öznur Alkan , Wolfang Stammer , Elizabeth Daly

There has been considerable recent interest in explainability in AI, especially with black-box machine learning models. As correctly observed by the planning community, when the application at hand is not a single-shot decision or…

Artificial Intelligence · Computer Science 2025-02-14 Vaishak Belle