English
Related papers

Related papers: Balancing Explicability and Explanation in Human-A…

200 papers

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

Artificial Intelligence · Computer Science 2018-02-05 Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , Finale Doshi-Velez

Intelligent robots need to generate and execute plans. In order to deal with the complexity of real environments, planning makes some assumptions about the world. When executing plans, the assumptions are usually not met. Most works have…

Artificial Intelligence · Computer Science 2024-03-20 Daniel Borrajo , Manuela Veloso

Recent engineering developments in specialised computational hardware, data-acquisition and storage technology have seen the emergence of Machine Learning (ML) as a powerful form of data analysis with widespread applicability beyond its…

Machine Learning · Computer Science 2022-05-19 Ashwin Srinivasan , Michael Bain , Enrico Coiera

Explanations are hypothesized to improve human understanding of machine learning models and achieve a variety of desirable outcomes, ranging from model debugging to enhancing human decision making. However, empirical studies have found…

Artificial Intelligence · Computer Science 2023-05-02 Chacha Chen , Shi Feng , Amit Sharma , Chenhao Tan

Algorithms play a crucial role in many technological systems that control or affect various aspects of our lives. As a result, providing explanations for their decisions to address the needs of users and organisations is increasingly…

Software Engineering · Computer Science 2023-05-29 Trung Dong Huynh , Niko Tsakalakis , Ayah Helal , Sophie Stalla-Bourdillon , Luc Moreau

Designing agents capable of explaining complex sequential decisions remain a significant open problem in automated decision-making. Recently, there has been a lot of interest in developing approaches for generating such explanations for…

Artificial Intelligence · Computer Science 2019-03-19 Sarath Sreedharan , Alberto Olmo , Aditya Prasad Mishra , Subbarao Kambhampati

As the interest in Artificial Intelligence continues to grow it is becoming more and more important to investigate formalization and tools that allow us to exploit logic to reason about the world. In particular, given the increasing number…

Artificial Intelligence · Computer Science 2019-09-19 Francesco Fabiano

In this paper, we report on the visualization capabilities of an Explainable AI Planning (XAIP) agent that can support human in the loop decision making. Imposing transparency and explainability requirements on such agents is especially…

We consider the problem of multi-task reasoning (MTR), where an agent can solve multiple tasks via (first-order) logic reasoning. This capability is essential for human-like intelligence due to its strong generalizability and simplicity for…

Artificial Intelligence · Computer Science 2022-02-15 Daoming Lyu , Bo Liu , Jianshu Chen

In automated planning, the need for explanations arises when there is a mismatch between a proposed plan and the user's expectation. We frame Explainable AI Planning in the context of the plan negotiation problem, in which a succession of…

Artificial Intelligence · Computer Science 2021-03-30 Benjamin Krarup , Senka Krivic , Daniele Magazzeni , Derek Long , Michael Cashmore , David E. Smith

In this paper, we provide a comprehensive outline of the different threads of work in Explainable AI Planning (XAIP) that has emerged as a focus area in the last couple of years and contrast that with earlier efforts in the field in terms…

Artificial Intelligence · Computer Science 2020-02-27 Tathagata Chakraborti , Sarath Sreedharan , Subbarao Kambhampati

As machine learning algorithms getting adopted in an ever-increasing number of applications, interpretation has emerged as a crucial desideratum. In this paper, we propose a mathematical definition for the human-interpretable model. In…

Machine Learning · Computer Science 2021-06-01 Weishen Pan , Changshui Zhang

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

"Human-aware" has become a popular keyword used to describe a particular class of AI systems that are designed to work and interact with humans. While there exists a surprising level of consistency among the works that use the label…

Robotics · Computer Science 2024-07-16 Silvia Tulli , Stylianos Loukas Vasileiou , Sarath Sreedharan

In complex multi-agent systems involving heterogeneous teams, uncertainty arises from numerous sources like environmental disturbances, model inaccuracies, and changing tasks. This causes planned trajectories to become infeasible, requiring…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Neelanga Thelasingha , Agung Julius , James Humann , James Dotterweich

This paper introduces a framework for Planning while Learning where an agent is given a goal to achieve in an environment whose behavior is only partially known to the agent. We discuss the tractability of various plan-design processes. We…

Artificial Intelligence · Computer Science 2014-11-17 S. Safra , M. Tennenholtz

Planning, as the core module of agents, is crucial in various fields such as embodied agents, web navigation, and tool using. With the development of large language models (LLMs), some researchers treat large language models as intelligent…

Computation and Language · Computer Science 2024-06-25 Tianyi Men , Pengfei Cao , Zhuoran Jin , Yubo Chen , Kang Liu , Jun Zhao

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

The adoption of machine learning in high-stakes applications such as healthcare and law has lagged in part because predictions are not accompanied by explanations comprehensible to the domain user, who often holds the ultimate…

As more robots are being deployed into human environments, a human-aware navigation planner needs to handle multiple contexts that occur in indoor and outdoor environments. In this paper, we propose a tunable human-aware robot navigation…

Robotics · Computer Science 2021-06-21 Phani Singamaneni , Anthony Favier , Rachid Alami