English
Related papers

Related papers: Explaining Agent Behavior with Large Language Mode…

200 papers

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

Intelligent agents, such as robots, are increasingly deployed in real-world, human-centric environments. To foster appropriate human trust and meet legal and ethical standards, these agents must be able to explain their behavior. However,…

Machine Learning · Computer Science 2025-08-12 Zhang Xi-Jia , Yue Guo , Shufei Chen , Simon Stepputtis , Matthew Gombolay , Katia Sycara , Joseph Campbell

Reinforcement learning techniques successfully generate convincing agent behaviors, but it is still difficult to tailor the behavior to align with a user's specific preferences. What is missing is a communication method for the system to…

Human-Computer Interaction · Computer Science 2021-05-28 Christian Arzate Cruz , Takeo Igarashi

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

Automated rationale generation is an approach for real-time explanation generation whereby a computational model learns to translate an autonomous agent's internal state and action data representations into natural language. Training on…

Artificial Intelligence · Computer Science 2019-01-15 Upol Ehsan , Pradyumna Tambwekar , Larry Chan , Brent Harrison , Mark Riedl

As robots are deployed in human spaces, it is important that they are able to coordinate their actions with the people around them. Part of such coordination involves ensuring that people have a good understanding of how a robot will act in…

Robotics · Computer Science 2024-07-02 Ravi Pandya , Michelle Zhao , Changliu Liu , Reid Simmons , Henny Admoni

We present an approach to generating natural language justifications of decisions derived from norm-based reasoning. Assuming an agent which maximally satisfies a set of rules specified in an object-oriented temporal logic, the user can ask…

Computation and Language · Computer Science 2019-11-04 Daniel Kasenberg , Antonio Roque , Ravenna Thielstrom , Meia Chita-Tegmark , Matthias Scheutz

Providing plausible responses to why questions is a challenging but critical goal for language based human-machine interaction. Explanations are challenging in that they require many different forms of abstract knowledge and reasoning.…

Computation and Language · Computer Science 2019-06-05 Allen Nie , Erin D. Bennett , Noah D. Goodman

The aim of my Ph.D. thesis concerns Reasoning in Highly Reactive Environments. As reasoning in highly reactive environments, we identify the setting in which a knowledge-based agent, with given goals, is deployed in an environment subject…

Artificial Intelligence · Computer Science 2019-09-19 Francesco Pacenza

In cooperation, the workers must know how co-workers behave. However, an agent's policy, which is embedded in a statistical machine learning model, is hard to understand, and requires much time and knowledge to comprehend. Therefore, it is…

Artificial Intelligence · Computer Science 2018-10-23 Yosuke Fukuchi , Masahiko Osawa , Hiroshi Yamakawa , Michita Imai

Effective collaboration between a robot and a person requires natural communication. When a robot travels with a human companion, the robot should be able to explain its navigation behavior in natural language. This paper explains how a…

Artificial Intelligence · Computer Science 2017-09-29 Raj Korpan , Susan L. Epstein , Anoop Aroor , Gil Dekel

Adoption and deployment of robotic and autonomous systems in industry are currently hindered by the lack of transparency, required for safety and accountability. Methods for providing explanations are needed that are agnostic to the…

Robotics · Computer Science 2023-06-01 Konstantinos Gavriilidis , Andrea Munafo , Wei Pang , Helen Hastie

With the recent development of natural language generation models - termed as large language models (LLMs) - a potential use case has opened up to improve the way that humans interact with robot assistants. These LLMs should be able to…

Multiagent Systems · Computer Science 2024-11-27 Mitchell Rosser , Marc. G Carmichael

Explainable AI (XAI) systems have been proposed to help people understand how AI systems produce outputs and behaviors. Explainable Reinforcement Learning (XRL) has an added complexity due to the temporal nature of sequential…

Artificial Intelligence · Computer Science 2025-08-19 Madhuri Singh , Amal Alabdulkarim , Gennie Mansi , Mark O. Riedl

Explainable Artificial Intelligence (XAI) systems, including intelligent agents, must be able to explain their internal decisions, behaviours and reasoning that produce their choices to the humans (or other systems) with which they…

Artificial Intelligence · Computer Science 2020-09-15 Mariela Morveli-Espinoza , Ayslan Possebom , Cesar Augusto Tacla

Agent-based modeling and simulation has evolved as a powerful tool for modeling complex systems, offering insights into emergent behaviors and interactions among diverse agents. Integrating large language models into agent-based modeling…

Artificial Intelligence · Computer Science 2023-12-20 Chen Gao , Xiaochong Lan , Nian Li , Yuan Yuan , Jingtao Ding , Zhilun Zhou , Fengli Xu , Yong Li

Autonomous systems in remote locations have a high degree of autonomy and there is a need to explain what they are doing and why in order to increase transparency and maintain trust. Here, we describe a natural language chat interface that…

Computation and Language · Computer Science 2018-03-07 Francisco J. Chiyah Garcia , David A. Robb , Xingkun Liu , Atanas Laskov , Pedro Patron , Helen Hastie

In recent years, agents have become capable of communicating seamlessly via natural language and navigating in environments that involve cooperation and competition, a fact that can introduce social dilemmas. Due to the interleaving of…

Artificial Intelligence · Computer Science 2025-01-28 Maayan Orner , Oleg Maksimov , Akiva Kleinerman , Charles Ortiz , Sarit Kraus

Increasingly complex and autonomous robots are being deployed in real-world environments with far-reaching consequences. High-stakes scenarios, such as emergency response or offshore energy platform and nuclear inspections, require robot…

Human-Computer Interaction · Computer Science 2020-03-13 Francisco J. Chiyah Garcia , José Lopes , Helen Hastie

Can emergent language models faithfully model the intelligence of decision-making agents? Though modern language models exhibit already some reasoning ability, and theoretically can potentially express any probable distribution over tokens,…

Machine Learning · Computer Science 2024-06-27 Wenhao Lu , Xufeng Zhao , Josua Spisak , Jae Hee Lee , Stefan Wermter
‹ Prev 1 2 3 10 Next ›