English
Related papers

Related papers: A Surrogate Model Framework for Explainable Autono…

200 papers

Is transparency always beneficial in complex systems such as traffic networks and stock markets? How is transparency defined in multi-agent systems, and what is its optimal degree at which social welfare is highest? We take an agent-based…

Multiagent Systems · Computer Science 2024-01-12 Kshama Dwarakanath , Svitlana Vyetrenko , Toks Oyebode , Tucker Balch

Reinforcement learning techniques successfully generate convincing agent behaviors, but it is still difficult to tailor the behavior to align with a user's specific preferences. What is missing is a communication method for the system to…

Human-Computer Interaction · Computer Science 2021-05-28 Christian Arzate Cruz , Takeo Igarashi

High-speed flight vehicles, which travel much faster than the speed of sound, are crucial for national defense and space exploration. However, accurately predicting their behavior under numerous, varied flight conditions is a challenge and…

Machine Learning · Computer Science 2024-11-07 Tyler E. Korenyi-Both , Nathan J. Falkiewicz , Matthew C. Jones

The proliferation of artificial intelligence is increasingly dependent on model understanding. Understanding demands both an interpretation - a human reasoning about a model's behavior - and an explanation - a symbolic representation of the…

Machine Learning · Computer Science 2022-08-30 Charl Maree , Christian W. Omlin

With the growing capabilities of intelligent systems, the integration of robots in our everyday life is increasing. However, when interacting in such complex human environments, the occasional failure of robotic systems is inevitable. The…

Artificial Intelligence · Computer Science 2021-08-05 Devleena Das , Siddhartha Banerjee , Sonia Chernova

There is a growing interest within the AI research community to develop autonomous systems capable of explaining their behavior to users. One aspect of the explanation generation problem that has yet to receive much attention is the task of…

Artificial Intelligence · Computer Science 2018-02-21 Sarath Sreedharan , Siddharth Srivastava , Subbarao Kambhampati

The continued development of robots has enabled their wider usage in human surroundings. Robots are more trusted to make increasingly important decisions with potentially critical outcomes. Therefore, it is essential to consider the ethical…

Artificial Intelligence · Computer Science 2022-06-22 Benjamin Krarup , Felix Lindner , Senka Krivic , Derek Long

Recent work has shown how predictive modeling can endow agents with rich knowledge of their surroundings, improving their ability to act in complex environments. We propose question-answering as a general paradigm to decode and understand…

We argue that accountability mechanisms are needed in human-AI agent relationships to ensure alignment with user and societal interests. We propose a framework according to which AI agents' engagement is conditional on appropriate user…

Human-Computer Interaction · Computer Science 2025-10-28 Benjamin Lange , Geoff Keeling , Arianna Manzini , Amanda McCroskery

As foundation models increasingly permeate sensitive domains such as healthcare, finance, and mental health, ensuring their behavior meets desired outcomes and social expectations becomes critical. Given the complexities of these…

Robotics · Computer Science 2024-12-30 Rebecca Ramnauth , Dražen Brščić , Brian Scassellati

We introduce the term Super-Reactive Systems to refer to reactive systems whose construction and behavior are complex, constantly changing and evolving, and heavily interwoven with other systems and the physical world. Finding hidden faults…

Software Engineering · Computer Science 2025-06-17 David Harel , Assaf Marron

Determining the proper level of details to develop and solve physical models is usually difficult when one encounters new engineering problems. Such difficulty comes from how to balance the time (simulation cost) and accuracy for the…

Artificial Intelligence · Computer Science 2022-02-03 Randi Wang , Morad Behandish

Recent work leverages the capabilities and commonsense priors of generative models for robot control. In this paper, we present an agentic control system in which a reasoning-capable language model plans and executes tasks by selecting and…

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

Modelling the behaviours of other agents is essential for understanding how agents interact and making effective decisions. Existing methods for agent modelling commonly assume knowledge of the local observations and chosen actions of the…

Machine Learning · Computer Science 2021-11-10 Georgios Papoudakis , Filippos Christianos , Stefano V. Albrecht

Current technologies have enabled us to track and quantify our physical state and behavior. Self-tracking aims to achieve increased awareness to decrease undesired behaviors and lead to a healthier lifestyle. However, inappropriately…

Human-Computer Interaction · Computer Science 2019-03-21 Monica Perusquía-Hernández , David Antonio Gómez Jáuregui , Marisabel Cuberos-Balda , Diego Paez-Granados

With the ever-increasing use of complex machine learning models in critical applications within the finance domain, explaining the decisions of the model has become a necessity. With applications spanning from credit scoring to credit…

Machine Learning · Computer Science 2020-09-14 Aditya Lahiri , Narayanan Unny Edakunni

Automated rationale generation is an approach for real-time explanation generation whereby a computational model learns to translate an autonomous agent's internal state and action data representations into natural language. Training on…

Artificial Intelligence · Computer Science 2019-01-15 Upol Ehsan , Pradyumna Tambwekar , Larry Chan , Brent Harrison , Mark Riedl

Consider a setting where a pre-trained agent is operating in an environment and a human operator can decide to temporarily terminate its operation and take-over for some duration of time. These kind of scenarios are common in human-machine…

Human-Computer Interaction · Computer Science 2025-05-06 Uri Menkes , Assaf Hallak , Ofra Amir

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad