English
Related papers

Related papers: Discovering User-Interpretable Capabilities of Bla…

200 papers

Artificial Intelligence has emerged as a useful aid in numerous clinical applications for diagnosis and treatment decisions. Deep neural networks have shown same or better performance than clinicians in many tasks owing to the rapid…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Zohaib Salahuddin , Henry C Woodruff , Avishek Chatterjee , Philippe Lambin

We grapple with the question: How, for whom and why should explainable artificial intelligence (XAI) aim to support the user goal of agency? In particular, we analyze the relationship between agency and explanations through a user-centric…

Human-Computer Interaction · Computer Science 2023-12-07 Iyadunni Adenuga , Jonathan Dodge

Existing approaches for the design of interpretable agent behavior consider different measures of interpretability in isolation. In this paper we posit that, in the design and deployment of human-aware agents in the real world, notions of…

Artificial Intelligence · Computer Science 2020-11-24 Sarath Sreedharan , Anagha Kulkarni , Tathagata Chakraborti , David E. Smith , Subbarao Kambhampati

The development of artificial agents for social interaction pushes to enrich robots with social skills and knowledge about (local) social norms. One possibility is to distinguish the expressive and the functional orders during a human-robot…

Artificial Intelligence · Computer Science 2023-08-08 Chiara Bassetti , Enrico Blanzieri , Stefano Borgo , Sofia Marangon

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

The field of AI is undergoing a fundamental transition from generative models that can produce synthetic content to artificial agents that can plan and execute complex tasks with only limited human involvement. Companies that pioneered the…

Artificial Intelligence · Computer Science 2025-02-12 Noam Kolt

As robots are deployed in human spaces, it is important that they are able to coordinate their actions with the people around them. Part of such coordination involves ensuring that people have a good understanding of how a robot will act in…

Robotics · Computer Science 2024-07-02 Ravi Pandya , Michelle Zhao , Changliu Liu , Reid Simmons , Henny Admoni

The question addressed in this paper is: If we present to a user an AI system that explains how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? In other words, how do we…

Artificial Intelligence · Computer Science 2019-02-04 Robert R. Hoffman , Shane T. Mueller , Gary Klein , Jordan Litman

This paper develops a control-theoretic framework for analyzing agentic systems embedded within feedback control loops, where an AI agent may adapt controller parameters, select among control strategies, invoke external tools, reconfigure…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Ali Eslami , Jiangbo Yu

Frontier AI systems require governance mechanisms that can verify internal alignment, not just behavioral compliance. Private governance mechanisms audits, certification, insurance, and procurement are emerging to complement public…

Machine Learning · Computer Science 2025-11-21 Aadit Sengupta , Pratinav Seth , Vinay Kumar Sankarapu

Identifying and resolving conflicts of interests is a key challenge when designing autonomous agents. For example, such conflicts often occur when complex information systems interact persuasively with humans and are in the future likely to…

Multiagent Systems · Computer Science 2019-02-22 Timotheus Kampik , Juan Carlos Nieves , Helena Lindgren

This paper provides empirical concerns about post-hoc explanations of black-box ML models, one of the major trends in AI explainability (XAI), by showing its lack of interpretability and societal consequences. Using a representative…

Human-Computer Interaction · Computer Science 2021-10-01 Jean-Marie John-Mathews

People are relying on AI agents to assist them with various tasks. The human must know when to rely on the agent, collaborate with the agent, or ignore its suggestions. In this work, we propose to learn rules, grounded in data regions and…

Machine Learning · Computer Science 2023-11-09 Hussein Mozannar , Jimin J Lee , Dennis Wei , Prasanna Sattigeri , Subhro Das , David Sontag

We consider the human-aware task planning problem where a human-robot team is given a shared task with a known objective to achieve. Recent approaches tackle it by modeling it as a team of independent, rational agents, where the robot plans…

Robotics · Computer Science 2022-10-18 Anthony Favier , Shashank Shekhar , Rachid Alami

Agents can achieve effective interaction with previously unknown other agents by maintaining beliefs over a set of hypothetical behaviours, or types, that these agents may have. A current limitation in this method is that it does not…

Multiagent Systems · Computer Science 2019-06-27 Stefano V. Albrecht , Peter Stone

Real-life agents seldom have unlimited reasoning power. In this paper, we propose and study a new formal notion of computationally bounded strategic ability in multi-agent systems. The notion characterizes the ability of a set of agents to…

Multiagent Systems · Computer Science 2023-10-27 Catalin Dima , Wojciech Jamroga

AI has proven highly successful at urban planning analysis -- learning patterns from data to predict future conditions. The next frontier is AI-assisted decision-making: agents that recommend sites, allocate resources, and evaluate…

Artificial Intelligence · Computer Science 2025-11-10 Sijie Yang , Jiatong Li , Filip Biljecki

The questions which we will consider here are "What is AI?" and "How can we make AI?". Here we will present the definition of AI in terms of multi-agent systems. This means that here you will not find a new answer to the question "What is…

Artificial Intelligence · Computer Science 2012-10-03 Dimiter Dobrev

As AI becomes more "agentic," it faces technical and socio-legal issues it must address if it is to fulfill its promise of increased economic productivity and efficiency. This paper uses technical and legal perspectives to explain how…

Computers and Society · Computer Science 2025-08-13 Mark O. Riedl , Deven R. Desai

Conversational AI agents are commonly applied within single-user, turn-taking scenarios. The interaction mechanics of these scenarios are trivial: when the user enters a message, the AI agent produces a response. However, the interaction…