English
Related papers

Related papers: The Limits of Predicting Agents from Behaviour

200 papers

To enable effective human-AI collaboration, merely optimizing AI performance without considering human factors is insufficient. Recent research has shown that designing AI agents that take human behavior into account leads to improved…

Artificial Intelligence · Computer Science 2025-05-21 Guanghui Yu , Robert Kasumba , Chien-Ju Ho , William Yeoh

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

Scientists and philosophers have debated whether humans can trust advanced artificial intelligence (AI) agents to respect humanity's best interests. Yet what about the reverse? Will advanced AI agents trust humans? Gauging an AI agent's…

Artificial Intelligence · Computer Science 2022-12-29 Tim Johnson , Nick Obradovich

With humans interacting with AI-based systems at an increasing rate, it is necessary to ensure the artificial systems are acting in a manner which reflects understanding of the human. In the case of humans and artificial AI agents operating…

Human-Computer Interaction · Computer Science 2023-02-03 Andrew Fuchs , Andrea Passarella , Marco Conti

In this paper we, an epistemologist and a machine learning scientist, argue that we need to pursue a novel area of philosophical research in AI - the ethics of belief for AI. Here we take the ethics of belief to refer to a field at the…

Computers and Society · Computer Science 2024-04-16 Winnie Ma , Vincent Valton

The more AI agents are deployed in scenarios with possibly unexpected situations, the more they need to be flexible, adaptive, and creative in achieving the goal we have given them. Thus, a certain level of freedom to choose the best path…

Artificial Intelligence · Computer Science 2018-12-11 Francesca Rossi , Nicholas Mattei

There is a long history in game theory on the topic of Bayesian or "rational" learning, in which each player maintains beliefs over a set of alternative behaviours, or types, for the other players. This idea has gained increasing interest…

Artificial Intelligence · Computer Science 2016-03-03 Stefano V. Albrecht , Jacob W. Crandall , Subramanian Ramamoorthy

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts, however, their behavior is…

Machine Learning · Computer Science 2023-09-20 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

This book-length article combines several peer reviewed papers and new material to analyze the issues of ethical artificial intelligence (AI). The behavior of future AI systems can be described by mathematical equations, which are adapted…

Artificial Intelligence · Computer Science 2015-11-18 Bill Hibbard

Intelligent agents such as robots are increasingly deployed in real-world, safety-critical settings. It is vital that these agents are able to explain the reasoning behind their decisions to human counterparts; however, their behavior is…

Machine Learning · Computer Science 2023-12-01 Xijia Zhang , Yue Guo , Simon Stepputtis , Katia Sycara , Joseph Campbell

The deployment of capable AI agents raises fresh questions about safety, human-machine relationships and social coordination. We argue for greater engagement by scientists, scholars, engineers and policymakers with the implications of a…

Computers and Society · Computer Science 2025-09-15 Iason Gabriel , Geoff Keeling , Arianna Manzini , James Evans

As AI becomes more "agentic," it faces technical and socio-legal issues it must address if it is to fulfill its promise of increased economic productivity and efficiency. This paper uses technical and legal perspectives to explain how…

Computers and Society · Computer Science 2025-08-13 Mark O. Riedl , Deven R. Desai

Existing approaches for generating human-aware agent behaviors have considered different measures of interpretability in isolation. Further, these measures have been studied under differing assumptions, thus precluding the possibility of…

Artificial Intelligence · Computer Science 2021-04-23 Sarath Sreedharan , Anagha Kulkarni , David E. Smith , Subbarao Kambhampati

A key feature of human theory-of-mind is the ability to attribute beliefs to other agents as mentalistic explanations for their behavior. But given the wide variety of beliefs that agents may hold about the world and the rich language we…

Computation and Language · Computer Science 2025-05-27 Lance Ying , Almog Hillel , Ryan Truong , Vikash K. Mansinghka , Joshua B. Tenenbaum , Tan Zhi-Xuan

Verification and validation of agentic behavior have been suggested as important research priorities in efforts to reduce risks associated with the creation of general artificial intelligence (Russell et al 2015). In this paper we question…

Artificial Intelligence · Computer Science 2016-10-12 David J. Jilk

We explore conclusions a person draws from observing society when he allows for the possibility that individuals' outcomes are affected by group-level discrimination. Injecting a single non-classical assumption, that the agent is…

Theoretical Economics · Economics 2019-09-19 Paul Heidhues , Botond Kőszegi , Philipp Strack

Intelligent agents, such as robots, are increasingly deployed in real-world, human-centric environments. To foster appropriate human trust and meet legal and ethical standards, these agents must be able to explain their behavior. However,…

Machine Learning · Computer Science 2025-08-12 Zhang Xi-Jia , Yue Guo , Shufei Chen , Simon Stepputtis , Matthew Gombolay , Katia Sycara , Joseph Campbell

Intention is an important and challenging concept in AI. It is important because it underlies many other concepts we care about, such as agency, manipulation, legal responsibility, and blame. However, ascribing intent to AI systems is…

Artificial Intelligence · Computer Science 2024-02-16 Francis Rhys Ward , Matt MacDermott , Francesco Belardinelli , Francesca Toni , Tom Everitt

Agentic AIs $-$ AIs that are capable and permitted to undertake complex actions with little supervision $-$ mark a new frontier in AI capabilities and raise new questions about how to safely create and align such systems with users,…

Computers and Society · Computer Science 2024-10-04 Hayley Clatterbuck , Clinton Castro , Arvo Muñoz Morán

There is a clear desire to model and comprehend human behavior. Trends in research covering this topic show a clear assumption that many view human reasoning as the presupposed standard in artificial reasoning. As such, topics such as game…

Artificial Intelligence · Computer Science 2022-05-16 Andrew Fuchs , Andrea Passarella , Marco Conti
‹ Prev 1 2 3 10 Next ›