English
Related papers

Related papers: Steps Towards Satisficing Distributed Dynamic Team…

200 papers

People who design, use, and are affected by autonomous artificially intelligent agents want to be able to \emph{trust} such agents -- that is, to know that these agents will perform correctly, to understand the reasoning behind their…

Computers and Society · Computer Science 2019-02-06 Brett W Israelsen , Nisar R Ahmed

The paper begins by exploring the rationality of ethical trust as a foundational concept. This involves distinguishing between trust and trustworthiness and delving into scenarios where trust is both rational and moral. It lays the…

Social and Information Networks · Computer Science 2024-01-17 Abbas Tariverdi

Artificial intelligence (AI) holds great promise to empower us with knowledge and augment our effectiveness. We can -- and must -- ensure that we keep humans safe and in control, particularly with regard to government and public sector…

Artificial Intelligence · Computer Science 2019-10-09 Carol J. Smith

With recent advancements in AI and computation tools, intelligent paradigms emerged to empower different fields such as healthcare robots with new capabilities. Advanced AI robotic algorithms (e.g., reinforcement learning) can be trained…

Robotics · Computer Science 2024-07-25 Reza Abiri , Ali Rabiee , Sima Ghafoori , Anna Cetera

Scientists and philosophers have debated whether humans can trust advanced artificial intelligence (AI) agents to respect humanity's best interests. Yet what about the reverse? Will advanced AI agents trust humans? Gauging an AI agent's…

Artificial Intelligence · Computer Science 2022-12-29 Tim Johnson , Nick Obradovich

Trust is not just a cognitive issue but also an emotional one, yet the research in human-AI interactions has primarily focused on the cognitive route of trust development. Recent work has highlighted the importance of studying affective…

Human-Computer Interaction · Computer Science 2024-11-11 Ruoxi Shang , Gary Hsieh , Chirag Shah

It is an amazing fact that remarkably complex behaviors could emerge from a large collection of very rudimentary dynamical agents through very simple local interactions. However, it still remains elusive on how to design these local…

Multiagent Systems · Computer Science 2011-01-13 Mohammad Karimadini , Hai Lin

Handling trust is one of the core requirements for facilitating effective interaction between the human and the AI agent. Thus, any decision-making framework designed to work with humans must possess the ability to estimate and leverage…

Artificial Intelligence · Computer Science 2023-01-31 Zahra Zahedi , Sarath Sreedharan , Subbarao Kambhampati

When we go for a walk with friends, we can observe an interesting effect: From step lengths to arm movements - our movements unconsciously align; they synchronize. Prior research found that this synchronization is a crucial aspect of human…

Human-Computer Interaction · Computer Science 2023-05-01 Wieslaw Bartkowski , Andrzej Nowak , Filip Ignacy Czajkowski , Albrecht Schmidt , Florian Müller

In the context of humans operating with artificial or autonomous agents in a hybrid team, it is essential to accurately identify when to authorize those team members to perform actions. Given past examples where humans and autonomous…

Artificial Intelligence · Computer Science 2023-10-12 Andrew Fuchs , Andrea Passarella , Marco Conti

Collaboration requires coordination, and we coordinate by anticipating our teammates' future actions and adapting to their plan. In some cases, our teammates' actions early on can give us a clear idea of what the remainder of their plan is,…

Trust is a central component of the interaction between people and AI, in that 'incorrect' levels of trust may cause misuse, abuse or disuse of the technology. But what, precisely, is the nature of trust in AI? What are the prerequisites…

Artificial Intelligence · Computer Science 2021-01-21 Alon Jacovi , Ana Marasović , Tim Miller , Yoav Goldberg

With robots becoming increasingly prevalent in various domains, it has become crucial to equip them with tools to achieve greater fluency in interactions with humans. One of the promising areas for further exploration lies in human trust. A…

Robotics · Computer Science 2025-04-08 Haley N. Green , Tariq Iqbal

This work considers the problem of resilient consensus where stochastic values of trust between agents are available. Specifically, we derive a unified mathematical framework to characterize convergence, deviation of the consensus from the…

Optimization and Control · Mathematics 2025-05-07 Michal Yemini , Angelia Nedić , Andrea Goldsmith , Stephanie Gil

The problem of human trust in artificial intelligence is one of the most fundamental problems in applied machine learning. Our processes for evaluating AI trustworthiness have substantial ramifications for ML's impact on science, health,…

Machine Learning · Computer Science 2022-02-14 Max W. Shen

How should a robot that collaborates with multiple people decide upon the distribution of resources (e.g. social attention, or parts needed for an assembly)? People are uniquely attuned to how resources are distributed. A decision to…

Artificial Intelligence · Computer Science 2020-12-08 Houston Claure , Yifang Chen , Jignesh Modi , Malte Jung , Stefanos Nikolaidis

We propose a method, based on empirical game theory, for a robot operating as part of a team to choose its role within the team without explicitly communicating with team members, by leveraging its knowledge about the team structure. To do…

Multiagent Systems · Computer Science 2021-10-01 Fengjun Yang , Negar Mehr , Mac Schwager

User trust in Artificial Intelligence (AI) enabled systems has been increasingly recognized and proven as a key element to fostering adoption. It has been suggested that AI-enabled systems must go beyond technical-centric approaches and…

Human-Computer Interaction · Computer Science 2023-12-05 Tita Alissa Bach , Amna Khan , Harry Hallock , Gabriela Beltrão , Sonia Sousa

Artificial intelligence (AI) technologies (re-)shape modern life, driving innovation in a wide range of sectors. However, some AI systems have yielded unexpected or undesirable outcomes or have been used in questionable manners. As a…

We identify a fundamental incompatibility between the goals of accuracy, trust, and human-level reasoning in artificial intelligence (AI) systems, for strict mathematical definitions of these notions. We define accuracy of a system as the…

Machine Learning · Computer Science 2026-05-11 Rina Panigrahy , Vatsal Sharan