English
Related papers

Related papers: Human Trust-based Feedback Control: Dynamically va…

200 papers

Human trust in social robots is a complex attitude based on cognitive and emotional evaluations, as well as a behavior, like task delegation. While previous research explored the features of robots that influence overall trust attitude, it…

Human-Computer Interaction · Computer Science 2025-03-31 Filippo Cantucci , Marco Marini , Rino Falcone

AI systems are being deployed to support human decision making in high-stakes domains. In many cases, the human and AI form a team, in which the human makes decisions after reviewing the AI's inferences. A successful partnership requires…

Human-Computer Interaction · Computer Science 2019-06-06 Gagan Bansal , Besmira Nushi , Ece Kamar , Dan Weld , Walter Lasecki , Eric Horvitz

Defining and measuring trust in dynamic, multiagent teams is important in a range of contexts, particularly in defense and security domains. Team members should be trusted to work towards agreed goals and in accordance with shared values.…

Artificial Intelligence · Computer Science 2024-01-26 Edmund R. Hunt , Chris Baber , Mehdi Sobhani , Sanja Milivojevic , Sagir Yusuf , Mirco Musolesi , Patrick Waterson , Sally Maynard

In Human-Robot Collaboration, the robot operates in a highly dynamic environment. Thus, it is pivotal to guarantee the robust stability of the system during the interaction but also a high flexibility of the robot behavior in order to…

Robotics · Computer Science 2021-03-05 Federico Benzi , Cristian Secchi

Humans rely more and more on systems with AI components. The AI community typically treats human inputs as a given and optimizes AI models only. This thinking is one-sided and it neglects the fact that humans can learn, too. In this work,…

Human-Computer Interaction · Computer Science 2020-09-22 Johannes Schneider

The increasing use of artificial intelligence (AI) systems in our daily life through various applications, services, and products explains the significance of trust/distrust in AI from a user perspective. AI-driven systems (as opposed to…

Computers and Society · Computer Science 2024-04-05 Saleh Afroogh , Ali Akbari , Evan Malone , Mohammadali Kargar , Hananeh Alambeigi

A trust-aware safe control system for autonomous navigation in the presence of humans, specifically pedestrians, is presented. The system combines model predictive control (MPC) with control barrier functions (CBFs) and trust estimation to…

Systems and Control · Electrical Eng. & Systems 2024-11-01 Saad Ejaz , Masaki Inoue

The use of artificial intelligence models has recently grown common; we may use them to write lines of code for us, summarize readings, draft emails, or even illustrate images. But when it comes to important decisions we need to make, such…

Human-Computer Interaction · Computer Science 2024-01-26 Ali Saffarini

To facilitate the widespread acceptance of AI systems guiding decision-making in real-world applications, it is key that solutions comprise trustworthy, integrated human-AI systems. Not only in safety-critical applications such as…

Artificial Intelligence · Computer Science 2020-01-16 Florian Buettner , John Piorkowski , Ian McCulloh , Ulli Waltinger

Since trust measures in human-robot interaction are often subjective or not possible to implement real-time, we propose to use speech cues (on what, when and how the user talks) as an objective real-time measure of trust. This could be…

Human-Computer Interaction · Computer Science 2021-04-13 Ella Velner , Khiet P. Truong , Vanessa Evers

Autonomous systems can substantially enhance a human's efficiency and effectiveness in complex environments. Machines, however, are often unable to observe the preferences of the humans that they serve. Despite the fact that the human's and…

Machine Learning · Statistics 2017-05-29 Agostino Capponi , Reza Ghanadan , Matt Stern

Effective collaboration between humans and AI-based systems requires effective modeling of the human in the loop, both in terms of the mental state as well as the physical capabilities of the latter. However, these models can also open up…

Artificial Intelligence · Computer Science 2018-01-31 Tathagata Chakraborti , Subbarao Kambhampati

AI design characteristics and human personality traits each impact the quality and outcomes of human-AI interactions. However, their relative and joint impacts are underexplored in imperfectly cooperative scenarios, where people and AI only…

Computation and Language · Computer Science 2026-04-20 Myke C. Cohen , Mingqian Zheng , Neel Bhandari , Hsien-Te Kao , Xuhui Zhou , Daniel Nguyen , Laura Cassani , Maarten Sap , Svitlana Volkova

How much are we to trust a decision made by an AI algorithm? Trusting an algorithm without cause may lead to abuse, and mistrusting it may similarly lead to disuse. Trust in an AI is only desirable if it is warranted; thus, calibrating…

Human-Computer Interaction · Computer Science 2023-03-27 Neil Natarajan , Reuben Binns , Jun Zhao , Nigel Shadbolt

This paper investigates the influence of anthropomorphized descriptions of so-called "AI" (artificial intelligence) systems on people's self-assessment of trust in the system. Building on prior work, we define four categories of…

Human-Computer Interaction · Computer Science 2024-06-10 Nanna Inie , Stefania Druga , Peter Zukerman , Emily M. Bender

Automated decision systems are increasingly used for consequential decision making -- for a variety of reasons. These systems often rely on sophisticated yet opaque models, which do not (or hardly) allow for understanding how or why a given…

Artificial Intelligence · Computer Science 2021-03-09 Jakob Schoeffer , Yvette Machowski , Niklas Kuehl

This article explores human-horse interactions as a metaphor for understanding and designing effective human-AI partnerships. Drawing on the long history of human collaboration with horses, we propose that AI, like horses, should complement…

Human-Computer Interaction · Computer Science 2025-12-23 Mohammad Hossein Jarrahi , Stanley Ahalt

In AI-assisted decision-making, it is crucial but challenging for humans to appropriately rely on AI, especially in high-stakes domains such as finance and healthcare. This paper addresses this problem from a human-centered perspective by…

Human-Computer Interaction · Computer Science 2025-02-21 Takehiro Takayanagi , Ryuji Hashimoto , Chung-Chi Chen , Kiyoshi Izumi

Successful design of human-in-the-loop control systems requires appropriate models for human decision makers. Whilst most paradigms adopted in the control systems literature hide the (limited) decision capability of humans, in behavioral…

Optimization and Control · Mathematics 2020-08-03 Marius Protte , Rene Fahr , Daniel E. Quevedo

The widespread utilization of AI systems has drawn attention to the potential impacts of such systems on society. Of particular concern are the consequences that prediction errors may have on real-world scenarios, and the trust humanity…

Computers and Society · Computer Science 2021-06-22 Mary Roszel , Robert Norvill , Jean Hilger , Radu State