English
Related papers

Related papers: Measuring an artificial intelligence agent's trust…

200 papers

Large Language Models based on transformer algorithms have revolutionized Artificial Intelligence by enabling verbal interaction with machines akin to human conversation. These AI agents have surpassed the Turing Test, achieving confusion…

Large Language Model (LLM) agents have been increasingly adopted as simulation tools to model humans in social science and role-playing applications. However, one fundamental question remains: can LLM agents really simulate human behavior?…

Artificial Intelligence · Computer Science 2024-11-04 Chengxing Xie , Canyu Chen , Feiran Jia , Ziyu Ye , Shiyang Lai , Kai Shu , Jindong Gu , Adel Bibi , Ziniu Hu , David Jurgens , James Evans , Philip Torr , Bernard Ghanem , Guohao Li

In this paper, we analyze the performance of an agent developed according to a well-accepted appraisal theory of human emotion with respect to how it modulates play in the context of a social dilemma. We ask if the agent will be capable of…

Artificial Intelligence · Computer Science 2021-07-19 Moojan Ghafurian , Neil Budnarain , Jesse Hoey

In recent years the use of Artificial Intelligence (AI) has become increasingly prevalent in a growing number of fields. As AI systems are being adopted in more high-stakes areas such as medicine and finance, ensuring that they are…

Human-Computer Interaction · Computer Science 2023-11-03 Tobias M. Peters , Roel W. Visser

This study examines the understudied role of algorithmic evaluation of human judgment in hybrid decision-making systems, a critical gap in management research. While extant literature focuses on human reluctance to follow algorithmic…

Human-Computer Interaction · Computer Science 2025-04-22 Yuanjun Feng , Vivek Chodhary , Yash Raj Shrestha

Autonomous agents (AA) will increasingly be interacting with us in our daily lives. While we want the benefits attached to AAs, it is essential that their behavior is aligned with our values and norms. Hence, an AA will need to estimate the…

Artificial Intelligence · Computer Science 2021-05-17 Luciano Cavalcante Siebert , Rijk Mercuur , Virginia Dignum , Jeroen van den Hoven , Catholijn Jonker

Today, AI is being increasingly used to help human experts make decisions in high-stakes scenarios. In these scenarios, full automation is often undesirable, not only due to the significance of the outcome, but also because human experts…

Artificial Intelligence · Computer Science 2020-01-08 Yunfeng Zhang , Q. Vera Liao , Rachel K. E. Bellamy

Handling trust is one of the core requirements for facilitating effective interaction between the human and the AI agent. Thus, any decision-making framework designed to work with humans must possess the ability to estimate and leverage…

Artificial Intelligence · Computer Science 2023-01-31 Zahra Zahedi , Sarath Sreedharan , Subbarao Kambhampati

Building trust in AI-based systems is deemed critical for their adoption and appropriate use. Recent research has thus attempted to evaluate how various attributes of these systems affect user trust. However, limitations regarding the…

Human-Computer Interaction · Computer Science 2022-04-29 Michaela Benk , Suzanne Tolmeijer , Florian von Wangenheim , Andrea Ferrario

Given the fast rise of increasingly autonomous artificial agents and robots, a key acceptability criterion will be the possible moral implications of their actions. In particular, intelligent persuasive systems (systems designed to…

Computers and Society · Computer Science 2014-04-16 Marco Guerini , Fabio Pianesi , Oliviero Stock

This study critically examines the commonly held assumption that explicability in artificial intelligence (AI) systems inherently boosts user trust. Utilizing a meta-analytical approach, we conducted a comprehensive examination of the…

Artificial Intelligence · Computer Science 2025-04-18 Zahra Atf , Peter R. Lewis

Recent research on human robot interaction explored whether people's tendency to conform to others extends to artificial agents (Hertz & Wiese, 2016). However, little is known about to what extent perception of a robot as having a mind…

Robotics · Computer Science 2018-11-05 Deniz Lefkeli , Baris Akgun , Sahibzada Omar , Aansa Malik , Zeynep Gurhan Canli , Terry Eskenazi

Interaction and cooperation with humans are overarching aspirations of artificial intelligence (AI) research. Recent studies demonstrate that AI agents trained with deep reinforcement learning are capable of collaborating with humans. These…

Human-Computer Interaction · Computer Science 2024-05-10 Kevin R. McKee , Xuechunzi Bai , Susan T. Fiske

Classic evaluation methods of believable agents are time-consuming because they involve many human to judge agents. They are well suited to validate work on new believable behaviours models. However, during the implementation, numerous…

Artificial Intelligence · Computer Science 2010-09-03 Fabien Tencé , Cédric Buche

Explainability, interpretability and how much they affect human trust in AI systems are ultimately problems of human cognition as much as machine learning, yet the effectiveness of AI recommendations and the trust afforded by end-users are…

Human-Computer Interaction · Computer Science 2022-02-21 Ali Shafti , Victoria Derks , Hannah Kay , A. Aldo Faisal

As anthropomorphic agents (AI and robots) are increasingly used in society, empathy and trust between people and agents are becoming increasingly important. A better understanding of agents by people will help to improve the problems caused…

Human-Computer Interaction · Computer Science 2025-04-22 Takahiro Tsumura , Seiji Yamada

Appropriate Trust in Artificial Intelligence (AI) systems has rapidly become an important area of focus for both researchers and practitioners. Various approaches have been used to achieve it, such as confidence scores, explanations,…

Human-Computer Interaction · Computer Science 2023-11-14 Siddharth Mehrotra , Chadha Degachi , Oleksandra Vereschak , Catholijn M. Jonker , Myrthe L. Tielman

In this paper, we show that counterfactual explanations of confidence scores help users better understand and better trust an AI model's prediction in human-subject studies. Showing confidence scores in human-agent interaction systems can…

Machine Learning · Computer Science 2022-06-08 Thao Le , Tim Miller , Ronal Singh , Liz Sonenberg

How to attribute responsibility for autonomous artificial intelligence (AI) systems' actions has been widely debated across the humanities and social science disciplines. This work presents two experiments ($N$=200 each) that measure…

Computers and Society · Computer Science 2021-02-02 Gabriel Lima , Nina Grgić-Hlača , Meeyoung Cha

Trust between humans and artificial intelligence(AI) is an issue which has implications in many fields of human computer interaction. The current issue with artificial intelligence is a lack of transparency into its decision making, and…

Human-Computer Interaction · Computer Science 2021-08-11 Arnav Kartikeya