English
Related papers

Related papers: Measuring an artificial intelligence agent's trust…

200 papers

This work proposes a framework that incorporates trust in an ad hoc teamwork scenario with human-agent teams, where an agent must collaborate with a human to perform a task. During the task, the agent must infer, through interactions and…

Human-Computer Interaction · Computer Science 2022-10-14 Ana Carrasco

Artificial intelligence (AI) comes with great opportunities but can also pose significant risks. Automatically generated explanations for decisions can increase transparency and foster trust, especially for systems based on automated…

Machine Learning · Computer Science 2021-12-03 Johannes Schneider , Christian Meske , Michalis Vlachos

AI practitioners typically strive to develop the most accurate systems, making an implicit assumption that the AI system will function autonomously. However, in practice, AI systems often are used to provide advice to people in domains…

Artificial Intelligence · Computer Science 2021-02-23 Gagan Bansal , Besmira Nushi , Ece Kamar , Eric Horvitz , Daniel S. Weld

As machine learning systems become more powerful they also become increasingly unpredictable and opaque. Yet, finding human-understandable explanations of how they work is essential for their safe deployment. This technical report…

AI systems are increasingly intertwined with daily life, assisting users with various tasks and guiding decision-making. This integration introduces risks of AI-driven manipulation, where such systems may exploit users' cognitive biases and…

In human society, trust is an essential component of social attitude that helps build and maintain long-term, healthy relationships which creates a strong foundation for cooperation, enabling individuals to work together effectively and…

Human-Computer Interaction · Computer Science 2025-07-30 Anushka Debnath , Stephen Cranefield , Emiliano Lorini , Bastin Tony Roy Savarimuthu

The transfer of tasks with sometimes far-reaching moral implications to autonomous systems raises a number of ethical questions. In addition to fundamental questions about the moral agency of these systems, behavioral issues arise. This…

Computers and Society · Computer Science 2021-01-28 Till Feier , Jan Gogoll , Matthias Uhl

Assistive agents should make humans' lives easier. Classically, such assistance is studied through the lens of inverse reinforcement learning, where an assistive agent (e.g., a chatbot, a robot) infers a human's intention and then selects…

Artificial Intelligence · Computer Science 2025-01-17 Vivek Myers , Evan Ellis , Sergey Levine , Benjamin Eysenbach , Anca Dragan

A current concern in the field of Artificial Intelligence (AI) is to ensure the trustworthiness of AI systems. The development of explainability methods is one prominent way to address this, which has often resulted in the assumption that…

Human-Computer Interaction · Computer Science 2023-12-05 Roel Visser , Tobias M. Peters , Ingrid Scharlau , Barbara Hammer

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

The rapid rise of AI-based autonomous agents is transforming human society and economic systems, as these entities increasingly exhibit human-like or superhuman intelligence. From excelling at complex games like Go to tackling diverse…

Artificial Intelligence · Computer Science 2025-05-27 Ke Yang , ChengXiang Zhai

Agent-based modelling is a powerful tool when simulating human systems, yet when human behaviour cannot be described by simple rules or maximising one's own profit, we quickly reach the limits of this methodology. Machine learning has the…

Multiagent Systems · Computer Science 2022-01-21 Georg Jäger , Daniel Reisinger

User trust in Artificial Intelligence (AI) enabled systems has been increasingly recognized and proven as a key element to fostering adoption. It has been suggested that AI-enabled systems must go beyond technical-centric approaches and…

Human-Computer Interaction · Computer Science 2023-12-05 Tita Alissa Bach , Amna Khan , Harry Hallock , Gabriela Beltrão , Sonia Sousa

Human interactions are influenced by emotions, temperament, and affection, often conflicting with individuals' underlying preferences. Without explicit knowledge of those preferences, judging whether behaviour is appropriate becomes…

Computer Science and Game Theory · Computer Science 2025-11-05 Victor Villin , Christos Dimitrakakis

Research has shown that human-agent relationships form in similar ways to human-human relationships. Since children do not have the same critical analysis skills as adults (and may over-trust technology, for example), this…

Human-Computer Interaction · Computer Science 2022-09-13 Jessica Van Brummelen , Mingyan Claire Tian , Maura Kelleher , Nghi Hoang Nguyen

Personal AI assistants have changed how people use institutional and professional advice. We study this new strategic setting in which individuals may stochastically consult a personal AI whose recommendation is predictable to the focal…

Machine Learning · Computer Science 2026-03-03 Yueyang Liu , Wichinpong Park Sinchaisri

Explainable AI provides insight into the "why" for model predictions, offering potential for users to better understand and trust a model, and to recognize and correct AI predictions that are incorrect. Prior research on human and…

Machine Learning · Computer Science 2020-06-22 Yasmeen Alufaisan , Laura R. Marusich , Jonathan Z. Bakdash , Yan Zhou , Murat Kantarcioglu

The neutrality thesis holds that technology cannot be laden with values. This long-standing view has faced critiques, but much of the argumentation against neutrality has focused on traditional, non-smart technologies like bridges and…

Artificial Intelligence · Computer Science 2024-08-23 Torben Swoboda , Lode Lauwaert

Recent developments in artificial intelligence (AI) have permeated through an array of different immersive environments, including virtual, augmented, and mixed realities. AI brings a wealth of potential that centers on its ability to…

Human-Computer Interaction · Computer Science 2024-05-10 Wangfan Li , Rohit Mallick , Carlos Toxtli-Hernandez , Christopher Flathmann , Nathan J. McNeese

The range of application of artificial intelligence (AI) is vast, as is the potential for harm. Growing awareness of potential risks from AI systems has spurred action to address those risks, while eroding confidence in AI systems and the…