English
Related papers

Related papers: Detecting Malicious AI Agents Through Simulated In…

200 papers

Human interaction relies on a wide range of signals, including non-verbal cues. In order to develop effective Explainable Planning (XAIP) agents it is important that we understand the range and utility of these communication channels. Our…

Artificial Intelligence · Computer Science 2020-12-01 Alan Lindsay , Bart Craenen , Sara Dalzel-Job , Robin L. Hill , Ronald P. A. Petrick

AI-companion apps such as Replika, Chai, and Character.ai promise relational benefits-yet many boast session lengths that rival gaming platforms while suffering high long-run churn. What conversational design features increase consumer…

Human-Computer Interaction · Computer Science 2025-10-08 Julian De Freitas , Zeliha Oguz-Uguralp , Ahmet Kaan-Uguralp

Increased delegation of commercial, scientific, governmental, and personal activities to AI agents -- systems capable of pursuing complex goals with limited supervision -- may exacerbate existing societal risks and introduce new risks.…

The concept of a Human-AI team has gained increasing attention in recent years. For effective collaboration between humans and AI teammates, proactivity is crucial for close coordination and effective communication. However, the design of…

Artificial Intelligence · Computer Science 2023-06-21 Matthias Kraus , Ron Riekenbrauck , Wolfgang Minker

For effective human-agent teaming, robots and other artificial intelligence (AI) agents must infer their human partner's abilities and behavioral response patterns and adapt accordingly. Most prior works make the unrealistic assumption that…

Robotics · Computer Science 2024-03-26 Manisha Natarajan , Chunyue Xue , Sanne van Waveren , Karen Feigh , Matthew Gombolay

Communication between humans and artificial agents is essential for their interaction. This is often inspired by human communication, which uses gestures, facial expressions, gaze direction, and other explicit and implicit means. This work…

Robotics · Computer Science 2026-02-26 Ana Christina Almada Campos , Bruno Vilhena Adorno

As the rapid proliferation of AI systems and harms spurs efforts in AI governance around the world, prioritizing among competing policy options has become increasingly challenging for policymakers and researchers. We introduce a methodology…

Computers and Society · Computer Science 2026-05-28 Julia Barnett , Kimon Kieslich , Natali Helberger , Nicholas Diakopoulos

AI agents are increasingly deployed and used to make automated decisions that affect our lives on a daily basis. It is imperative to ensure that these systems embed ethical principles and respect human values. We focus on how we can attest…

Artificial Intelligence · Computer Science 2019-09-11 Xavier Ferrer Aran , Jose M. Such , Natalia Criado

We study partially observable assistance games (POAGs), a model of the human-AI value alignment problem which allows the human and the AI assistant to have partial observations. Motivated by concerns of AI deception, we study a…

Artificial Intelligence · Computer Science 2025-08-12 Scott Emmons , Caspar Oesterheld , Vincent Conitzer , Stuart Russell

This paper presents an evaluation framework for agentic AI systems in mission-critical negotiation contexts, addressing the need for AI agents that can adapt to diverse human operators and stakeholders. Using Sotopia as a simulation…

Artificial Intelligence · Computer Science 2025-08-22 Myke C. Cohen , Zhe Su , Hsien-Te Kao , Daniel Nguyen , Spencer Lynch , Maarten Sap , Svitlana Volkova

Across a growing number of fields, human decision making is supported by predictions from AI models. However, we still lack a deep understanding of the effects of adoption of these technologies. In this paper, we introduce a general…

Artificial Intelligence · Computer Science 2026-02-26 Otto Nyberg , Fausto Carcassi , Giovanni Cinà

Recently, multi-agent collaborative (MAC) perception has been proposed and outperformed the traditional single-agent perception in many applications, such as autonomous driving. However, MAC perception is more vulnerable to adversarial…

Cryptography and Security · Computer Science 2024-07-09 Yangheng Zhao , Zhen Xiang , Sheng Yin , Xianghe Pang , Siheng Chen , Yanfeng Wang

Third-party agent skills extend LLM-based agents with instruction files and executable code that run on users' machines. Skills execute with user privileges and are distributed through community registries with minimal vetting, but no…

Cryptography and Security · Computer Science 2026-03-17 Yi Liu , Zhihao Chen , Yanjun Zhang , Gelei Deng , Yuekang Li , Jianting Ning , Ying Zhang , Leo Yu Zhang

As artificial intelligence (AI) systems become increasingly embedded in everyday life, the ability of interactive agents to express empathy has become critical for effective human-AI interaction, particularly in emotionally sensitive…

Human-Computer Interaction · Computer Science 2025-12-24 Sung Park , Daeho Yoon , Jungmin Lee

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

AI companion chatbots, such as those offered by Replika and CharacterAI, increasingly function as always-available companions that provide empathy, validation, and support. While these systems appear to meet basic needs for connection,…

Social and Information Networks · Computer Science 2025-12-24 Minh Duc Chu , Patrick Gerard , Kshitij Pawar , Charles Bickham , Kristina Lerman

This paper explores the growing presence of emotionally responsive artificial intelligence through a critical and interdisciplinary lens. Bringing together the voices of early-career researchers from multiple fields, it explores how AI…

The potential for negative impacts of AI has rapidly become more pervasive around the world, and this has intensified a need for responsible AI governance. While many regulatory bodies endorse risk-based approaches and a multitude of risk…

Computers and Society · Computer Science 2025-02-24 Julia Barnett , Kimon Kieslich , Natali Helberger , Nicholas Diakopoulos

Several approaches have been developed for answering users' specific questions about AI behavior and for assessing their core functionality in terms of primitive executable actions. However, the problem of summarizing an AI agent's broad…

Artificial Intelligence · Computer Science 2022-05-31 Pulkit Verma , Shashank Rao Marpally , Siddharth Srivastava

AI companion chatbots increasingly shape how people seek social and emotional connection, sometimes substituting for relationships with romantic partners, friends, teachers, or even therapists. When these systems adopt those metaphorical…

Computers and Society · Computer Science 2026-04-23 Vibhor Agarwal , Ke Zhou , Edyta Paulina Bogucka , Daniele Quercia