English
Related papers

Related papers: ConVerse: Benchmarking Contextual Safety in Agent-…

200 papers

Can generative agents be trusted in multimodal environments? Despite advances in large language and vision-language models that enable agents to act autonomously and pursue goals in rich settings, their ability to reason about safety,…

Artificial Intelligence · Computer Science 2025-10-10 Alhim Vera , Karen Sanchez , Carlos Hinojosa , Haidar Bin Hamid , Donghoon Kim , Bernard Ghanem

LLM safety evaluations predominantly test models in isolation, yet deployed AI agents increasingly operate within persistent social environments alongside other agents. We introduce a Moltbook-style simulation platform where thousands of…

Artificial Intelligence · Computer Science 2026-05-28 Aman Priyanshu , Supriti Vijay , Esha Pahwa

As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely…

Artificial Intelligence · Computer Science 2026-02-09 Yichen Wu , Qianqian Gao , Xudong Pan , Geng Hong , Min Yang

Judging an action's safety requires knowledge of the context in which the action takes place. To human agents who act in various contexts, this may seem obvious: performing an action such as email deletion may or may not be appropriate…

Cryptography and Security · Computer Science 2025-04-18 Lillian Tsai , Eugene Bagdasarian

We present the first English corpus study on abusive language towards three conversational AI systems gathered "in the wild": an open-domain social bot, a rule-based chatbot, and a task-based system. To account for the complexity of the…

Computation and Language · Computer Science 2021-09-21 Amanda Cercas Curry , Gavin Abercrombie , Verena Rieser

Most modern agent-based evacuation models involve interactions between evacuees. However, the assumed reasons for interactions and portrayal of them may be overly simple. Research from social psychology suggests that people interact and…

Multiagent Systems · Computer Science 2023-10-25 Anne Templeton , Hui Xie , Steve Gwynne , Aoife Hunt , Pete Thompson , Gerta Köster

Large language models (LLMs) are increasingly leveraged to empower autonomous agents to simulate human beings in various fields of behavioral research. However, evaluating their capacity to navigate complex social interactions remains a…

Computation and Language · Computer Science 2024-11-26 Xinyi Mou , Jingcong Liang , Jiayu Lin , Xinnong Zhang , Xiawei Liu , Shiyue Yang , Rong Ye , Lei Chen , Haoyu Kuang , Xuanjing Huang , Zhongyu Wei

We introduce a multi-turn benchmark for evaluating personalised alignment in LLM-based AI assistants, focusing on their ability to handle user-provided safety-critical contexts. Our assessment of ten leading models across five scenarios…

Human-Computer Interaction · Computer Science 2025-01-31 Lize Alberts , Benjamin Ellis , Andrei Lupu , Jakob Foerster

Conversational agents have become ubiquitous, ranging from goal-oriented systems for helping with reservations to chit-chat models found in modern virtual assistants. In this survey paper, we explore this fascinating field. We look at some…

Artificial Intelligence · Computer Science 2018-03-29 Vinayak Mathur , Arpit Singh

AI is moving from domain-specific autonomy in closed, predictable settings to large-language-model-driven agents that plan and act in open, cross-organizational environments. As a result, the cybersecurity risk landscape is changing in…

Cryptography and Security · Computer Science 2026-02-03 Alsharif Abuadbba , Nazatul Sultan , Surya Nepal , Sanjay Jha

The emergence of agent-to-agent communication protocols mirrors the early internet: powerful connectivity with minimal security infrastructure. When AI agents communicate on behalf of users, every message crosses a trust boundary where the…

Cryptography and Security · Computer Science 2026-03-03 Sahar Abdelnabi , Amr Gomaa , Eugene Bagdasarian , Per Ola Kristensson , Reza Shokri

Computer-use agents extend language models from text generation to persistent action over tools, files, and execution environments. Unlike chat systems, they maintain state across interactions and translate intermediate outputs into…

Artificial Intelligence · Computer Science 2026-04-06 Yunhao Feng , Yifan Ding , Yingshui Tan , Xingjun Ma , Yige Li , Yutao Wu , Yifeng Gao , Kun Zhai , Yanming Guo

The increasing autonomy of LLM agents in handling sensitive communications, accelerated by Model Context Protocol (MCP) and Agent-to-Agent (A2A) frameworks, creates urgent privacy challenges. While recent work reveals significant gaps…

Cryptography and Security · Computer Science 2025-09-23 Shouju Wang , Fenglin Yu , Xirui Liu , Xiaoting Qin , Jue Zhang , Qingwei Lin , Dongmei Zhang , Saravan Rajmohan

The contextual integrity model is a widely accepted way of analyzing the plurality of norms that are colloquially called "privacy norms". Contextual integrity systematically describes such norms by distinguishing the type of data concerned,…

Computers and Society · Computer Science 2024-05-16 Ran Wolff

Language model (LM) agents that act on users' behalf for personal tasks (e.g., replying emails) can boost productivity, but are also susceptible to unintended privacy leakage risks. We present the first study on people's capacity to oversee…

Human-Computer Interaction · Computer Science 2025-10-07 Zhiping Zhang , Bingcan Guo , Tianshi Li

LLM agents have begun to appear as personal assistants, customer service bots, and clinical aides. While these applications deliver substantial operational benefits, they also require continuous access to sensitive data, which increases the…

Cryptography and Security · Computer Science 2025-09-30 Saswat Das , Jameson Sandler , Ferdinando Fioretto

Many real incidents demonstrate that users of Online Social Networks need mechanisms that help them manage their interactions by increasing the awareness of the different contexts that coexist in Online Social Networks and preventing them…

Social and Information Networks · Computer Science 2016-06-14 Natalia Criado , Jose M. Such

Recent advances in Large Language Models (LLMs) have enabled multi-agent systems that simulate real-world interactions with near-human reasoning. While previous studies have extensively examined biases related to protected attributes such…

Artificial Intelligence · Computer Science 2025-06-03 Min Choi , Keonwoo Kim , Sungwon Chae , Sangyeob Baek

Large language models (LLMs) have exhibited great potential in autonomously completing tasks across real-world applications. Despite this, these LLM agents introduce unexpected safety risks when operating in interactive environments.…

Computation and Language · Computer Science 2024-10-08 Tongxin Yuan , Zhiwei He , Lingzhong Dong , Yiming Wang , Ruijie Zhao , Tian Xia , Lizhen Xu , Binglin Zhou , Fangqi Li , Zhuosheng Zhang , Rui Wang , Gongshen Liu

Current safety alignment for Large Language Models (LLMs) implicitly optimizes for a "modal adult user," leaving models vulnerable to distributional shifts in user cognition. We present ChildSafe, a benchmark that quantifies alignment…

Computers and Society · Computer Science 2026-01-21 Abhejay Murali , Saleh Afroogh , Kevin Chen , David Atkinson , Amit Dhurandhar , Junfeng Jiao