English
Related papers

Related papers: Comparing Human Oversight Strategies for Computer-…

200 papers

As autonomous agents powered by LLM are increasingly deployed in society, understanding their collective behaviour in social dilemmas becomes critical. We introduce an evaluation framework where LLMs generate strategies encoded as…

Multiagent Systems · Computer Science 2026-02-19 Richard Willis , Jianing Zhao , Yali Du , Joel Z. Leibo

We stress test monitoring systems for detecting covert misbehavior in autonomous LLM agents (e.g., secretly sharing private information). To this end, we systematize a monitor red teaming (MRT) workflow that incorporates: (1) varying levels…

Artificial Intelligence · Computer Science 2025-08-28 Neil Kale , Chen Bo Calvin Zhang , Kevin Zhu , Ankit Aich , Paula Rodriguez , Scale Red Team , Christina Q. Knight , Zifan Wang

With the increased adoption of artificial intelligence (AI) in industry and society, effective human-AI interaction systems are becoming increasingly important. A central challenge in the interaction of humans with AI is the estimation of…

Human-Computer Interaction · Computer Science 2023-04-20 Philipp Spitzer , Joshua Holstein , Michael Vössing , Niklas Kühl

Multi-agent collaboration has emerged as a pivotal paradigm for addressing complex, distributed tasks in large language model (LLM)-driven applications. While prior research has focused on high-level architectural frameworks, the granular…

Multiagent Systems · Computer Science 2025-05-20 Haochun Wang , Sendong Zhao , Jingbo Wang , Zewen Qiang , Bing Qin , Ting Liu

LLM-based agents can complete tasks correctly yet still frustrate users through poor interaction patterns, such as excessive confirmations, opaque reasoning, or misaligned pacing. Current benchmarks evaluate task accuracy but overlook how…

Human-Computer Interaction · Computer Science 2026-02-09 Jialin Li , Zhenhao Chen , Hanjun Luo , Hanan Salam

On many learning platforms, the optimization criteria guiding model training reflect the priorities of the designer rather than those of the individuals they affect. Consequently, users may act strategically to obtain more favorable…

Machine Learning · Computer Science 2025-12-22 Haiqing Zhu , Tijana Zrnic , Celestine Mendler-Dünner

Users of shared control systems change their behavior in the presence of assistance, which conflicts with assumpts about user behavior that some assistance methods make. In this paper, we propose an analysis technique to evaluate the user's…

Robotics · Computer Science 2024-08-23 Reuben M. Aronson , Elaine Schaertl Short

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S…

Artificial Intelligence · Computer Science 2024-10-11 Saaket Agashe , Jiuzhou Han , Shuyu Gan , Jiachen Yang , Ang Li , Xin Eric Wang

We introduce OrchVis, a multi-agent orchestration framework that visualizes, verifies, and coordinates goal-driven collaboration among LLM-based agents. Through hierarchical goal alignment, task assignment, and conflict resolution, OrchVis…

Human-Computer Interaction · Computer Science 2025-10-30 Jieyu Zhou

Growing evidence suggests that the brain uses an attention schema, or a simplified model of attention, to help control what it attends to. One proposed benefit of this model is to allow agents to model the attention states of other agents,…

Machine Learning · Computer Science 2025-08-21 Kathryn T. Farrell , Kirsten Ziman , Michael S. A. Graziano

The future of UAV interaction systems is evolving from engineer-driven to user-driven, aiming to replace traditional predefined Human-UAV Interaction designs. This shift focuses on enabling more personalized task planning and design,…

Robotics · Computer Science 2025-12-10 Haoran Wang , Zhuohang Chen , Guang Li , Bo Ma , Chuanghuang Li

Despite recent advances, LLM-based web agents still struggle with limited exploration, omission of critical steps, and sensitivity to task constraints. Prior work suggests that many of these failures stem from weaknesses in planning, yet…

Computation and Language · Computer Science 2026-05-29 Alejandra Zambrano , Sara Vera Marjanovic , Imene Kerboua , Xing Han Lù , Leila Kosseim

Autonomous network management in Open Radio Access Networks requires intelligent decision making across conflicting objectives, yet existing LLM based multi agent systems employ homogeneous strategies and lack systematic predeployment…

Networking and Internet Architecture · Computer Science 2026-04-14 Zeinab Nezami , Syed Ali Raza Zaidi , Maryam Hafeez , Louis Powell , Vara Prasad Talari , Mallik Tatipamula

In the age of large language models (LLMs), autonomous agents have emerged as a powerful paradigm for achieving general intelligence. These agents dynamically leverage tools, memory, and reasoning capabilities to accomplish user-defined…

Artificial Intelligence · Computer Science 2025-08-05 Chaojia Yu , Zihan Cheng , Hanwen Cui , Yishuo Gao , Zexu Luo , Yijin Wang , Hangbin Zheng , Yong Zhao

(M)LLM-powered computer use agents (CUA) are emerging as a transformative technique to automate human-computer interaction. However, existing CUA benchmarks predominantly target GUI agents, whose evaluation methods are susceptible to UI…

LLMs gain competence by predicting words in human text, which often reflects how people perform tasks. Consequently, coupling an LLM to an engineered runtime turns prediction into control: outputs trigger interventions that enact…

Artificial Intelligence · Computer Science 2026-04-10 Tim Sainburg , Caleb Weinreb

In the field of MLLM-based GUI agents, compared to smartphones, the PC scenario not only features a more complex interactive environment, but also involves more intricate intra- and inter-app workflows. To address these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haowei Liu , Xi Zhang , Haiyang Xu , Yuyang Wanyan , Junyang Wang , Ming Yan , Ji Zhang , Chunfeng Yuan , Changsheng Xu , Weiming Hu , Fei Huang

As AI usage becomes more prevalent in social contexts, understanding agent-user interaction is critical to designing systems that improve both individual and group outcomes. We present an online behavioral experiment (N = 243) in which…

Computer Science and Game Theory · Computer Science 2026-02-16 Kehang Zhu , Nithum Thain , Vivian Tsai , James Wexler , Crystal Qian

Open agentic systems combine LLM-based planning with external capabilities, persistent memory, and privileged execution. They are used in coding assistants, browser copilots, and enterprise automation. OpenClaw is a visible instance of this…

Cryptography and Security · Computer Science 2026-03-30 Shiping Chen , Qin Wang , Guangsheng Yu , Xu Wang , Liming Zhu

Optimization is as much about modeling the right problem as solving it. Identifying the right objectives, constraints, and trade-offs demands extensive interaction between researchers and stakeholders. Large language models can empower…

Artificial Intelligence · Computer Science 2026-04-06 Joshua Drossman , Alexandre Jacquillat , Sébastien Martin