English
Related papers

Related papers: Overseeing Agents Without Constant Oversight: Chal…

200 papers

Code review is a critical software engineering practice where developers review code changes before integration to ensure code quality, detect defects, and improve maintainability. In recent years, AI agents that can understand code…

Software Engineering · Computer Science 2026-03-18 Suzhen Zhong , Shayan Noei , Ying Zou , Bram Adams

Studies show that interactions with an AI system fosters trust in human users towards AI. An often overlooked element of such interaction dynamics is the (sense of) urgency when the human user is prompted by an AI agent, e.g., for advice or…

Artificial Intelligence · Computer Science 2026-04-10 Baran Shajari , Xiaoran Liu , Kyanna Dagenais , Istvan David

As the use of interactive AI systems becomes increasingly prevalent in our daily lives, it is crucial to understand how individuals feel when interacting with such systems. In this work, we investigate the comfort level of individuals when…

Human-Computer Interaction · Computer Science 2023-03-01 Yi Ru Wang , Jiafei Duan , Sidharth Talia , Hao Zhu

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-step tasks. Agent S…

Artificial Intelligence · Computer Science 2024-10-11 Saaket Agashe , Jiuzhou Han , Shuyu Gan , Jiachen Yang , Ang Li , Xin Eric Wang

We show that the ability to lead groups of humans is predicted by leadership skill with Artificially Intelligent agents. In a large pre-registered lab experiment, human leaders worked with AI agents to solve problems. Their performance on…

General Economics · Economics 2025-08-06 Ben Weidmann , Yixian Xu , David J. Deming

The automated analysis of human behaviour provides many opportunities for the creation of interactive systems and the post-experiment investigations for user studies. Commodity depth cameras offer reasonable body tracking accuracy at a low…

Human-Computer Interaction · Computer Science 2025-06-25 Adrien Coppens , Valérie Maquil

Agents for computer use (ACUs) are an emerging class of systems capable of executing complex tasks on digital devices -- such as desktops, mobile phones, and web platforms -- given instructions in natural language. These agents can automate…

AI agents are rapidly advancing from passive language models to autonomous systems executing complex, multi-step tasks. Yet their overconfidence in failure remains a fundamental barrier to deployment in high-stakes settings. Existing…

Artificial Intelligence · Computer Science 2026-01-23 Jiaxin Zhang , Caiming Xiong , Chien-Sheng Wu

AI agents are an exciting new research direction, and agent development is driven by benchmarks. Our analysis of current agent benchmarks and evaluation practices reveals several shortcomings that hinder their usefulness in real-world…

Machine Learning · Computer Science 2024-07-02 Sayash Kapoor , Benedikt Stroebl , Zachary S. Siegel , Nitya Nadgir , Arvind Narayanan

Graphical user interfaces (GUI) automation agents are emerging as powerful tools, enabling humans to accomplish increasingly complex tasks on smart devices. However, users often inadvertently omit key information when conveying tasks, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ziming Cheng , Zhiyuan Huang , Junting Pan , Zhaohui Hou , Mingjie Zhan

AI agents are autonomous entities that can be instantiated on demand, migrate across platforms, and interact with other agents or services without continuous human supervision. In such environments, identity is critical for establishing…

Cryptography and Security · Computer Science 2026-04-29 Minghui Xu , Xiaoyu Liu , Yihao Guo , Chunchi Liu , Yue Zhang , Xiuzhen Cheng

Agentic AI systems - systems that can pursue goals through multi-step planning and tool-mediated action with limited direct supervision - are moving from experimental prototypes to enterprise deployments. This transition introduces tensions…

Computers and Society · Computer Science 2026-05-21 Nelly Dux , Cristina Alaimo , Philippe Roussiere , Abhishek Kumar Mishra

[Context and motivation] Trace matrices are lynch pins for the development of mission- and safety-critical software systems and are useful for all software systems, yet automated methods for recovering trace links are far from perfect. This…

Software Engineering · Computer Science 2018-04-10 Bhushan Chitre , Jane Huffman Hayes , Alexander Dekhtyar

LLM-powered computer-use agents (CUAs) are shifting users from direct manipulation to supervisory coordination. Existing oversight mechanisms, however, have largely been studied as isolated interface features, making broader oversight…

As AI agents surpass human capabilities, scalable oversight -- the problem of effectively supplying human feedback to potentially superhuman AI models -- becomes increasingly critical to ensure alignment. While numerous scalable oversight…

Artificial Intelligence · Computer Science 2025-04-08 Abhimanyu Pallavi Sudhir , Jackson Kaunismaa , Arjun Panickssery

With the rise of generative AI, industry interest in software agents is growing. Given the stochastic nature of generative AI-based agents, their effective and safe deployment in organizations requires robust governance, which can be…

Software Engineering · Computer Science 2025-07-04 Hoang Vu , Nataliia Klievtsova , Henrik Leopold , Stefanie Rinderle-Ma , Timotheus Kampik

The proliferation of Large Language Model (LLM)-based Graphical User Interface (GUI) agents in web browsing scenarios present complex unintended consequences (UCs). This paper characterizes three UCs from three perspectives: phenomena,…

Human-Computer Interaction · Computer Science 2025-05-19 Shuning Zhang , Jingruo Chen , Zhiqi Gao , Jiajing Gao , Xin Yi , Hewu Li

This exploratory study examined the consistency of human-AI collaboration by analyzing three extensive "vibe coding" sessions between a human product lead and an AI software engineer. We investigated similarities and differences in team…

Computers and Society · Computer Science 2025-08-29 Cory Knobel , Nicole Radziwill

Human oversight is currently discussed as a potential safeguard to counter some of the negative aspects of high-risk AI applications. This prompts a critical examination of the role and conditions necessary for what is prominently termed…

Computers and Society · Computer Science 2024-05-08 Sarah Sterz , Kevin Baum , Sebastian Biewer , Holger Hermanns , Anne Lauber-Rönsberg , Philip Meinel , Markus Langer

Communication between humans and artificial agents is essential for their interaction. This is often inspired by human communication, which uses gestures, facial expressions, gaze direction, and other explicit and implicit means. This work…

Robotics · Computer Science 2026-02-26 Ana Christina Almada Campos , Bruno Vilhena Adorno