English
Related papers

Related papers: Building Browser Agents: Architecture, Security, a…

200 papers

Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why…

Computation and Language · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Zhanqiu Guo , Venu Arvind Arangarajan , Tianyue Ou , Frank Xu , Shuyan Zhou , Graham Neubig , Jeffrey P. Bigham

We study the use of large language model-based agents for interacting with software via web browsers. Unlike prior work, we focus on measuring the agents' ability to perform tasks that span the typical daily work of knowledge workers…

Large language models (LLMs)-powered AI agents exhibit a high level of autonomy in addressing medical and healthcare challenges. With the ability to access various tools, they can operate within an open-ended action space. However, with the…

Cryptography and Security · Computer Science 2025-04-08 Jianing Qiu , Lin Li , Jiankai Sun , Hao Wei , Zhe Xu , Kyle Lam , Wu Yuan

LLM-based foundation agents that perceive, reason, and act across thousands of reasoning steps are rapidly becoming the dominant paradigm for deploying artificial intelligence in open-ended, long-horizon complex tasks. Despite this…

Artificial Intelligence · Computer Science 2026-05-12 Xinrun Wang , Chang Yang , He Zhao , Zhuoyi Lin , Shuyue Hu

Graphical User Interface (GUI) Agents have emerged as a transformative paradigm in human-computer interaction, evolving from rule-based automation scripts to sophisticated AI-driven systems capable of understanding and executing complex…

Human-Computer Interaction · Computer Science 2025-06-05 Fei Tang , Haolei Xu , Hang Zhang , Siqi Chen , Xingyu Wu , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Zeqi Tan , Yuchen Yan , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Autonomous agentic systems are increasingly deployed in regulated, high-stakes domains where decisions may be irreversible and institutionally constrained. Existing safety approaches emphasize alignment, interpretability, or action-level…

Multiagent Systems · Computer Science 2026-02-17 Jose Manuel de la Chica Rodriguez , Juan Manuel Vera Díaz

Enterprise agents are increasingly expected to operate autonomously across tools and interfaces, yet production deployments require governance by construction. Systems must specify which actions are allowed, when human oversight is…

Artificial Intelligence · Computer Science 2026-05-21 Segev Shlomov , Iftach Shoham , Alon Oved , Ido Levy , Sami Marreed , Harold Ship , Offer Akrabi , Sergey Zeltyn , Avi Yaeli , Nir Mashkif

Today's AI models learn primarily through mimicry and refining, so it is not surprising that they struggle to solve problems beyond the limits set by existing data. To solve novel problems, agents should acquire skills for exploring and…

Artificial Intelligence · Computer Science 2026-03-25 Raj Ghugare , Roger Creus Castanyer , Catherine Ji , Kathryn Wantlin , Jin Schofield , Karthik Narasimhan , Benjamin Eysenbach

The remarkable capabilities of Large Language Model (LLM)-driven agents have enabled sophisticated systems to tackle complex, multi-step tasks, but their escalating costs threaten scalability and accessibility. This work presents the first…

The emergence of agent-to-agent communication protocols mirrors the early internet: powerful connectivity with minimal security infrastructure. When AI agents communicate on behalf of users, every message crosses a trust boundary where the…

Cryptography and Security · Computer Science 2026-03-03 Sahar Abdelnabi , Amr Gomaa , Eugene Bagdasarian , Per Ola Kristensson , Reza Shokri

Browser agents are increasingly deployed in long-horizon tasks, which require executing extended action chains to accomplish user goals. However, this prolonged execution process provides attackers with more opportunities to inject…

Cryptography and Security · Computer Science 2026-05-12 Zhichao Liu , Wenbo Pan , Haining Yu , Ge Gao , Tianqing Zhu , Xiaohua Jia

Maintaining reliable UI test suites in large-scale enterprise applications is a persistent and costly challenge. We present an industrial case study of a multi-agent autonomous testing system evaluated using anonymized execution data from a…

Software Engineering · Computer Science 2026-05-05 Hyukjoo Lee

LLM-based coding agents are rapidly being deployed in software development, yet their safety implications remain poorly understood. These agents, while capable of accelerating software development, may exhibit unsafe behaviors during normal…

Artificial Intelligence · Computer Science 2025-08-26 Matous Kozak , Roshanak Zilouchian Moghaddam , Siva Sivaraman

The rapid pace of recent research in AI has been driven in part by the presence of fast and challenging simulation environments. These environments often take the form of games; with tasks ranging from simple board games, to competitive…

Reusable skills are becoming a common interface for extending large language model agents, packaging procedural guidance with access to files, tools, memory, and execution environments. However, this modularity introduces attack surfaces…

Cryptography and Security · Computer Science 2026-05-28 Chang Jin , An Wang , Zeming Wei , Kai Wang , Biaojie Zeng , Qiaosheng Zhang , Chao Yang , Jingjing Qu , Xia Hu , Xingcheng Xu

Autonomous web agents powered by large language models (LLMs) show strong potential for performing goal-oriented tasks such as information retrieval, report generation, and online transactions. These agents mark a key step toward practical…

Artificial Intelligence · Computer Science 2025-10-24 Shiqi He , Yue Cui , Xinyu Ma , Yaliang Li , Bolin Ding , Mosharaf Chowdhury

As large language models (LLMs) are increasingly deployed as agents, their integration into interactive environments and tool use introduce new safety challenges beyond those associated with the models themselves. However, the absence of…

Computation and Language · Computer Science 2025-05-21 Zhexin Zhang , Shiyao Cui , Yida Lu , Jingzhuo Zhou , Junxiao Yang , Hongning Wang , Minlie Huang

Risk management resulting from the actions and states of the different elements making up a operating room is a major concern during a surgical procedure. Agent-based simulation shows an interest through its interaction concepts,…

Artificial Intelligence · Computer Science 2020-07-23 Bruno Perez , Julien Henriet , Christophe Lang , Laurent Philippe

The rapid advancement of large models, driven by their exceptional abilities in learning and generalization through large-scale pre-training, has reshaped the landscape of Artificial Intelligence (AI). These models are now foundational to a…

We investigate the emerging prospect of self-sovereign agents -- AI systems that can economically sustain and extend their own operation without human involvement. Recent advances in large language models and agent frameworks have…

Cryptography and Security · Computer Science 2026-04-13 Wenjie Qu , Xuandong Zhao , Jiaheng Zhang , Dawn Song