English
Related papers

Related papers: The Tool Illusion: Rethinking Tool Use in Web Agen…

200 papers

Autonomous browsing agents powered by large language models (LLMs) are increasingly used to automate web-based tasks. However, their reliance on dynamic content, tool execution, and user-provided data exposes them to a broad attack surface.…

Cryptography and Security · Computer Science 2025-05-20 Mykyta Mudryi , Markiyan Chaklosh , Grzegorz Wójcik

With advances in generative AI, there is increasing work towards creating autonomous agents that can manage daily tasks by operating user interfaces (UIs). While prior research has studied the mechanics of how AI agents might navigate UIs…

Human-Computer Interaction · Computer Science 2025-03-25 Zhuohao Jerry Zhang , Eldon Schoop , Jeffrey Nichols , Anuj Mahajan , Amanda Swearngin

This paper presents our research towards a near-term future in which legal entities, such as individuals and organisations can entrust semi-autonomous AI-driven agents to carry out online interactions on their behalf. The author's research…

Artificial Intelligence · Computer Science 2024-09-10 Jesse Wright

Artificial intelligence (AI) tools are being incorporated into scientific research workflows with the potential to enhance efficiency in tasks such as document analysis, question answering (Q&A), and literature search. However, system…

Artificial Intelligence · Computer Science 2026-05-13 Anthea Dathe , Kiran Hoffmann , Aline Mangold

As the power of Artificial Intelligence (AI) continues to advance, there is increased interest in how best to combine AI-based agents with humans to achieve mission effectiveness. Three perspectives have emerged. The first stems from more…

Human-Computer Interaction · Computer Science 2024-02-21 James E. McCarthy

Automated web testing plays a critical role in ensuring high-quality user experiences and delivering business value. Traditional approaches primarily focus on code coverage and load testing, but often fall short of capturing complex user…

Software Engineering · Computer Science 2025-09-08 Naimeng Ye , Xiao Yu , Ruize Xu , Tianyi Peng , Zhou Yu

Agentic systems increasingly rely on reusable procedural capabilities, \textit{a.k.a., agentic skills}, to execute long-horizon workflows reliably. These capabilities are callable modules that package procedural knowledge with explicit…

Cryptography and Security · Computer Science 2026-02-25 Yanna Jiang , Delong Li , Haiyu Deng , Baihe Ma , Xu Wang , Qin Wang , Guangsheng Yu

Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why…

Computation and Language · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Zhanqiu Guo , Venu Arvind Arangarajan , Tianyue Ou , Frank Xu , Shuyan Zhou , Graham Neubig , Jeffrey P. Bigham

The inevitable incompleteness of any collection of PMESII models, along with poorly understood methods for combining heterogeneous models, leads to major uncertainty regarding the reliability of computational tools. This uncertainty is…

Computers and Society · Computer Science 2016-07-25 Alexander Kott , Stephen Morse

Working with data in table form is usually considered a preparatory and tedious step in the sensemaking pipeline; a way of getting the data ready for more sophisticated visualization and analytical tools. But for many people, spreadsheets…

Human-Computer Interaction · Computer Science 2021-06-30 Lyn Bartram , Michael Correll , Melanie Tory

This paper presents our methodology to simulate the behavior of the DeLend Platform. Such simulations are important to verify if the system is able to connect the different sets of agents linked to the platform in a functional manner. They…

Computational Finance · Quantitative Finance 2023-04-04 Frederico Dutilh Novaes , Gabriel de Abreu Madeira , Aurimar Cerqueira

Artificial intelligence (AI) agents are emerging as transformative tools in drug discovery, with the ability to autonomously reason, act, and learn through complicated research workflows. Building on large language models (LLMs) coupled…

We envision "AI scientists" as systems capable of skeptical learning and reasoning that empower biomedical research through collaborative agents that integrate AI models and biomedical tools with experimental platforms. Rather than taking…

This paper introduces two ongoing research projects which seek to apply computer modelling techniques in order to simulate human behaviour within organisations. Previous research in other disciplines has suggested that complex social…

Neural and Evolutionary Computing · Computer Science 2010-07-05 Helen Celia , Christopher Clegg , Mark Robinson , Peer-Olaf Siebers , Uwe Aickelin , Christine Sprigg

The study of cooperation within social dilemmas has long been a fundamental topic across various disciplines, including computer science and social science. Recent advancements in Artificial Intelligence (AI) have significantly reshaped…

Artificial Intelligence · Computer Science 2024-07-31 Chunjiang Mu , Hao Guo , Yang Chen , Chen Shen , Shuyue Hu , Zhen Wang

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

Human-Computer Interaction · Computer Science 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang

Large language model (LLM) agents are increasingly used to interact with and execute tasks in dynamic environments. However, a critical yet overlooked limitation of these agents is that they, by default, assume a stationary context, failing…

Computation and Language · Computer Science 2026-04-17 Yize Cheng , Arshia Soltani Moakhar , Chenrui Fan , Parsa Hosseini , Kazem Faghih , Zahra Sodagar , Wenxiao Wang , Soheil Feizi

The development of general-purpose agents requires a shift from executing simple instructions to completing complex, real-world productivity workflows. However, current tool-use benchmarks remain misaligned with real-world requirements,…

Computation and Language · Computer Science 2026-04-20 Jize Wang , Xuanxuan Liu , Yining Li , Songyang Zhang , Yijun Wang , Zifei Shan , Xinyi Le , Cailian Chen , Xinping Guan , Dacheng Tao

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

We introduce Reagent, a technology that readily converts ordinary webpages containing structured data into software agents with which one can interact naturally, via a combination of speech and pointing. Previous efforts to make webpage…

Human-Computer Interaction · Computer Science 2018-10-30 Mathew Peveler , Jeffery Kephart , Hui Su