English
Related papers

Related papers: WebCanvas: Benchmarking Web Agents in Online Envir…

200 papers

Although large language models (LLMs) have advanced rapidly, robust automation of complex software workflows remains an open problem. In long-horizon settings, agents frequently suffer from cascading errors and environmental stochasticity;…

Artificial Intelligence · Computer Science 2026-03-30 Yenchia Feng , Chirag Sharma , Karime Maamari

Proactive agents that anticipate user needs and autonomously execute tasks hold great promise as digital assistants, yet the lack of realistic user simulation frameworks hinders their development. Existing approaches model apps as flat…

Artificial Intelligence · Computer Science 2026-04-02 Deepak Nathani , Cheng Zhang , Chang Huan , Jiaming Shan , Yinfei Yang , Alkesh Patel , Zhe Gan , William Yang Wang , Michael Saxon , Xin Eric Wang

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

Computation and Language · Computer Science 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin

AI agents -- powered by reasoning-capable large language models (LLMs) and integrated with tools, data, and web search -- are poised to transform the internet into a \emph{Web of Agents}: a machine-native ecosystem where autonomous agents…

Artificial Intelligence · Computer Science 2025-09-08 Rajesh Tembarai Krishnamachari , Srividya Rajesh

Reliability is key to realizing the promise of autonomous UI-Agents, multimodal agents that directly interact with apps in the same manner as humans, as users must be able to trust an agent to complete a given task. Current evaluations rely…

Despite the integration of search tools, Deep Search Agents often suffer from a misalignment between reasoning-driven queries and the underlying web indexing structures. Existing frameworks treat the search engine as a static utility,…

Machine Learning · Computer Science 2026-03-10 Zixuan Yu , Zhenheng Tang , Tongliang Liu , Chengqi Zhang , Xiaowen Chu , Bo Han

Online form filling is a common yet labor-intensive task involving extensive keyboard and mouse interactions. Despite the long-standing vision of automating this process with "one click", existing tools remain largely rule-based and lack…

Computation and Language · Computer Science 2025-06-03 Bobo Li , Yuheng Wang , Hao Fei , Juncheng Li , Wei Ji , Mong-Li Lee , Wynne Hsu

AI agents could accelerate scientific discovery by automating hypothesis formation, experiment design, coding, execution, and analysis, yet existing benchmarks probe narrow skills in simplified settings. To address this gap, we introduce…

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

Integrating web search tools has significantly extended the capability of LLMs to address open-world, real-time, and long-tail problems. However, evaluating these Search Agents presents formidable challenges. First, constructing…

Artificial Intelligence · Computer Science 2026-04-28 Jiawei Chen , Xintian Shen , Lihao Zheng , Lifu Mu , Haoyi Sun , Ning Mao , Hao Ma , Tao Wei , Pan Zhou , Kun Zhan

We propose a goal-driven web navigation as a benchmark task for evaluating an agent with abilities to understand natural language and plan on partially observed environments. In this challenging task, an agent navigates through a website,…

Artificial Intelligence · Computer Science 2016-05-23 Rodrigo Nogueira , Kyunghyun Cho

Foundation agents have rapidly advanced in their ability to reason and interact with real environments, making the evaluation of their core capabilities increasingly important. While many benchmarks have been developed to assess agent…

Real-world multimodal agents solve multi-step workflows grounded in visual evidence. For example, an agent can troubleshoot a device by linking a wiring photo to a schematic and validating the fix with online documentation, or plan a trip…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaochen Su , Jincheng Gao , Hangyu Guo , Zhenhua Liu , Lueyang Zhang , Xinyu Geng , Shijue Huang , Peng Xia , Guanyu Jiang , Cheng Wang , Yue Zhang , Yi R. Fung , Junxian He

As large language model (LLM)-based agents become increasingly integrated into daily digital interactions, their ability to reason across long interaction histories becomes crucial for providing personalized and contextually aware…

Machine Learning · Computer Science 2025-12-05 Andy Chung , Yichi Zhang , Kaixiang Lin , Aditya Rawal , Qiaozi Gao , Joyce Chai

Pre-trained large language models (LLMs) have recently achieved better generalization and sample efficiency in autonomous web automation. However, the performance on real-world websites has still suffered from (1) open domainness, (2)…

Machine Learning · Computer Science 2024-02-27 Izzeddin Gur , Hiroki Furuta , Austin Huang , Mustafa Safdari , Yutaka Matsuo , Douglas Eck , Aleksandra Faust

Agent evaluation requires assessing complex multi-step behaviors involving tool use and intermediate reasoning, making it costly and expertise-intensive. A natural question arises: can frontier coding assistants reliably automate this…

Internet measurement faces twin challenges: complex analyses require expert-level orchestration of tools, yet even syntactically correct implementations can have methodological flaws and can be difficult to verify. Democratizing measurement…

Networking and Internet Architecture · Computer Science 2026-02-25 Alagappan Ramanathan , Eunju Kang , Dongsu Han , Sangeetha Abdu Jyothi

Front-end web code has become a core product surface for every frontier LLM release, yet evaluating these interactive applications at development speed remains costly because human-judged leaderboards like Arena do not scale. Existing…

Artificial Intelligence · Computer Science 2026-05-29 Haoyue Yang , Zhangxiao Shen , Fan Ding , Hangting Lou , Yifeng Kou , Haoqing Yu , Jingyao Li , Zhengfan Wu , Siqi Bao , Jing Liu , Hua Wu

The convergence of Web3 technologies and AI agents represents a rapidly evolving frontier poised to reshape decentralized ecosystems. This paper presents the first and most comprehensive analysis of the intersection between Web3 and AI…

Computers and Society · Computer Science 2025-09-15 Yiming Shen , Jiashuo Zhang , Zhenzhe Shao , Wenxuan Luo , Yanlin Wang , Ting Chen , Zibin Zheng , Jiachi Chen

Web agents--autonomous systems that navigate and execute tasks on the web on behalf of users--have the potential to transform how people interact with the digital world. However, the most capable web agents today rely on proprietary models…