English
Related papers

Related papers: GTA: Generating Long-Horizon Tasks for Web Agents …

200 papers

Current agentic frameworks underperform on long-horizon tasks. As reasoning depth increases, sequential orchestration becomes brittle, context windows impose hard limits that degrade performance, and opaque execution traces make failures…

Artificial Intelligence · Computer Science 2026-02-17 Salaheddin Alzu'bi , Baran Nama , Arda Kaz , Anushri Eswaran , Weiyuan Chen , Sarvesh Khetan , Rishab Bala , Tu Vu , Sewoong Oh

Current approaches rely on zero-shot evaluation due to the absence of training data; while proprietary models such as GPT-4 exhibit strong reasoning capabilities, smaller open-source models remain ineffective at complex tool use. To address…

Artificial Intelligence · Computer Science 2026-05-05 Hyunji Min , Sangwon Jung , Junyoung Sung , Dosung Lee , Leekyeung Han , Paul Hongsuck Seo

Training robotic policies directly in the real world is expensive and unscalable. Although generative simulation enables large-scale data synthesis, current approaches often fail to generate logically coherent long-horizon tasks and…

Robotics · Computer Science 2026-02-13 Xiang Liu , Sen Cui , Guocai Yao , Zhong Cao , Jingheng Ma , Min Zhang , Changshui Zhang

Recent advances in deep-research systems have demonstrated the potential for AI agents to autonomously discover and synthesize knowledge from external sources. In this paper, we introduce WebResearcher, a novel framework for building such…

The emergence of AI-driven web automation through Large Language Models (LLMs) offers unprecedented opportunities for optimizing digital workflows. However, deploying such systems within industry's real-world environments presents four core…

Software Engineering · Computer Science 2025-08-26 Ankur Tomar , Hengyue Liang , Indranil Bhattacharya , Natalia Larios , Francesco Carbone

We introduce EconWebArena, a benchmark for evaluating autonomous agents on complex, multimodal economic tasks in realistic web environments. The benchmark comprises 360 curated tasks from 82 authoritative websites spanning domains such as…

Computation and Language · Computer Science 2026-05-12 Zefang Liu , Yinzhu Quan

Graphical User Interface (GUI) Agents, powered by large language and vision-language models, hold promise for enabling end-to-end automation in digital environments. However, their progress is fundamentally constrained by the scarcity of…

Machine Learning · Computer Science 2025-09-22 Musen Lin , Minghao Liu , Taoran Lu , Lichen Yuan , Yiwei Liu , Haonan Xu , Yu Miao , Yuhao Chao , Zhaojian Li

As large language model (LLM)-based agents become increasingly integrated into daily digital interactions, their ability to reason across long interaction histories becomes crucial for providing personalized and contextually aware…

Machine Learning · Computer Science 2025-12-05 Andy Chung , Yichi Zhang , Kaixiang Lin , Aditya Rawal , Qiaozi Gao , Joyce Chai

Modern information systems require autonomous agents capable of navigating complex workflows, yet current methodologies often struggle with the transition from structured metadata parsing to general environmental perception. While the…

Artificial Intelligence · Computer Science 2026-05-28 Susanna Cifani , Mario Luca Bernardi , Marta Cimitile

As Large Language Models (LLMs) are increasingly deployed in highly specialized vertical domains, the evaluation of their domain-specific performance becomes critical. However, existing evaluations for vertical domains typically rely on the…

Artificial Intelligence · Computer Science 2025-09-26 Wanying Wang , Zeyu Ma , Xuhong Wang , Yangchun Zhang , Pengfei Liu , Mingang Chen

Large language model (LLM) agents perform strongly on short- and mid-horizon tasks, but often break down on long-horizon tasks that require extended, interdependent action sequences. Despite rapid progress in agentic systems, these…

Artificial Intelligence · Computer Science 2026-04-15 Xinyu Jessica Wang , Haoyue Bai , Yiyou Sun , Haorui Wang , Shuibai Zhang , Wenjie Hu , Mya Schroder , Bilge Mutlu , Dawn Song , Robert D Nowak

Large language model (LLM) agents are becoming competent at straightforward web tasks, such as opening an item page or submitting a form, but still struggle with objectives that require long horizon navigation, large scale information…

Artificial Intelligence · Computer Science 2025-10-09 Jingbo Yang , Bairu Hou , Wei Wei , Shiyu Chang , Yujia Bao

Computer-aided translation (CAT), the use of software to assist a human translator in the translation process, has been proven to be useful in enhancing the productivity of human translators. Autocompletion, which suggests translation…

Computation and Language · Computer Science 2021-06-01 Huayang Li , Lemao Liu , Guoping Huang , Shuming Shi

The advancement of Large Language Model (LLM)-powered agents has enabled automated task processing through reasoning and tool invocation capabilities. However, existing frameworks often operate under the idealized assumption that tool…

Artificial Intelligence · Computer Science 2026-03-06 Zhipeng Chen , Zhongrui Zhang , Chao Zhang , Yifan Xu , Lan Yang , Jun Liu , Ke Li , Yi-Zhe Song

Large language models are transitioning from generalpurpose knowledge engines to realworld problem solvers, yet optimizing them for deep search tasks remains challenging. The central bottleneck lies in the extreme sparsity of highquality…

Artificial Intelligence · Computer Science 2026-02-17 Zheng Chu , Xiao Wang , Jack Hong , Huiming Fan , Yuqi Huang , Yue Yang , Guohai Xu , Chenxiao Zhao , Cheng Xiang , Shengchao Hu , Dongdong Kuang , Ming Liu , Bing Qin , Xing Yu

Playing text-based games requires skills in processing natural language and sequential decision making. Achieving human-level performance on text-based games remains an open challenge, and prior research has largely relied on hand-crafted…

We study the use of large language model-based agents for interacting with software via web browsers. Unlike prior work, we focus on measuring the agents' ability to perform tasks that span the typical daily work of knowledge workers…

Recent progress on long-horizon agentic tasks has been driven largely by scaling up individual agents through stronger models, better tools, and more effective scaffolding. In contrast, much less is understood about scaling out: whether…

Artificial Intelligence · Computer Science 2026-05-26 Yuyang Hu , Hongjin Qian , Shuting Wang , Jiongnan Liu , Tong Zhao , Xiaoxi Li , Zheng Liu , Zhicheng Dou

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction…

Artificial Intelligence · Computer Science 2025-10-22 Abhigya Verma , Seganrasan Subramanian , Nandhakumar Kandasamy , Naman Gupta

High-fidelity agent initialization is crucial for credible Agent-Based Modeling across diverse domains. A robust framework should be Topic-Adaptive, capturing macro-level joint distributions while ensuring micro-level individual…

Artificial Intelligence · Computer Science 2026-04-07 Rongxin Chen , Tianyu Wu , Bingbing Xu , Jiatang Luo , Xiucheng Xu , Huawei Shen