English
Related papers

Related papers: GTA: Generating Long-Horizon Tasks for Web Agents …

200 papers

End-to-end GUI agents for real desktop environments require large amounts of high-quality interaction data, yet collecting human demonstrations is expensive and existing synthetic pipelines often suffer from limited task diversity or noisy,…

Artificial Intelligence · Computer Science 2026-04-14 Jinbiao Wei , Yilun Zhao , Kangqi Ni , Arman Cohan

AI agents are emerging as a dominant workload in a wide range of applications, promising to be the vehicle that delivers the promised benefits of AI to enterprises and consumers. Unlike conventional software or static inference, agentic…

Machine Learning · Computer Science 2025-07-29 Zain Asgar , Michelle Nguyen , Sachin Katti

Nowadays, research on GUI agents is a hot topic in the AI community. However, current research focuses on GUI task automation, limiting the scope of applications in various GUI scenarios. In this paper, we propose a formalized and…

Artificial Intelligence · Computer Science 2024-12-25 Kangjia Zhao , Jiahui Song , Leigang Sha , Haozhan Shen , Zhi Chen , Tiancheng Zhao , Xiubo Liang , Jianwei Yin

Real-world language agents must handle complex, multi-step workflows across diverse Apps. For instance, an agent may manage emails by coordinating with calendars and file systems, or monitor a production database to detect anomalies and…

Web agents struggle to adapt to new websites due to the scarcity of environment specific tasks and demonstrations. Recent works have explored synthetic data generation to address this challenge, however, they suffer from data quality issues…

Unlike traditional automation tools or static LLM-based systems, agents combine decision-making and tool utilization to accomplish complex tasks, showing great potential in software engineering. However, existing studies largely focus on…

Software Engineering · Computer Science 2025-11-04 Zhuowen Yin , Cuifeng Gao , Chunsong Fan , Wenzhang Yang , Yinxing Xue , Lijun Zhang

Generating user activity is a key capability for both evaluating security monitoring tools as well as improving the credibility of attacker analysis platforms (e.g., honeynets). In this paper, to generate this activity, we instrument each…

Artificial Intelligence · Computer Science 2021-11-24 Alexandre Dey , Benjamin Costé , Éric Totel , Adrien Bécue

Deep Research Agents (DRAs) aim to solve complex, long-horizon research tasks involving planning, retrieval, multimodal understanding, and report generation, yet their evaluation remains challenging due to dynamic web environments and…

Large language models are increasingly deployed as complex agentic systems that scale with task complexity. While prior work has extensively explored model- and system-level scaling, algorithm- and task-level scaling remain largely…

Artificial Intelligence · Computer Science 2026-04-21 Zizhang Luo , Yuhao Luo , Youwei Xiao , Yansong Xu , Runlin Guo , Yun Liang

Web agents promise to automate complex browser tasks, but current methods remain brittle -- relying on step-by-step UI interactions and heavy LLM reasoning that break under dynamic layouts and long horizons. Humans, by contrast, exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Viraj Prabhu , Yutong Dai , Matthew Fernandez , Jing Gu , Krithika Ramakrishnan , Yanqi Luo , Silvio Savarese , Caiming Xiong , Junnan Li , Zeyuan Chen , Ran Xu

LLM-based agents can autonomously accomplish complex tasks across various domains. However, to further cultivate capabilities such as adaptive behavior and long-term decision-making, training on static datasets built from human-level…

Machine Learning · Computer Science 2025-12-24 Yuchen Huang , Sijia Li , Minghao Liu , Wei Liu , Shijue Huang , Zhiyuan Fan , Hou Pong Chan , Yi R. Fung

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Recent advances in AI-assisted programming have empowered agents to execute complex workflows via command-line interfaces, however, existing benchmarks are limited by short task horizons, data contamination from GitHub scraping, and a lack…

GUI agents are designed to automate repetitive tasks and enhance productivity. However, existing GUI agents struggle to recover once they follow an incorrect exploration path, often leading to task failure. In this work, we model GUI task…

Artificial Intelligence · Computer Science 2026-01-30 Ziyu Lu , Tengjin Weng , Yiying Yang , Yuhang Zhao , Xinxin Huang , Wenhao Jiang

Can advanced multi-modal models effectively tackle complex web-based tasks? Such tasks are often found on crowdsourcing platforms, where crowdworkers engage in challenging micro-tasks within web-based environments. Building on this idea, we…

Artificial Intelligence · Computer Science 2025-02-25 Kevin Xu , Yeganeh Kordi , Tanay Nayak , Adi Asija , Yizhong Wang , Kate Sanders , Adam Byerly , Jingyu Zhang , Benjamin Van Durme , Daniel Khashabi

While much work on web agents emphasizes the promise of autonomously performing tasks on behalf of users, in reality, agents often fall short on complex tasks in real-world contexts and modeling user preference. This presents an opportunity…

Artificial Intelligence · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Frank F. Xu , Tianyue Ou , Shuyan Zhou , Jeffrey P. Bigham , Graham Neubig

Large language models (LLMs) have shown remarkable advancements in enabling language agents to tackle simple tasks. However, applying them for complex, multi-step, long-horizon tasks remains a challenge. Recent work have found success by…

Computation and Language · Computer Science 2025-08-05 Lutfi Eren Erdogan , Nicholas Lee , Sehoon Kim , Suhong Moon , Hiroki Furuta , Gopala Anumanchipalli , Kurt Keutzer , Amir Gholami

AI web agents use Internet resources at far greater speed, scale, and complexity -- changing how users and services interact. Deployed maliciously or erroneously, these agents could overload content providers. At the same time, web agents…

Artificial Intelligence · Computer Science 2025-09-03 Abhinav Kumar , Jaechul Roh , Ali Naseh , Amir Houmansadr , Eugene Bagdasarian

Realistic long-horizon productivity work is strongly conditioned on user-specific computer environments, where much of the work context is stored and organized through directory structures and content-rich artifacts. To scale synthetic data…

Artificial Intelligence · Computer Science 2026-05-01 Tao Ge , Baolin Peng , Hao Cheng , Jianfeng Gao

Large language models are increasingly expected to serve as general-purpose agents that interact with external, stateful tool environments. The Model Context Protocol (MCP) and broader agent skills offer a unified interface for connecting…