English
Related papers

Related papers: Scaling Web Agent Training through Automatic Data …

200 papers

Autonomous agents that control computer interfaces to accomplish human tasks are emerging. Leveraging LLMs to power such agents has been of special interest, but unless fine-tuned on human-collected task demonstrations, performance is still…

Artificial Intelligence · Computer Science 2024-11-14 Wei Li , William Bishop , Alice Li , Chris Rawles , Folawiyo Campbell-Ajala , Divya Tyamagundlu , Oriana Riva

End-to-end GUI agents for real desktop environments require large amounts of high-quality interaction data, yet collecting human demonstrations is expensive and existing synthetic pipelines often suffer from limited task diversity or noisy,…

Artificial Intelligence · Computer Science 2026-04-14 Jinbiao Wei , Yilun Zhao , Kangqi Ni , Arman Cohan

Designing autonomous drone swarms is hampered by a vast design space spanning platform, algorithmic, and numerical-strength choices. We perform large-scale agent-based simulations in three canonical scenarios: swarm-on-swarm battle,…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Abram H. Clark , Liraz Mudrik , Colton Kawamura , Nathan C. Redder , João P. Hespanha , Isaac Kaminer

Autonomous agents capable of planning, reasoning, and executing actions on the web offer a promising avenue for automating computer tasks. However, the majority of existing benchmarks primarily focus on text-based agents, neglecting many…

In recent years, mobile robot navigation approaches have become increasingly important due to various application areas ranging from healthcare to warehouse logistics. In particular, Deep Reinforcement Learning approaches have gained…

The rapid adoption of AI agents across domains has made systematic evaluation crucial for ensuring their usefulness and successful production deployment. Evaluation of AI agents typically involves using a fixed set of benchmarks and…

Recent advances in high-fidelity simulators have enabled closed-loop training of autonomous driving agents, potentially solving the distribution shift in training v.s. deployment and allowing training to be scaled both safely and cheaply.…

Robotics · Computer Science 2023-06-29 Chris Zhang , Runsheng Guo , Wenyuan Zeng , Yuwen Xiong , Binbin Dai , Rui Hu , Mengye Ren , Raquel Urtasun

Recent advances in large language models (LLMs) and agent system designs have empowered agents with unprecedented levels of capability. However, existing agent benchmarks are showing a trend of rapid ceiling-hitting by newly developed…

Artificial Intelligence · Computer Science 2026-03-25 Dadi Guo , Tianyi Zhou , Dongrui Liu , Chen Qian , Qihan Ren , Shuai Shao , Zhiyuan Fan , Yi R. Fung , Kun Wang , Linfeng Zhang , Jing Shao

Recent advances in multimodal web agents often rely on increased inference-time computation, including rollout search, verifier passes, offline skill discovery, and specialist model stacks. This raises a central question: can a web agent…

Artificial Intelligence · Computer Science 2026-05-27 Yubo Li , Yidi Miao , Yuntian Shen , Yuxin Liu

In the realm of web agent research, achieving both generalization and accuracy remains a challenging problem. Due to high variance in website structure, existing approaches often fail. Moreover, existing fine-tuning and in-context learning…

Computation and Language · Computer Science 2024-04-10 Michael Lutz , Arth Bohra , Manvel Saroyan , Artem Harutyunyan , Giovanni Campagna

The improvement of web agents on current benchmarks raises the question: Do today's agents perform just as well when the web changes? We introduce TimeWarp, a benchmark that emulates the evolving web using containerized environments that…

Artificial Intelligence · Computer Science 2026-03-06 Md Farhan Ishmam , Kenneth Marino

We introduce a framework for optimizing domain-specific dataset construction in foundation model training. Specifically, we seek a cost-efficient way to estimate the quality of data sources (e.g. synthetically generated or filtered web…

Deep Research systems based on web agents have shown strong potential in solving complex information-seeking tasks, yet their search efficiency remains underexplored. We observe that many state-of-the-art open-source web agents rely on long…

Artificial Intelligence · Computer Science 2026-05-11 Junjie Wang , Zequn Xie , Dan Yang , Jie Feng , Yue Shen , Duolin Sun , Meixiu Long , Yihan Jiao , Zhehao Tan , Jian Wang , Peng Wei , Jinjie Gu

Large language models (LLMs) have advanced virtual educators and learners, bridging NLP with AI4Education. Existing work often lacks scalability and fails to leverage diverse, large-scale course content, with limited frameworks for…

Artificial Intelligence · Computer Science 2025-09-08 Jiahuan Pei , Fanghua Ye , Xin Sun , Wentao Deng , Koen Hindriks , Junxiao Wang

Transcending human cognitive limitations represents a critical frontier in LLM training. Proprietary agentic systems like DeepResearch have demonstrated superhuman capabilities on extremely complex information-seeking benchmarks such as…

Web scraping is a powerful technique that extracts data from websites, enabling automated data collection, enhancing data analysis capabilities, and minimizing manual data entry efforts. Existing methods, wrappers-based methods suffer from…

Computation and Language · Computer Science 2024-09-27 Wenhao Huang , Zhouhong Gu , Chenghao Peng , Zhixu Li , Jiaqing Liang , Yanghua Xiao , Liqian Wen , Zulong Chen

Autonomy via agents using large language models (LLMs) for personalized, standardized tasks boosts human efficiency. Automating web tasks (like booking hotels within a budget) is increasingly sought after. Fulfilling practical needs, the…

Artificial Intelligence · Computer Science 2025-05-27 Ke Yang , Yao Liu , Sapana Chaudhary , Rasool Fakoor , Pratik Chaudhari , George Karypis , Huzefa Rangwala

To survive and thrive in complex environments, humans have evolved sophisticated self-improvement mechanisms through environment exploration, hierarchical abstraction of experiences into reuseable skills, and collaborative construction of…

Artificial Intelligence · Computer Science 2025-04-10 Boyuan Zheng , Michael Y. Fatemi , Xiaolong Jin , Zora Zhiruo Wang , Apurva Gandhi , Yueqi Song , Yu Gu , Jayanth Srinivasa , Gaowen Liu , Graham Neubig , Yu Su

Large Language Models (LLMs) have achieved remarkable success through imitation learning on vast text corpora, but this paradigm creates a training-generation gap and limits robust reasoning. Reinforcement learning (RL) offers a more…

Computation and Language · Computer Science 2026-04-13 Zhepeng Cen , Haolin Chen , Shiyu Wang , Zuxin Liu , Zhiwei Liu , Jielin Qiu , Ding Zhao , Silvio Savarese , Caiming Xiong , Huan Wang , Weiran Yao

Web agents powered by large language models (LLMs) can autonomously perform complex, multistep tasks in dynamic web environments. However, current evaluations mostly focus on the overall success while overlooking intermediate errors. This…

Artificial Intelligence · Computer Science 2025-09-19 Daniel Röder , Akhil Juneja , Roland Roller , Sven Schmeier