English
Related papers

Related papers: WebWorld: A Large-Scale World Model for Web Agent …

200 papers

World models (WMs) are intended to serve as internal simulators of the real world that enable agents to understand, anticipate, and act upon complex environments. Existing WM benchmarks remain narrowly focused on next-state prediction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 PAN Team , Qiyue Gao , Kun Zhou , Jiannan Xiang , Zihan Liu , Dequan Yang , Junrong Chen , Arif Ahmad , Cong Zeng , Ganesh Bannur , Xinqi Huang , Zheqi Liu , Yi Gu , Yichi Yang , Guangyi Liu , Zhiting Hu , Zhengzhong Liu , Eric Xing

Agentic reinforcement learning increasingly relies on experience-driven scaling, yet real-world environments remain non-adaptive, limited in coverage, and difficult to scale. World models offer a potential way to improve learning efficiency…

Computation and Language · Computer Science 2026-03-06 Yixia Li , Hongru Wang , Jiahao Qiu , Zhenfei Yin , Dongdong Zhang , Cheng Qian , Zeping Li , Pony Ma , Guanhua Chen , Heng Ji

Reinforcement learning (RL) for web agents demands environments that are both effective for evaluation and efficient enough for large-scale on-policy training. Current web environments fall short: server-side Docker setups are too…

Machine Learning · Computer Science 2026-05-19 Yuxuan Lu , Ziyi Wang , Jing Huang , Hui Liu , Jiri Gesi , Yan Han , Shihan Fu , Tianqi Zheng , Xianfeng Tang , Chen Luo , Yisi Sang , Jin Lai , Dakuo Wang

Large language models (LLMs) have shown remarkable potential as autonomous agents, particularly in web-based tasks. However, existing LLM web agents heavily rely on expensive proprietary LLM APIs, while open LLMs lack the necessary…

Computation and Language · Computer Science 2025-01-28 Zehan Qi , Xiao Liu , Iat Long Iong , Hanyu Lai , Xueqiao Sun , Wenyi Zhao , Yu Yang , Xinyue Yang , Jiadai Sun , Shuntian Yao , Tianjie Zhang , Wei Xu , Jie Tang , Yuxiao Dong

World models aim to learn action-controlled future prediction and have proven essential for the development of intelligent agents. However, most existing world models rely heavily on substantial action-labeled data and costly training,…

Artificial Intelligence · Computer Science 2025-06-03 Shenyuan Gao , Siyuan Zhou , Yilun Du , Jun Zhang , Chuang Gan

While reinforcement learning (RL) has demonstrated remarkable success in enhancing large language models (LLMs), it has primarily focused on single-turn tasks such as solving math problems. Training effective web agents for multi-turn…

Computation and Language · Computer Science 2025-10-10 Zhepei Wei , Wenlin Yao , Yao Liu , Weizhi Zhang , Qin Lu , Liang Qiu , Changlong Yu , Puyang Xu , Chao Zhang , Bing Yin , Hyokun Yun , Lihong Li

World models have become increasingly popular in acting as learned traffic simulators. Recent work has explored replacing traditional traffic simulators with world models for policy training. In this work, we explore the robustness of…

Robotics · Computer Science 2025-08-05 Hunter Schofield , Mohammed Elmahgiubi , Kasra Rezaee , Jinjun Shan

We present LingBot-World, an open-sourced world simulator stemming from video generation. Positioned as a top-tier world model, LingBot-World offers the following features. (1) It maintains high fidelity and robust dynamics in a broad…

Recent advances in Multimodal Large Language Models (MLLMs) have enabled agents to operate in open-ended web and operating system environments. However, existing benchmarks predominantly target consumer-oriented scenarios (e.g., e-commerce…

Artificial Intelligence · Computer Science 2026-01-27 Ying Mo , Yu Bai , Dapeng Sun , Yuqian Shi , Yukai Miao , Li Chen , Dan Li

Large language models (LLMs) have fueled many intelligent web agents, but most existing ones perform far from satisfying in real-world web navigation tasks due to three factors: (1) the complexity of HTML text data (2) versatility of…

Computation and Language · Computer Science 2024-10-15 Hanyu Lai , Xiao Liu , Iat Long Iong , Shuntian Yao , Yuxuan Chen , Pengbo Shen , Hao Yu , Hanchen Zhang , Xiaohan Zhang , Yuxiao Dong , Jie Tang

Recent success in large multimodal models (LMMs) has sparked promising applications of agents capable of autonomously completing complex web tasks. While open-source LMM agents have made significant advances in offline evaluation…

Artificial Intelligence · Computer Science 2025-06-02 Vardaan Pahuja , Yadong Lu , Corby Rosset , Boyu Gou , Arindam Mitra , Spencer Whitehead , Yu Su , Ahmed Awadallah

Meta-World is widely used for evaluating multi-task and meta-reinforcement learning agents, which are challenged to master diverse skills simultaneously. Since its introduction however, there have been numerous undocumented changes which…

Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due to (i) history-free initialization that mismatches policy…

Robotics · Computer Science 2026-03-19 Chaokang Jiang , Desen Zhou , Jiuming Liu , Kevin Li Sun

Web agents hold great potential for automating complex computer tasks, yet their interactions involve long-horizon, sequential decision-making with irreversible actions. In such settings, outcome-based supervision is sparse and delayed,…

Artificial Intelligence · Computer Science 2026-04-10 Yao Zhang , Shijie Tang , Zeyu Li , Zhen Han , Volker Tresp

Terminal agents extend Large Language Models with the ability to execute tasks directly in command-line environments, but their progress is bottlenecked by the scarcity of high-quality training data. Existing approaches bootstrap from…

Computation and Language · Computer Science 2026-05-21 Zihao Cheng , Hongru Wang , Zeming Liu , Xinyi Wang , Xiangrong Zhu , Yuhang Guo , Wei Lin , Jeff Z. Pan , Yunhong Wang

Large language model (LLM) agents trained using reinforcement learning has achieved superhuman performance in low-cost environments like games, mathematics, and coding. However, these successes have not translated to complex domains where…

Artificial Intelligence · Computer Science 2026-02-03 Sherry Yang

Building Graphical User Interface (GUI) agents is a promising research direction, which simulates human interaction with computers or mobile phones to perform diverse GUI tasks. However, a major challenge in developing generalized GUI…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Bofei Zhang , Zirui Shang , Zhi Gao , Wang Zhang , Rui Xie , Xiaojian Ma , Tao Yuan , Xinxiao Wu , Song-Chun Zhu , Qing Li

Among existing online mobile-use benchmarks, AndroidWorld has emerged as the dominant benchmark due to its reproducible environment and deterministic evaluation; however, recent agents achieving over 90% success rates indicate its…

Computation and Language · Computer Science 2026-01-01 Quyu Kong , Xu Zhang , Zhenyu Yang , Nolan Gao , Chen Liu , Panrong Tong , Chenglin Cai , Hanzhang Zhou , Jianan Zhang , Liangyu Chen , Zhidan Liu , Steven Hoi , Yue Wang

Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jianjie Fang , Yingshan Lei , Qin Wan , Ziyou Wang , Yuchao Huang , Yongyan Xu , Baining Zhao , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Training capable Large Language Model (LLM) agents is critically bottlenecked by the high cost and static nature of real-world interaction data. We address this by introducing GenEnv, a framework that establishes a difficulty-aligned…

Computation and Language · Computer Science 2025-12-24 Jiacheng Guo , Ling Yang , Peter Chen , Qixin Xiao , Yinjie Wang , Xinzhe Juan , Jiahao Qiu , Ke Shen , Mengdi Wang