English
Related papers

Related papers: World-Model-Augmented Web Agents with Action Corre…

200 papers

In multi-agent domains (MADs), an agent's action may not just change the world and the agent's knowledge and beliefs about the world, but also may change other agents' knowledge and beliefs about the world and their knowledge and beliefs…

Artificial Intelligence · Computer Science 2020-12-29 Chitta Baral , Gregory Gelfond , Enrico Pontelli , Tran Cao Son

Temporal action proposal generation is an essential and challenging task that aims at localizing temporal intervals containing human actions in untrimmed videos. Most of existing approaches are unable to follow the human cognitive process…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Viet-Khoa Vo-Ho , Ngan Le , Kashu Yamazaki , Akihiro Sugimoto , Minh-Triet Tran

Agents powered by large language models have shown remarkable abilities in solving complex tasks. However, most agent systems remain reactive, limiting their effectiveness in scenarios requiring foresight and autonomous decision-making. In…

Mobile GUI agents exhibit substantial potential to facilitate and automate the execution of user tasks on mobile phones. However, exist mobile GUI agents predominantly privilege autonomous operation and neglect the necessity of active user…

Artificial Intelligence · Computer Science 2025-10-10 Haitao Jia , Ming He , Zimo Yin , Likang Wu , Jianping Fan , Jitao Sang

Action-conditioned video prediction models (often referred to as world models) have shown strong potential for robotics applications, but existing approaches are often slow and struggle to capture physically consistent interactions over…

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

Machine Learning · Computer Science 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

A world model is an AI system that simulates how an environment evolves under actions, enabling planning through imagined futures rather than reactive perception. Current world models, however, suffer from visual conflation: the mistaken…

Artificial Intelligence · Computer Science 2026-01-23 Zhikang Chen , Tingting Zhu

Achieving Artificial General Intelligence (AGI) requires agents that learn and interact adaptively, with interactive world models providing scalable environments for perception, reasoning, and action. Yet current research still lacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jianjie Fang , Yingshan Lei , Qin Wan , Ziyou Wang , Yuchao Huang , Yongyan Xu , Baining Zhao , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

This paper studies fully decentralized cooperative multi-agent reinforcement learning, where each agent solely observes the states, its local actions, and the shared rewards. The inability to access other agents' actions often leads to…

Machine Learning · Computer Science 2026-05-12 Chao Li , Bingkun Bao , Yang Gao

As digitalization and cloud technologies evolve, the web is becoming increasingly important in the modern society. Autonomous web agents based on large language models (LLMs) hold a great potential in work automation. It is therefore…

Artificial Intelligence · Computer Science 2025-10-09 Tianci Xue , Weijian Qi , Tianneng Shi , Chan Hee Song , Boyu Gou , Dawn Song , Huan Sun , Yu Su

As sixth-generation (6G) wireless networks evolve toward increasingly heterogeneous scenarios, tasks, and service requirements, conventional artificial intelligence (AI) models remain limited in task-aware decision-making and autonomous…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Mingyue Li , Li Yu , Yuxiang Zhang , Heng Wang , Jianhua Zhang , Ping Zhang , Guangyi Liu

For autonomous agents to act as trustworthy partners to human users, they must be able to reliably communicate their competency for the tasks they are asked to perform. Towards this objective, we develop probabilistic world models based on…

Machine Learning · Computer Science 2022-03-25 Aastha Acharya , Rebecca Russell , Nisar R. Ahmed

Large language model-based agents are increasingly applied in the recommendation field due to their extensive knowledge and strong planning capabilities. While prior research has primarily focused on enhancing either the recommendation…

Information Retrieval · Computer Science 2025-05-05 Shihao Cai , Jizhi Zhang , Keqin Bao , Chongming Gao , Qifan Wang , Fuli Feng , Xiangnan He

Multiagent reinforcement learning, as a prominent intelligent paradigm, enables collaborative decision-making within complex systems. However, existing approaches often rely on explicit action exchange between agents to evaluate action…

Robotics · Computer Science 2026-01-09 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu

Agentic Reinforcement Learning (Agentic RL) has achieved notable success in enabling agents to perform complex reasoning and tool use. However, most methods still relies on sparse outcome-based reward for training. Such feedback fails to…

Artificial Intelligence · Computer Science 2026-04-29 Kaixuan Fan , Kaituo Feng , Manyuan Zhang , Tianshuo Peng , Zhixun Li , Yilei Jiang , Shuang Chen , Peng Pei , Xunliang Cai , Xiangyu Yue

Pre-trained large language models (LLMs) have recently achieved better generalization and sample efficiency in autonomous web automation. However, the performance on real-world websites has still suffered from (1) open domainness, (2)…

Machine Learning · Computer Science 2024-02-27 Izzeddin Gur , Hiroki Furuta , Austin Huang , Mustafa Safdari , Yutaka Matsuo , Douglas Eck , Aleksandra Faust

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

World models aim to improve robotic decision making by predicting the consequences of actions. However, in practice, their predictions often become unreliable once the robot encounters states outside the training distribution, limiting…

Robotics · Computer Science 2026-05-18 Tuo An , Jindou Jia , Gen Li , Jingliang Li , Chuhao Zhou , Pengfei Liu , Bofan Lyu , Jiaqi Bai , Xinying Guo , Geng Li , Jianfei Yang

A significant aspiration of offline reinforcement learning (RL) is to develop a generalist agent with high capabilities from large and heterogeneous datasets. However, prior approaches that scale offline RL either rely heavily on expert…

Machine Learning · Computer Science 2026-01-30 Jie Cheng , Ruixi Qiao , Yingwei Ma , Binhua Li , Gang Xiong , Qinghai Miao , Yongbin Li , Yisheng Lv

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun