English
Related papers

Related papers: World Models for Policy Refinement in StarCraft II

200 papers

Recent years have seen significant advances in explainable AI as the need to understand deep learning models has gained importance with the increased emphasis on trust and ethics in AI. Comprehensible models for sequential decision tasks…

Artificial Intelligence · Computer Science 2022-08-19 Pedro Sequeira , Daniel Elenius , Jesse Hostetler , Melinda Gervasio

The availability of challenging benchmarks has played a key role in the recent progress of machine learning. In cooperative multi-agent reinforcement learning, the StarCraft Multi-Agent Challenge (SMAC) has become a popular testbed for…

Large Language Models (LLMs) have achieved strong performance on static reasoning benchmarks, yet their effectiveness as interactive agents operating in adversarial, time-sensitive environments remains poorly understood. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yang Li , Xing Chen , Yutao Liu , Gege Qi , Yanxian BI , Zizhe Wang , Yunjian Zhang , Yao Zhu

To interact effectively with humans in the real world, it is important for agents to understand language that describes the dynamics of the environment--that is, how the environment behaves--rather than just task instructions specifying…

Computation and Language · Computer Science 2025-12-01 Anh Nguyen , Stefan Lee

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

Social robot navigation increasingly relies on large language models for reasoning, path planning, and enabling movement in dynamic human spaces. However, relying solely on LLMs for planning often leads to unpredictable and unsafe…

Robotics · Computer Science 2026-05-26 Weizheng Wang , Obi Ike , Soyun Choi , Sungeun Hong , Aniket Bera , Byung-Cheol Min

Designing adaptive mechanisms to align individual and collective interests remains a central challenge in artificial social intelligence. Existing methods often struggle with modeling heterogeneous agents possessing persistent latent traits…

Computers and Society · Computer Science 2025-10-23 Xiaoyuan Zhang , Yizhe Huang , Chengdong Ma , Zhixun Chen , Long Ma , Yali Du , Song-Chun Zhu , Yaodong Yang , Xue Feng

While model-based reinforcement learning (MBRL) improves sample efficiency by learning world models from raw observations, existing methods struggle to generalize across structurally similar scenes and remain vulnerable to spurious…

Machine Learning · Computer Science 2026-01-28 Zhao-Han Peng , Shaohui Li , Zhi Li , Shulan Ruan , Yu Liu , You He

Despite remarkable progress in driving world models, their potential for autonomous systems remains largely untapped: the world models are mostly learned for world simulation and decoupled from trajectory planning. While recent efforts aim…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zhida Zhao , Talas Fu , Yifan Wang , Lijun Wang , Huchuan Lu

Can we build accurate world models out of large language models (LLMs)? How can world models benefit LLM agents? The gap between the prior knowledge of LLMs and the specified environment's dynamics usually bottlenecks LLMs' performance as…

Artificial Intelligence · Computer Science 2025-04-23 Siyu Zhou , Tianyi Zhou , Yijun Yang , Guodong Long , Deheng Ye , Jing Jiang , Chengqi Zhang

StarCraft II (SC2) poses a grand challenge for reinforcement learning (RL), of which the main difficulties include huge state space, varying action space, and a long time horizon. In this work, we investigate a set of RL techniques for the…

Machine Learning · Computer Science 2022-10-05 Ruo-Ze Liu , Zhen-Jia Pang , Zhou-Yu Meng , Wenhai Wang , Yang Yu , Tong Lu

World Models have emerged as a powerful paradigm for learning compact, predictive representations of environment dynamics, enabling agents to reason, plan, and generalize beyond direct experience. Despite recent interest in World Models,…

Artificial Intelligence · Computer Science 2026-02-18 Lucas Maes , Quentin Le Lidec , Dan Haramati , Nassim Massaudi , Damien Scieur , Yann LeCun , Randall Balestriero

Large language models (LLMs) have been proposed as supervisory agents for spacecraft operations, but existing approaches rely on static prompting and do not improve across repeated executions. We introduce \textsc{GUIDE}, a non-parametric…

Multiagent Systems · Computer Science 2026-04-16 Alejandro Carrasco , Mariko Storey-Matsutani , Victor Rodriguez-Fernandez , Richard Linares

Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi-agent reinforcement learning (MARL)…

Machine Learning · Computer Science 2022-06-13 Linghui Meng , Muning Wen , Yaodong Yang , Chenyang Le , Xiyun Li , Weinan Zhang , Ying Wen , Haifeng Zhang , Jun Wang , Bo Xu

Macro-management is an important problem in StarCraft, which has been studied for a long time. Various datasets together with assorted methods have been proposed in the last few years. But these datasets have some defects for boosting the…

Artificial Intelligence · Computer Science 2023-04-04 Huikai Wu , Yanqi Zong , Junge Zhang , Kaiqi Huang

Agents operating in complex software environments benefit from reasoning about the consequences of their actions, as even a single incorrect user interface (UI) operation can derail long, artifact-preserving workflows. This challenge is…

In the last few years, deep multi-agent reinforcement learning (RL) has become a highly active area of research. A particularly challenging class of problems in this area is partially observable, cooperative, multi-agent learning, in which…

Reinforcement learning from large-scale offline datasets provides us with the ability to learn policies without potentially unsafe or impractical exploration. Significant progress has been made in the past few years in dealing with the…

Machine Learning · Computer Science 2021-08-04 Philip J. Ball , Cong Lu , Jack Parker-Holder , Stephen Roberts

Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text…

Artificial Intelligence · Computer Science 2026-04-14 Hongyu Chen , Liang Lin , Guangrun Wang

Robotic manipulation requires reasoning about future spatial-temporal interactions and geometric constraints, yet existing Vision-Language-Action (VLA) policies often leave predictive representation weakly coupled with action execution,…

Robotics · Computer Science 2026-05-04 Yuxuan Tian , Yurun Jin , Bin Yu , Yukun Shi , Hao Wu , Chi Harold Liu , Kai Chen , Cong Huang