English
Related papers

Related papers: Language-Guided World Models: A Model-Based Approa…

200 papers

Can we build accurate world models out of large language models (LLMs)? How can world models benefit LLM agents? The gap between the prior knowledge of LLMs and the specified environment's dynamics usually bottlenecks LLMs' performance as…

Artificial Intelligence · Computer Science 2025-04-23 Siyu Zhou , Tianyi Zhou , Yijun Yang , Guodong Long , Deheng Ye , Jing Jiang , Chengqi Zhang

The growing popularity of social deduction games has created an increasing need for intelligent frameworks where humans can collaborate with AI agents, particularly in post-pandemic contexts with heightened psychological and social…

Computation and Language · Computer Science 2025-08-12 Qihui Fan , Wenbo Li , Enfu Nan , Yixiao Chen , Lei Lu , Pu Zhao , Yanzhi Wang

Large Language Models (LLMs) have increasingly demonstrated the ability to facilitate the development of multi-agent systems that allow the interpretation of thoughts and actions generated by each individual. Promising advancements have…

Multiagent Systems · Computer Science 2024-09-24 Asher Sprigler , Alexander Drobek , Keagan Weinstock , Wendpanga Tapsoba , Gavin Childress , Andy Dao , Lucas Gral

Researchers and practitioners have recently reframed powerful Large Language Models (LLMs) as agents, enabling them to automate complex tasks largely via the use of specialized functions. To facilitate the development of LLM agents, we…

Artificial Intelligence · Computer Science 2024-08-01 Shaokun Zhang , Jieyu Zhang , Jiale Liu , Linxin Song , Chi Wang , Ranjay Krishna , Qingyun Wu

This study explores integrating large language models (LLMs) with situational awareness-based planning (SAP) to enhance the decision-making capabilities of AI agents in dynamic and uncertain environments. We employ a multi-agent reasoning…

Artificial Intelligence · Computer Science 2024-06-18 Liman Wang , Hanyang Zhong

The arrival of Large Language Models (LLMs) has stirred up philosophical debates about the possibility of realizing agency in an artificial manner. In this work we contribute to the debate by presenting a theoretical model that can be used…

Artificial Intelligence · Computer Science 2024-07-25 Maud van Lier , Gorka Muñoz-Gil

World modelling, i.e. building a representation of the rules that govern the world so as to predict its evolution, is an essential ability for any agent interacting with the physical world. Despite their impressive performance, many…

Machine Learning · Computer Science 2025-05-06 Francesco Petri , Luigi Asprino , Aldo Gangemi

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

Artificial Intelligence · Computer Science 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

In embodied AI, a persistent challenge is enabling agents to robustly adapt to novel domains without requiring extensive data collection or retraining. To address this, we present a world model implanting framework (WorMI) that combines the…

Artificial Intelligence · Computer Science 2025-09-05 Minjong Yoo , Jinwoo Jang , Sihyung Yoon , Honguk Woo

Language models trained on large text corpora encode rich distributional information about real-world environments and action sequences. This information plays a crucial role in current approaches to language processing tasks like question…

Machine Learning · Computer Science 2023-02-07 Belinda Z. Li , William Chen , Pratyusha Sharma , Jacob Andreas

Large Language Models (LLMs) have enabled Multi-Agent Systems (MASs) where agents interact through natural language to solve complex tasks or simulate multi-party dialogues. Recent work on LLM-based MASs has mainly focused on architecture…

Computation and Language · Computer Science 2026-01-09 Yuxiao Ye , Yiming Zhang , Yiran Ma , Huiyuan Xie , Huining Zhu , Zhiyuan Liu

Recent advances in Large Language Models (LLMs) have shown inspiring achievements in constructing autonomous agents that rely on language descriptions as inputs. However, it remains unclear how well LLMs can function as few-shot or…

Computation and Language · Computer Science 2024-06-25 Zixia Jia , Mengmeng Wang , Baichen Tong , Song-Chun Zhu , Zilong Zheng

Large Language Models (LLMs) have emerged as integral tools for reasoning, planning, and decision-making, drawing upon their extensive world knowledge and proficiency in language-related tasks. LLMs thus hold tremendous potential for…

Artificial Intelligence · Computer Science 2024-05-24 Xudong Guo , Kaixuan Huang , Jiale Liu , Wenhui Fan , Natalia Vélez , Qingyun Wu , Huazheng Wang , Thomas L. Griffiths , Mengdi Wang

There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously…

Machine Learning · Computer Science 2024-05-01 Bahar Radmehr , Adish Singla , Tanja Käser

In model-based learning, the agent learns behaviors by simulating trajectories based on world model predictions. Standard world models typically learn a stationary transition function that maps states and actions to next states, when an…

Artificial Intelligence · Computer Science 2026-05-11 Qinshi Zhang , Weipeng Deng , Zhihan Jiang , Jiaming Qu , Qianren Li , Weitao Xu , Ray LC

We give a model-based agent that builds a Python program representing its knowledge of the world based on its interactions with the environment. The world model tries to explain its interactions, while also being optimistic about what…

Artificial Intelligence · Computer Science 2024-09-24 Hao Tang , Darren Key , Kevin Ellis

Simulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process. Recently, substantial evidences…

Information Retrieval · Computer Science 2024-02-16 Lei Wang , Jingsen Zhang , Hao Yang , Zhiyuan Chen , Jiakai Tang , Zeyu Zhang , Xu Chen , Yankai Lin , Ruihua Song , Wayne Xin Zhao , Jun Xu , Zhicheng Dou , Jun Wang , Ji-Rong Wen

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

Large language models (LLMs) have revolutionized the field of artificial intelligence, enabling natural language processing tasks that were previously thought to be exclusive to humans. In this work, we introduce Qwen, the first installment…

Can world knowledge learned by large language models (LLMs) be used to act in interactive environments? In this paper, we investigate the possibility of grounding high-level tasks, expressed in natural language (e.g. "make breakfast"), to a…

Machine Learning · Computer Science 2022-03-09 Wenlong Huang , Pieter Abbeel , Deepak Pathak , Igor Mordatch