English
Related papers

Related papers: Collaborative Quest Completion with LLM-driven Non…

200 papers

Recently, procedural content generation has exhibited considerable advancements in the domain of 2D game level generation such as Super Mario Bros. and Sokoban through large language models (LLMs). To further validate the capabilities of…

Artificial Intelligence · Computer Science 2024-06-14 Shiying Hu , Zengrong Huang , Chengpeng Hu , Jialin Liu

Strategic coordination between autonomous agents and human partners under incomplete information can be modeled as turn-based cooperative games. We extend a turn-based game under incomplete information, the shared-control game, to allow…

Artificial Intelligence · Computer Science 2025-02-19 Shenghui Chen , Ruihan Zhao , Sandeep Chinchali , Ufuk Topcu

Existing benchmarks for LLM agents' social behavior typically focus on a single capability dimension and evaluate only behavioral outcomes, overlooking process signals from reasoning and communication. We present M3-BENCH, a benchmark of 24…

Artificial Intelligence · Computer Science 2026-04-03 Sixiong Xie , Zhuofan Shi , Haiyang Shen , Yun Ma , Xiang Jing

Enhancing AI systems with efficient communication skills for effective human assistance necessitates proactive initiatives from the system side to discern specific circumstances and interact aptly. This research focuses on a collective…

Computation and Language · Computer Science 2024-02-09 Jack Zhang

In this work we proposing adapting the Minecraft builder task into an LLM benchmark suitable for evaluating LLM ability in spatially orientated tasks, and informing builder agent design. Previous works have proposed corpora with varying…

Computation and Language · Computer Science 2024-07-18 Chris Madge , Massimo Poesio

Role-playing games (RPGs) provide players with a rich, interactive world to explore. Dialogue serves as the primary means of communication between developers and players, manifesting in various forms such as guides, NPC interactions, and…

Computation and Language · Computer Science 2024-07-31 Navapat Nananukul , Wichayaporn Wongkamjan

People increasingly use multiple Multimodal Large Language Models (MLLMs) concurrently, selecting each based on its perceived strengths. This cross-platform practice creates coordination challenges: adapting prompts to different interfaces,…

Human-Computer Interaction · Computer Science 2026-03-30 Seunghwa Pyo , Donggun Lee , Jungwoo Rhee , Soobin Park , Youn-kyung Lim

GenQuest is a generative text adventure game that leverages Large Language Models (LLMs) to facilitate second language learning through immersive, interactive storytelling. The system engages English as a Foreign Language (EFL) learners in…

Computation and Language · Computer Science 2025-10-07 Qiao Wang , Adnan Labib , Robert Swier , Michael Hofmeyr , Zheng Yuan

While Vision-Language Models (VLMs) hold promise for tasks requiring extensive collaboration, traditional multi-agent simulators have facilitated rich explorations of an interactive artificial society that reflects collective behavior.…

Computation and Language · Computer Science 2024-05-24 Xianhao Yu , Jiaqi Fu , Renjia Deng , Wenjuan Han

Multi-agent collaboration with Large Language Models (LLMs) demonstrates proficiency in basic tasks, yet its efficiency in more complex scenarios remains unexplored. In gaming environments, these agents often face situations without…

Computation and Language · Computer Science 2024-01-01 Zijing Shi , Meng Fang , Shunfeng Zheng , Shilong Deng , Ling Chen , Yali Du

This paper describes a method for generative player modeling and its application to the automatic testing of game content using archetypal player models called procedural personas. Theoretically grounded in psychological decision theory,…

Artificial Intelligence · Computer Science 2018-02-21 Christoffer Holmgård , Michael Cerny Green , Antonios Liapis , Julian Togelius

We present Word2Minecraft, a system that leverages large language models to generate playable game levels in Minecraft based on structured stories. The system transforms narrative elements-such as protagonist goals, antagonist challenges,…

Computation and Language · Computer Science 2025-03-24 Shuo Huang , Muhammad Umair Nasir , Steven James , Julian Togelius

Interactive Fiction games (IF games) are where players interact through natural language commands. While recent advances in Artificial Intelligence agents have reignited interest in IF games as a domain for studying decision-making,…

Computation and Language · Computer Science 2025-05-20 Jinming Zhang , Yunfei Long

Recently, various studies have leveraged Large Language Models (LLMs) to help decision-making and planning in environments, and try to align the LLMs' knowledge with the world conditions. Nonetheless, the capacity of LLMs to continuously…

Machine Learning · Computer Science 2023-10-16 Yicheng Feng , Yuxuan Wang , Jiazheng Liu , Sipeng Zheng , Zongqing Lu

MineRL 2019 competition challenged participants to train sample-efficient agents to play Minecraft, by using a dataset of human gameplay and a limit number of steps the environment. We approached this task with behavioural cloning by…

Artificial Intelligence · Computer Science 2020-05-08 Anssi Kanervisto , Janne Karttunen , Ville Hautamäki

With the rapid advancement of Large Language Models (LLMs), LLM-based autonomous agents have shown the potential to function as digital employees, such as digital analysts, teachers, and programmers. In this paper, we develop an…

Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop an intelligent builder agent in a simulated building…

Computation and Language · Computer Science 2022-04-22 Zhengxiang Shi , Yue Feng , Aldo Lipani

As video games continue to evolve, understanding what drives player enjoyment remains a key challenge. Player reviews provide valuable insights, but their unstructured nature makes large-scale analysis difficult. This study applies…

Human-Computer Interaction · Computer Science 2025-12-02 Hisham Abdelqader

We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft that continuously explores the world, acquires diverse skills, and makes novel discoveries without human intervention. Voyager consists of three key…

Artificial Intelligence · Computer Science 2023-10-20 Guanzhi Wang , Yuqi Xie , Yunfan Jiang , Ajay Mandlekar , Chaowei Xiao , Yuke Zhu , Linxi Fan , Anima Anandkumar

The Connections puzzle is a word association game published daily by The New York Times (NYT). In this game, players are asked to find groups of four words that are connected by a common theme. While solving a given Connections puzzle…

Artificial Intelligence · Computer Science 2024-07-17 Tim Merino , Sam Earle , Ryan Sudhakaran , Shyam Sudhakaran , Julian Togelius