English
Related papers

Related papers: STORY2GAME: Generating (Almost) Everything in an I…

200 papers

We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and…

Automatically generating novel and interesting games is a complex task. Challenges include representing game rules in a computationally workable form, searching through the large space of potential games under most such representations, and…

Artificial Intelligence · Computer Science 2024-12-04 Graham Todd , Alexander Padula , Matthew Stephenson , Éric Piette , Dennis J. N. J. Soemers , Julian Togelius

Automatically generating stories is a challenging problem that requires producing causally related and logical sequences of events about a topic. Previous approaches in this domain have focused largely on one-shot generation, where a…

Computation and Language · Computer Science 2020-10-21 Faeze Brahman , Alexandru Petrusca , Snigdha Chaturvedi

Systems for story generation are asked to produce plausible and enjoyable stories given an input context. This task is underspecified, as a vast number of diverse stories can originate from a single input. The large output space makes it…

Computation and Language · Computer Science 2020-10-06 Nader Akoury , Shufan Wang , Josh Whiting , Stephen Hood , Nanyun Peng , Mohit Iyyer

World models improve a learning agent's ability to efficiently operate in interactive and situated environments. This work focuses on the task of building world models of text-based game environments. Text-based games, or interactive…

Machine Learning · Computer Science 2021-10-22 Prithviraj Ammanabrolu , Mark O. Riedl

There is much interest in using large pre-trained models in Automatic Game Design (AGD), whether via the generation of code, assets, or more abstract conceptualization of design ideas. But so far this interest largely stems from the ad hoc…

Artificial Intelligence · Computer Science 2025-06-10 Sam Earle , Ahmed Khalifa , Muhammad Umair Nasir , Zehua Jiang , Graham Todd , Andrzej Banburski-Fahey , Julian Togelius

Large language models (LLMs) offer promise for dynamic game content generation, but they face critical barriers, including narrative incoherence and high operational costs. Due to their large size, they are often accessed in the cloud,…

Artificial Intelligence · Computer Science 2026-05-20 Morten I. K. Munk , Arturo Valdivia , Paolo Burelli

Automatically generating 3D games in commercial game engines remains a non-trivial challenge, as it involves complex engine-related workflows for generating assets such as scenes, blueprints, and code. To address this challenge, we propose…

Human-Computer Interaction · Computer Science 2026-04-09 Lei Yin , Wentao Cheng , Zhida Qin , Tianyu Huang , Yidong Li , Gangyi Ding

Writing compelling fiction is a multifaceted process combining elements such as crafting a plot, developing interesting characters, and using evocative language. While large language models (LLMs) show promise for story writing, they…

Computation and Language · Computer Science 2025-03-17 Fantine Huot , Reinald Kim Amplayo , Jennimaria Palomaki , Alice Shoshana Jakobovits , Elizabeth Clark , Mirella Lapata

Strategic reasoning enables agents to cooperate, communicate, and compete with other agents in diverse situations. Existing approaches to solving strategic games rely on extensive training, yielding strategies that do not generalize to new…

Artificial Intelligence · Computer Science 2023-05-31 Kanishk Gandhi , Dorsa Sadigh , Noah D. Goodman

We designed and built a game called \textit{Immersive Text Game}, which allows the player to choose a story and a character, and interact with other characters in the story in an immersive manner of dialogues. The game is based on several…

Computation and Language · Computer Science 2022-03-22 Wanshui Li , Yifan Bai , Jiaxuan Lu , Kexin Yi

Digital storytelling, essential in entertainment, education, and marketing, faces challenges in production scalability and flexibility. The StoryAgent framework, introduced in this paper, utilizes Large Language Models and generative tools…

Computation and Language · Computer Science 2024-06-24 Samuel S. Sohn , Danrui Li , Sen Zhang , Che-Jui Chang , Mubbasir Kapadia

In this work, we propose a framework that creates a lively virtual dynamic scene with contextual motions of multiple humans. Generating multi-human contextual motion requires holistic reasoning over dynamic relationships among human-human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Donggeun Lim , Jinseok Bae , Inwoo Hwang , Seungmin Lee , Hwanhee Lee , Young Min Kim

This paper presents a demonstration of our monster battle game, in which the game agents fight in accordance with their player's language commands. The commands were translated into the knowledge expression called behavior branches by a…

Human-Computer Interaction · Computer Science 2024-12-19 Ray Ito , Junichiro Takahashi

Language-modeling--based approaches to story plot generation attempt to construct a plot by sampling from a language model (LM) to predict the next character, word, or sentence to add to the story. LM techniques lack the ability to receive…

Computation and Language · Computer Science 2023-01-19 Pradyumna Tambwekar , Murtaza Dhuliawala , Lara J. Martin , Animesh Mehta , Brent Harrison , Mark O. Riedl

In recent years, Artificial Intelligence Generated Content (AIGC) has advanced from text-to-image generation to text-to-video and multimodal video synthesis. However, generating playable games presents significant challenges due to the…

Artificial Intelligence · Computer Science 2024-12-03 Mingyu Yang , Junyou Li , Zhongbin Fang , Sheng Chen , Yangbin Yu , Qiang Fu , Wei Yang , Deheng Ye

This paper presents Dynamic Context Prompting/Programming (DCP/P), a novel framework for interacting with LLMs to generate graph-based content with a dynamic context window history. While there is an existing study utilizing LLMs to…

While generative AI is advancing writing support tools, creative writing is often seen as the exclusive domain of skilled writers. This paper introduces "1001 Nights", a co-creative story-crafting game that transforms writing into a playful…

Human-Computer Interaction · Computer Science 2025-03-13 Jiaying Fu , Xiruo Wang , Zhouyi Li , Kate Vi , Chuyan Xu , Yuqian Sun

Human writers often begin their stories with an overarching mental scene, where they envision the interactions between characters and their environment. Inspired by this creative process, we propose a novel approach to long-form story…

Computation and Language · Computer Science 2026-03-20 Zehao Chen , Rong Pan , Haoran Li

Generating a game is not the same as making one that can be played. Despite advances in code generation, existing approaches treat game generation as one-shot translation from prompt to artifact, leaving interaction-level failures…

Software Engineering · Computer Science 2026-05-28 Yixu Huang , Bo Li , Na Li , Zhe Wang , Kaijie Chen , Haonan Ge , Qingyi Si , Yuanzhe Shen , Ruihan Yang , Guangjing Wang , Hongcheng Guo