English
Related papers

Related papers: Word2Minecraft: Generating 3D Game Levels through …

200 papers

This paper proposes a procedural content generator which evolves Minecraft buildings according to an open-ended and intrinsic definition of novelty. To realize this goal we evaluate individuals' novelty in the latent space using a 3D…

Machine Learning · Computer Science 2022-09-08 Matthew Barthet , Antonios Liapis , Georgios N. Yannakakis

We present practical approaches of using deep learning to create and enhance level maps and textures for video games -- desktop, mobile, and web. We aim to present new possibilities for game developers and level artists. The task of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Piotr Migdał , Bartłomiej Olechno , Błażej Podgórski

As large language models have shown remarkable capabilities in conversing via natural language, the question arises as to how LLMs could potentially assist chemical engineers in research and industry with domain-specific tasks. We generate…

Programming Languages · Computer Science 2025-03-24 Sophia Rupprecht , Yassine Hounat , Monisha Kumar , Giacomo Lastrucci , Artur M. Schweidtmann

In task-oriented conversation systems, natural language generation systems that generate sentences with specific information related to conversation flow are useful. Our study focuses on language generation by considering various…

Computation and Language · Computer Science 2021-07-29 Joosung Lee

Large language models (LLMs) such as ChatGPT and GPT-4 have recently demonstrated their remarkable abilities of communicating with human users. In this technical report, we take an initiative to investigate their capacities of playing text…

Computation and Language · Computer Science 2025-04-01 Chen Feng Tsai , Xiaochen Zhou , Sierra S. Liu , Jing Li , Mo Yu , Hongyuan Mei

Large-scale language models (LMs) pretrained on massive corpora of text, such as GPT-2, are powerful open-domain text generators. However, as our systematic examination reveals, it is still challenging for such models to generate coherent…

Computation and Language · Computer Science 2021-04-15 Bowen Tan , Zichao Yang , Maruan AI-Shedivat , Eric P. Xing , Zhiting Hu

To enhance the quality of generated stories, recent story generation models have been investigating the utilization of higher-level attributes like plots or commonsense knowledge. The application of prompt-based learning with large language…

Computation and Language · Computer Science 2023-07-25 Zhuohan Xie , Trevor Cohn , Jey Han Lau

The procedural generation of levels and content in video games is a challenging AI problem. Often such generation relies on an intelligent way of evaluating the content being generated so that constraints are satisfied and/or objectives…

Artificial Intelligence · Computer Science 2019-04-22 Ahmed Khalifa , Michael Cerny Green , Gabriella Barros , Julian Togelius

With large language models (LLMs) on the rise, in-game interactions are shifting from rigid commands to natural conversations. However, the impacts of LLMs on player performance and game experience remain underexplored. This work explores…

Human-Computer Interaction · Computer Science 2025-07-31 Xin Sun , Lei Wang , Yue Li , Jie Li , Massimo Poesio , Julian Frommel , Koen Hinriks , Jiahuan Pei

Interactive fictions, or text-adventures, are games in which a player interacts with a world entirely through textual descriptions and text actions. Text-adventure games are typically structured as puzzles or quests wherein the player must…

Computation and Language · Computer Science 2020-08-20 Prithviraj Ammanabrolu , William Broniec , Alex Mueller , Jeremy Paul , Mark O. Riedl

Human writers often begin their stories with an overarching mental scene, where they envision the interactions between characters and their environment. Inspired by this creative process, we propose a novel approach to long-form story…

Computation and Language · Computer Science 2026-03-20 Zehao Chen , Rong Pan , Haoran Li

Procedural content generation via machine learning (PCGML) in games involves using machine learning techniques to create game content such as maps and levels. 2D tile-based game levels have consistently served as a standard dataset for…

Machine Learning · Computer Science 2025-04-08 Mahsa Bazzaz , Seth Cooper

We present a novel architecture for safely integrating Large Language Models (LLMs) into interactive game engines, allowing players to "program" new behaviors using natural language. Our framework mitigates risks by using an LLM to…

Human-Computer Interaction · Computer Science 2025-10-21 Austin Drake , Hang Dong

This paper introduces a system used to generate game feature suggestions based on a text prompt. Trained on the game descriptions of almost 60k games, it uses the word embeddings of a small GLoVe model to extract features and entities found…

Information Retrieval · Computer Science 2023-08-29 M Charity , Yash Bhartia , Daniel Zhang , Ahmed Khalifa , Julian Togelius

In this work, we investigate the capacity of language models to generate explicit, interpretable, and interactive world models of scientific and common-sense reasoning tasks. We operationalize this as a task of generating text games,…

Computation and Language · Computer Science 2023-10-25 Ruoyao Wang , Graham Todd , Eric Yuan , Ziang Xiao , Marc-Alexandre Côté , Peter Jansen

This paper focuses on procedurally generating rules and communicating them to players to adjust the difficulty. This is part of a larger project to collect and adapt games in educational games for young children using a digital puzzle game…

Human-Computer Interaction · Computer Science 2025-03-20 Thomas Volden , Djordje Grbic , Paolo Burelli

The use of generative AI in video game development is on the rise, and as the conversational and other capabilities of large language models continue to improve, we expect LLM-driven non-player characters (NPCs) to become widely deployed.…

Computation and Language · Computer Science 2024-07-08 Sudha Rao , Weijia Xu , Michael Xu , Jorge Leandro , Ken Lobb , Gabriel DesGarennes , Chris Brockett , Bill Dolan

Conditional story generation and contextual text continuation have become increasingly popular topics in NLP community. Existing models are often prone to output paragraphs of texts that gradually diverge from the given prompt. Although the…

Computation and Language · Computer Science 2020-09-15 Ruixiao Sun , Jie Yang , Mehrdad Yousefzadeh

In a rapidly evolving digital landscape autonomous tools and robots are becoming commonplace. Recognizing the significance of this development, this paper explores the integration of Large Language Models (LLMs) like Generative pre-trained…

Human-Computer Interaction · Computer Science 2024-03-22 Younes Lakhnati , Max Pascher , Jens Gerken

We present GANcraft, an unsupervised neural rendering framework for generating photorealistic images of large 3D block worlds such as those created in Minecraft. Our method takes a semantic block world as input, where each block is assigned…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Zekun Hao , Arun Mallya , Serge Belongie , Ming-Yu Liu