English
Related papers

Related papers: Narrative-to-Scene Generation: An LLM-Driven Pipel…

200 papers

Procedural generation techniques in 3D rendering engines have revolutionized the creation of complex environments, reducing reliance on manual design. Recent approaches using Large Language Models (LLMs) for 3D scene generation show promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Arafa Yoncalik , Wouter Jansen , Nico Huebel , Mohammad Hasan Rahmani , Jan Steckel

Large Language Models (LLMs) have shown strong potential for narrative generation, but their use in complex, multi-layered role-playing game (RPG) worlds is still limited by issues of coherence, controllability, and structural consistency.…

Computation and Language · Computer Science 2026-04-29 Dominik Borawski , Marta Szulc , Robert Chudy , Małgorzata Giedrowicz , Piotr Mironowicz

Diffusion-based generative models have significantly advanced text-to-image generation but encounter challenges when processing lengthy and intricate text prompts describing complex scenes with multiple objects. While excelling in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hanan Gani , Shariq Farooq Bhat , Muzammal Naseer , Salman Khan , Peter Wonka

Generative AI has established the opportunity to readily transform content from one medium to another. This capability is especially powerful for storytelling, where visual illustrations can illuminate a story originally expressed in text.…

Computation and Language · Computer Science 2025-09-30 Melissa Roemmele , John Joon Young Chung , Taewook Kim , Yuqian Sun , Alex Calderwood , Max Kreminski

This paper presents a system for procedurally generating agent-based narratives using large language models (LLMs). Users could drag and drop multiple agents and objects into a scene, with each entity automatically assigned semantic…

Graphics · Computer Science 2025-12-24 Vinayak Regmi , Christos Mousas

Procedural Content Generation for 3D game levels faces challenges in balancing spatial coherence, navigational functionality, and adaptable gameplay progression across multi-floor environments. This paper introduces a novel framework for…

Artificial Intelligence · Computer Science 2025-08-27 Kaijie Xu , Clark Verbrugge

Large language models (LLMs) offer promise for dynamic game content generation, but they face critical barriers, including narrative incoherence and high operational costs. Due to their large size, they are often accessed in the cloud,…

Artificial Intelligence · Computer Science 2026-05-20 Morten I. K. Munk , Arturo Valdivia , Paolo Burelli

Recent advances in scene-based video generation enable coherent visual narratives from structured prompts, yet a key aspect of storytelling -- character-driven dialogue and speech -- remains underexplored. We present a modular pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Taewon Kang , Ming C. Lin

We present a system for generating indoor scenes in response to text prompts. The prompts are not limited to a fixed vocabulary of scene descriptions, and the objects in generated scenes are not restricted to a fixed set of object…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Rio Aguina-Kang , Maxim Gumin , Do Heon Han , Stewart Morris , Seung Jean Yoo , Aditya Ganeshan , R. Kenny Jones , Qiuhong Anna Wei , Kailiang Fu , Daniel Ritchie

Dynamic scenes contain intricate spatio-temporal information, crucial for mobile robots, UAVs, and autonomous driving systems to make informed decisions. Parsing these scenes into semantic triplets <Subject-Predicate-Object> for accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Hang Zhang , Zhuoling Li , Jun Liu

Dialogue-based Role Playing Games (RPGs) require powerful storytelling. The narratives of these may take years to write and typically involve a large creative team. In this work, we demonstrate the potential of large generative text models…

Computation and Language · Computer Science 2024-06-07 Jorge Leandro , Sudha Rao , Michael Xu , Weijia Xu , Nebosja Jojic , Chris Brockett , Bill Dolan

Large Language Models (LLMs) have proven their worth across a diverse spectrum of disciplines. LLMs have shown great potential in Procedural Content Generation (PCG) as well, but directly generating a level through a pre-trained LLM is…

Computation and Language · Computer Science 2024-05-14 Muhammad U. Nasir , Steven James , Julian Togelius

Prompt-driven scene synthesis allows users to generate complete 3D environments from textual descriptions. Current text-to-scene methods often struggle with complex geometries and object transformations, and tend to show weak adherence to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Frédéric Berdoz , Luca A. Lanzendörfer , Nick Tuninga , Roger Wattenhofer

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

GameTileNet is a dataset designed to provide semantic labels for low-resolution digital game art, advancing procedural content generation (PCG) and related AI research as a vision-language alignment task. Large Language Models (LLMs) and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Yi-Chun Chen , Arnav Jhala

Large Language Models (LLMs) have proven to be useful tools in various domains outside of the field of their inception, which was natural language processing. In this study, we provide practical directions on how to use LLMs to generate…

Computation and Language · Computer Science 2023-07-04 Muhammad U Nasir , Julian Togelius

In recent years, Procedural Level Generation via Machine Learning (PLGML) techniques have been applied to generate game levels with machine learning. These approaches rely on human-annotated representations of game levels. Creating…

Machine Learning · Computer Science 2021-10-08 Mrunal Jadhav , Matthew Guzdial

Synthesizing 3D scenes from open-vocabulary text descriptions is a challenging, important, and recently-popular application. One of its critical subproblems is layout generation: given a set of objects, lay them out to produce a scene…

Animation elevates digital documents into immersive experiences, yet creating custom motion paths remains cumbersome, requiring designers to manually select presets, plot B\'ezier points, and configure timing properties. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mannat Khurana , Sanyam Jain , Rishav Agarwal

Writing compelling fiction is a multifaceted process combining elements such as crafting a plot, developing interesting characters, and using evocative language. While large language models (LLMs) show promise for story writing, they…

Computation and Language · Computer Science 2025-03-17 Fantine Huot , Reinald Kim Amplayo , Jennimaria Palomaki , Alice Shoshana Jakobovits , Elizabeth Clark , Mirella Lapata
‹ Prev 1 2 3 10 Next ›