English
Related papers

Related papers: Steps towards prompt-based creation of virtual wor…

200 papers

Generative AI tools can provide people with the ability to create virtual environments and scenes with natural language prompts. Yet, how people will formulate such prompts is unclear -- particularly when they inhabit the environment that…

Human-Computer Interaction · Computer Science 2024-05-30 Setareh Aghel Manesh , Tianyi Zhang , Yuki Onishi , Kotaro Hara , Scott Bateman , Jiannan Li , Anthony Tang

Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image…

Human-Computer Interaction · Computer Science 2023-08-28 Hai Dang , Frederik Brudy , George Fitzmaurice , Fraser Anderson

Generative artificial intelligence has shown promise in prompting virtual worlds into existence, yet little attention has been given to understanding how this process unfolds as social interaction. We present Social Conjurer, a framework…

Human-Computer Interaction · Computer Science 2024-10-03 Amina Kobenova , Cyan DeVeaux , Samyak Parajuli , Andrzej Banburski-Fahey , Judith Amores Fernandez , Jaron Lanier

Computing students increasingly rely on generative AI tools for programming assistance, often without formal instruction or guidance. This highlights a need to teach students how to effectively interact with AI models, particularly through…

Computers and Society · Computer Science 2025-09-15 Victor-Alexandru Pădurean , Paul Denny , Alkis Gotovos , Adish Singla

In recent years Generative Machine Learning systems have advanced significantly. A current wave of generative systems use text prompts to create complex imagery, video, even 3D datasets. The creators of these systems claim a revolution in…

Computers and Society · Computer Science 2023-02-03 Jon McCormack , Camilo Cruz Gambardella , Nina Rajcic , Stephen James Krol , Maria Teresa Llano , Meng Yang

In the world of technology and AI, digital models play an important role in our lives and are an essential part of the digital twins of real-world objects. They can be created by designers, artists, or game developers using spline curves…

Graphics · Computer Science 2025-05-20 Rushan Ziatdinov , Rifkat Nabiyev

Much literature has shown that prompt-based learning is an efficient method to make use of the large pre-trained language model. Recent works also exhibit the possibility of steering a chatbot's output by plugging in an appropriate prompt.…

Computation and Language · Computer Science 2022-10-14 Hsuan Su , Pohan Chi , Shih-Cheng Huang , Chung Ho Lam , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

The growing integration of AI tools in software development, particularly Large Language Models (LLMs) such as ChatGPT, has revolutionized how developers approach coding tasks. However, achieving high-quality code often requires iterative…

Software Engineering · Computer Science 2025-06-03 Sophia DiCuffa , Amanda Zambrana , Priyanshi Yadav , Sashidhar Madiraju , Khushi Suman , Eman Abdullah AlOmar

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instructions or generated…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jindong Gu , Zhen Han , Shuo Chen , Ahmad Beirami , Bailan He , Gengyuan Zhang , Ruotong Liao , Yao Qin , Volker Tresp , Philip Torr

Generative AI, such as image generation models and large language models, stands to provide tremendous value to end-user programmers in creative and knowledge workflows. Current research methods struggle to engage end-users in a realistic…

Human-Computer Interaction · Computer Science 2023-12-29 Advait Sarkar , Ian Drosos , Rob Deline , Andrew D. Gordon , Carina Negreanu , Sean Rintel , Jack Williams , Benjamin Zorn

World building forms the foundation of any task that requires narrative intelligence. In this work, we focus on procedurally generating interactive fiction worlds---text-based worlds that players "see" and "talk to" using natural language.…

Artificial Intelligence · Computer Science 2020-01-29 Prithviraj Ammanabrolu , Wesley Cheung , Dan Tu , William Broniec , Mark O. Riedl

Prompting is central to interaction with AI systems, yet many users struggle to explore alternative directions, articulate creative intent, or understand how variations in prompts shape model outputs. We introduce prompt recommender systems…

Human-Computer Interaction · Computer Science 2026-01-23 Jason Kim , Maria Teleki , James Caverlee

We are witnessing a novel era of creativity where anyone can create digital content via prompt-based learning (known as prompt engineering). This paper investigates prompt engineering as a novel creative skill for creating AI art with…

Human-Computer Interaction · Computer Science 2024-07-08 Jonas Oppenlaender , Rhema Linder , Johanna Silvennoinen

Large Language Models (LLMs) have proven their worth across a diverse spectrum of disciplines. LLMs have shown great potential in Procedural Content Generation (PCG) as well, but directly generating a level through a pre-trained LLM is…

Computation and Language · Computer Science 2024-05-14 Muhammad U. Nasir , Steven James , Julian Togelius

Recent advances in scene-based video generation enable coherent visual narratives from structured prompts, yet a key aspect of storytelling -- character-driven dialogue and speech -- remains underexplored. We present a modular pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Taewon Kang , Ming C. Lin

In the realm of AI architectural design, the importance of prompts is becoming increasingly prominent. With advancements in artificial intelligence and large-scale model technology, more design tasks are being delegated to machine learning…

Human-Computer Interaction · Computer Science 2024-04-25 Xin Zhang , Wenwen Liu

Recent advances in video generation models have sparked interest in world models capable of simulating realistic environments. While navigation has been well-explored, physically meaningful interactions that mimic real-world forces remain…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Nate Gillman , Charles Herrmann , Michael Freeman , Daksh Aggarwal , Evan Luo , Deqing Sun , Chen Sun

Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase…

Computation and Language · Computer Science 2023-11-28 Haotian Luo , Yixin Liu , Peidong Liu , Xianggen Liu

Crafting effective prompts for code generation or editing with Large Language Models (LLMs) is not an easy task. Particularly, the absence of immediate, stable feedback during prompt crafting hinders effective interaction, as users are left…

Human-Computer Interaction · Computer Science 2024-05-14 Chen Zhu-Tian , Zeyu Xiong , Xiaoshuo Yao , Elena Glassman

Deep generative models have the potential to fundamentally change the way we create high-fidelity digital content but are often hard to control. Prompting a generative model is a promising recent development that in principle enables…

Human-Computer Interaction · Computer Science 2022-09-07 Hai Dang , Lukas Mecke , Florian Lehmann , Sven Goller , Daniel Buschek
‹ Prev 1 2 3 10 Next ›