English
Related papers

Related papers: Promptable Game Models: Text-Guided Game Simulatio…

200 papers

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often…

Human-Computer Interaction · Computer Science 2023-04-20 Stephen Brade , Bryan Wang , Mauricio Sousa , Sageev Oore , Tovi Grossman

Understanding player behavior is fundamental in game data science. Video games evolve as players interact with the game, so being able to foresee player experience would help to ensure a successful game development. In particular, game…

Machine Learning · Statistics 2018-12-10 Anna Guitart , Pei Pei Chen , Paul Bertens , África Periáñez

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

Human-Computer Interaction · Computer Science 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

We present a demonstration of Play What I Mean (PWIM): a novel, AI-supported interaction technique for interactive emergent narrative (IEN) games and play experiences. By assisting players in translating high-level gameplay intents…

Human-Computer Interaction · Computer Science 2024-06-04 Max Kreminski

With the introduction of the transformer architecture in computer vision, increasing model scale has been demonstrated as a clear path to achieving performance and robustness gains. However, with model parameter counts reaching the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jochem Loedeman , Maarten C. Stol , Tengda Han , Yuki M. Asano

We present a novel architecture for safely integrating Large Language Models (LLMs) into interactive game engines, allowing players to "program" new behaviors using natural language. Our framework mitigates risks by using an LLM to…

Human-Computer Interaction · Computer Science 2025-10-21 Austin Drake , Hang Dong

We discuss the emerging new opportunity for building feedback-rich computational models of social systems using generative artificial intelligence. Referred to as Generative Agent-Based Models (GABMs), such individual-level models utilize…

Artificial Intelligence · Computer Science 2024-01-15 Navid Ghaffarzadegan , Aritra Majumdar , Ross Williams , Niyousha Hosseinichimeh

Game environments provide rich, controllable settings that stimulate many aspects of real-world complexity. As such, game agents offer a valuable testbed for exploring capabilities relevant to Artificial General Intelligence. Recently, the…

Artificial Intelligence · Computer Science 2025-11-05 Sihao Hu , Tiansheng Huang , Gaowen Liu , Ramana Rao Kompella , Fatih Ilhan , Selim Furkan Tekin , Yichang Xu , Zachary Yahn , Ling Liu

Text entry is an essential task in our day-to-day digital interactions. Numerous intelligent features have been developed to streamline this process, making text entry more effective, efficient, and fluid. These improvements include…

Computation and Language · Computer Science 2023-10-17 Junxiao Shen , John J. Dudley , Jingyao Zheng , Bill Byrne , Per Ola Kristensson

A wide range of real-world applications is characterized by their symbolic nature, necessitating a strong capability for symbolic reasoning. This paper investigates the potential application of Large Language Models (LLMs) as symbolic…

Computation and Language · Computer Science 2024-01-18 Meng Fang , Shilong Deng , Yudi Zhang , Zijing Shi , Ling Chen , Mykola Pechenizkiy , Jun Wang

In this paper, we present a method for automated persona-driven video game tutorial level generation. Tutorial levels are scenarios in which the player can explore and discover different rules and game mechanics. Procedural personas can…

Artificial Intelligence · Computer Science 2022-04-12 Michael Cerny Green , Ahmed Khalifa , M Charity , Julian Togelius

Many advancements have been made in procedural content generation for games, and with mixed-initiative co-creativity, have the potential for great benefits to human designers. However, co-creative systems for game generation are typically…

Artificial Intelligence · Computer Science 2023-08-07 Rohan Agarwal , Zhiyu Lin , Mark Riedl

Generating visual instructions in a given context is essential for developing interactive world simulators. While prior works address this problem through either text-guided image manipulation or video prediction, these tasks are typically…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yujiang Pu , Zhanbo Huang , Vishnu Boddeti , Yu Kong

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

Software systems are complex, and behavioral comprehension with the increasing amount of AI components challenges traditional testing and maintenance strategies.The lack of tools and methodologies for behavioral software comprehension…

Software Engineering · Computer Science 2019-12-19 Hannes Thaller , Lukas Linsbauer , Rudolf Ramler , Alexander Egyed

The ability to simulate the effects of future actions on the world is a crucial ability of intelligent embodied agents, enabling agents to anticipate the effects of their actions and make plans accordingly. While a large body of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Siyuan Zhou , Yilun Du , Yuncong Yang , Lei Han , Peihao Chen , Dit-Yan Yeung , Chuang Gan

There is a high demand for high-quality Non-Player Characters (NPCs) in video games. Hand-crafting their behavior is a labor intensive and error prone engineering process with limited controls exposed to the game designers. We propose to…

Machine Learning · Computer Science 2019-06-04 Igor Borovikov , Jesse Harder , Michael Sadovsky , Ahmad Beirami

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

With recent and rapid advancements in artificial intelligence (AI), understanding the foundation of purposeful behaviour in autonomous agents is crucial for developing safe and efficient systems. While artificial neural networks have…

Artificial Intelligence · Computer Science 2025-08-12 Aswin Paul , Moein Khajehnejad , Forough Habibollahi , Brett J. Kagan , Adeel Razi

Prompt learning has achieved great success in efficiently exploiting large-scale pre-trained models in natural language processing (NLP). It reformulates the downstream tasks as the generative pre-training ones to achieve consistency, thus…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Ning Liao , Bowen Shi , Xiaopeng Zhang , Min Cao , Junchi Yan , Qi Tian
‹ Prev 1 3 4 5 6 7 10 Next ›