English
Related papers

Related papers: Promptable Game Models: Text-Guided Game Simulatio…

200 papers

The nascent field of neurogames relies on active Brain-Computer Interface input to drive its game mechanics. Consequently, users expect their conscious will to be meaningfully reflected on the virtual environment they're engaging in.…

Human-Computer Interaction · Computer Science 2025-04-22 Diego Saldivar

Inductions and game semantics are two useful extensions to traditional logic programming. To be specific, inductions can capture a wider class of provable formulas in logic programming. Adopting game semantics can make logic programming…

Logic in Computer Science · Computer Science 2015-08-11 Keehang Kwon

Modern video games are becoming richer and more complex in terms of game mechanics. This complexity allows for the emergence of a wide variety of ways to play the game across the players. From the point of view of the game designer, this…

Artificial Intelligence · Computer Science 2022-11-30 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

A world model enables an intelligent agent to imagine, predict, and reason about how the world evolves in response to its actions, and accordingly to plan and strategize. While recent video generation models produce realistic visual…

Methods for learning latent user representations from historical behavior logs have gained traction for recommendation tasks in e-commerce, content streaming, and other settings. However, this area still remains relatively underexplored in…

We explore how interaction with large language models (LLMs) can give rise to emergent behaviors, empowering players to participate in the evolution of game narratives. Our testbed is a text-adventure game in which players attempt to solve…

The ability to generate highly realistic 2D images from mere text prompts has recently made huge progress in terms of speed and quality, thanks to the advent of image diffusion models. Naturally, the question arises if this can be also…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Christina Tsalicoglou , Fabian Manhardt , Alessio Tonioni , Michael Niemeyer , Federico Tombari

While diffusion-based text-to-image (T2I) models provide a simple and powerful way to generate images, guiding this generation remains a challenge. For concepts that are difficult to describe through language, users may struggle to create…

Human-Computer Interaction · Computer Science 2023-08-11 John Joon Young Chung , Eytan Adar

Sample-efficient online reinforcement learning often uses replay buffers to store experience for reuse when updating the value function. However, uniform replay is inefficient, since certain classes of transitions can be more relevant to…

Machine Learning · Computer Science 2025-05-12 Renhao Wang , Kevin Frans , Pieter Abbeel , Sergey Levine , Alexei A. Efros

A key challenge for reinforcement learning is solving long-horizon planning problems. Recent work has leveraged programs to guide reinforcement learning in these settings. However, these approaches impose a high manual burden on the user…

Artificial Intelligence · Computer Science 2021-11-03 Yichen David Yang , Jeevana Priya Inala , Osbert Bastani , Yewen Pu , Armando Solar-Lezama , Martin Rinard

Recent advances in video generation have spurred the development of world models capable of simulating 3D-consistent environments and interactions with static objects. However, a significant limitation remains in their ability to model…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Anmol Agarwal , Pranay Meshram , Sumer Singh , Saurav Suman , Andrew Lapp , Shahbuland Matiana , Louis Castricato , Spencer Frazier

World models have become a central paradigm for learning predictive simulators that support generation, planning, and decision-making. Yet, despite rapid progress in industry-scale interactive video generation, the broader research…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Siqiao Huang , Partha Kaushik , Michael Chen , Hengkai Pan , Kaiwen Geng , Omar Chehab , Fernando Moreno-Pino , Max Simchowitz

Given a natural language instruction and an input scene, our goal is to train a model to output a manipulation program that can be executed by the robot. Prior approaches for this task possess one of the following limitations: (i) rely on…

Robotic manipulation requires anticipating how the environment evolves in response to actions, yet most existing systems lack this predictive capability, often resulting in errors and inefficiency. While Vision-Language Models (VLMs)…

Robotics · Computer Science 2026-02-12 Songen Gu , Yunuo Cai , Tianyu Wang , Simo Wu , Yanwei Fu

The final frontier for simulation is the accurate representation of complex, real-world social systems. While agent-based modeling (ABM) seeks to study the behavior and interactions of agents within a larger system, it is unable to…

Artificial Intelligence · Computer Science 2023-08-16 Edward Junprung

As Large Language Models (LLMs) are increasingly deployed in decision-critical domains, it becomes essential to ensure that their confidence estimates faithfully correspond to their actual correctness. Existing calibration methods have…

Computation and Language · Computer Science 2025-08-21 Ke Fang , Tianyi Zhao , Lu Cheng

Prompt learning has demonstrated promising results in fine-tuning pre-trained multimodal models. However, the performance improvement is limited when applied to more complex and fine-grained tasks. The reason is that most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Weicai Yan , Wang Lin , Zirun Guo , Ye Wang , Fangming Feng , Xiaoda Yang , Zehan Wang , Tao Jin

Introduction: The application of Artificial Intelligence in games has evolved significantly, allowing for dynamic content generation. However, its use as a core gameplay co-creation tool remains underexplored. Objective: This paper proposes…

Artificial Intelligence · Computer Science 2025-11-21 Emanuel C. Silva , Emily S. M. Salum , Gabriel M. Arantes , Matheus P. Pereira , Vinicius F. Oliveira , Alessandro L. Bicho

Deep learning agents can achieve high performance in complex game domains without often understanding the underlying causal game mechanics. To address this, we investigate Causal Induction: the ability to infer governing laws from…

Artificial Intelligence · Computer Science 2026-02-03 Mohit Jiwatode , Alexander Dockhorn , Bodo Rosenhahn

Probing Pre-trained Language Models (PLMs) using prompts has indirectly implied that language models (LMs) can be treated as knowledge bases. To this end, this phenomena has been effective especially when these LMs are fine-tuned towards…

Computation and Language · Computer Science 2022-04-08 M. Abaho , D. Bollegala , P. Williamson , S. Dodd