English

Latent Perspective-Taking via a Schr\"odinger Bridge in Influence-Augmented Local Models

Robotics 2026-02-04 v1

Abstract

Operating in environments alongside humans requires robots to make decisions under uncertainty. In addition to exogenous dynamics, they must reason over others' hidden mental-models and mental-states. While Interactive POMDPs and Bayesian Theory of Mind formulations are principled, exact nested-belief inference is intractable, and hand-specified models are brittle in open-world settings. We address both by learning structured mental-models and an estimator of others' mental-states. Building on the Influence-Based Abstraction, we instantiate an Influence-Augmented Local Model to decompose socially-aware robot tasks into local dynamics, social influences, and exogenous factors. We propose (a) a neuro-symbolic world model instantiating a factored, discrete Dynamic Bayesian Network, and (b) a perspective-shift operator modeled as an amortized Schr\"odinger Bridge over the learned local dynamics that transports factored egocentric beliefs into other-centric beliefs. We show that this architecture enables agents to synthesize socially-aware policies in model-based reinforcement learning, via decision-time mental-state planning (a Schr\"odinger Bridge in belief space), with preliminary results in a MiniGrid social navigation task.

Keywords

Cite

@article{arxiv.2602.02857,
  title  = {Latent Perspective-Taking via a Schr\"odinger Bridge in Influence-Augmented Local Models},
  author = {Kevin Alcedo and Pedro U. Lima and Rachid Alami},
  journal= {arXiv preprint arXiv:2602.02857},
  year   = {2026}
}

Comments

Extended Abstract & Poster, Presented at World Modeling Workshop 2026

R2 v1 2026-07-01T09:33:06.534Z