English

Whose Is This?: Context-Aware Object Ownership Inference with Uncertainty-Guided Questioning

Robotics 2026-05-28 v1

Abstract

Service robots must infer object ownership to correctly interpret instructions such as "bring me my cup." However, ownership is a latent attribute that cannot be directly observed, and existing methods often rely on limited cues such as recent usage, making them unreliable in scenarios such as temporary sharing. We propose a framework for context-aware ownership inference with uncertainty-guided interaction (COIN). The method integrates user background information and object usage history using a large language model (LLM) to estimate ownership scores. To handle uncertainty, we apply conformal prediction to construct a set of plausible owners and selectively generate user queries when the prediction is uncertain. Experiments in a simulated home environment show that the proposed method consistently outperforms baseline approaches, achieving a Subset Accuracy of 0.988 and a Mean Jaccard index of 0.991. The method also maintains high performance in scenarios involving temporary use and shared ownership. The results demonstrate that combining contextual reasoning with uncertainty-aware interaction improves both estimation accuracy and robustness. The project page is available at https://emergentsystemlabstudent.github.io/COIN/.

Keywords

Cite

@article{arxiv.2605.28087,
  title  = {Whose Is This?: Context-Aware Object Ownership Inference with Uncertainty-Guided Questioning},
  author = {Saki Hashimoto and Akira Taniguchi and Shoichi Hasegawa and Yoshinobu Hagiwara and Tadahiro Taniguchi},
  journal= {arXiv preprint arXiv:2605.28087},
  year   = {2026}
}

Comments

Under review in Advanced Robotics. Project page is https://emergentsystemlabstudent.github.io/COIN/