English

IMBench: A Benchmark for Intuitive Robotic Manipulation

Robotics 2026-07-17 v1 Artificial Intelligence

Abstract

Humans combine reasoning and motor control to solve complex manipulation tasks under diverse constraints. They build an understanding of the physical world that helps them convert reasoning into actions and quickly adapt to new scenes, tasks, and rules. We refer to this capability as intuitive manipulation. Existing benchmarks fail to capture this integration: they evaluate physical reasoning in isolation from execution, or measure policy performance without requiring explicit reasoning. We introduce IMBENCH, a benchmark designed to evaluate intuitive manipulation as an integrated capability spanning perception, physical reasoning, action generation, and iterative execution. Our tasks require models to infer task-relevant physical structure and generate feasible action sequences under explicit constraints, including contact-rich manipulation, tool use, and multi-stage dependencies. We introduce a benchmark of 35 tasks, 14K filtered trajectories, and scalable tools for generating diverse scenarios. Experiments reveal a consistent gap: vision language models show partial physical reasoning ability but fail to produce executable plans, while state-of-the-art vision-language-action models struggle to satisfy task constraints and generalize across scenarios. These results identify intuitive manipulation as a missing axis in current foundation models and generalist robot policies, and position IMBENCH as a step toward evaluating and enabling more integrated, adaptive physical intelligence.

Cite

@article{arxiv.2607.15641,
  title  = {IMBench: A Benchmark for Intuitive Robotic Manipulation},
  author = {Anurag Maurya and Sukhvansh Jain and Prajwal Avhad and Gautham Balachandran and Ziyi Zhou and Atharva Kshirsagar and Satyam Singh and Bowen Li. Rishabh Mukund and Ritul Singh and Jatin Vira and Suvonil Chatterjee and Devesh K. Jha},
  journal= {arXiv preprint arXiv:2607.15641},
  year   = {2026}
}

Comments

Accepted to SemRob Workshop, RSS 2026. Project Website: https://imbench.org/