English

Do-Undo Bench: Reversibility for Action Understanding in Image Generation

Computer Vision and Pattern Recognition 2026-05-15 v2 Machine Learning

Abstract

We introduce the Do-Undo task and benchmark to address a critical gap in vision-language models: understanding and generating plausible scene transformations driven by real-world actions. Unlike prior work that relies on prompt-based image generation and editing to perform action-conditioned image manipulation, our training hypothesis requires models to simulate the outcome of a real-world action and then reverse it to the original state. This forward-reverse requirement tests genuine cause-and-effect understanding rather than stylistic or semantic edits. We curate a high-quality benchmark of reversible actions from real-world scenarios to enable robust action grounding. Our experiments reveal that current models struggle with action reversibility, highlighting the need to evaluate action understanding. Do-Undo provides an intuitive testbed for evaluating and advancing action-aware generation in multimodal systems that must reason about real-world dynamics.

Keywords

Cite

@article{arxiv.2512.13609,
  title  = {Do-Undo Bench: Reversibility for Action Understanding in Image Generation},
  author = {Shweta Mahajan and Shreya Kadambi and Hoang Le and Rajeev Yasarla and Apratim Bhattacharyya and Munawar Hayat and Fatih Porikli},
  journal= {arXiv preprint arXiv:2512.13609},
  year   = {2026}
}

Comments

Project page: https://s-mahajan.github.io/Do-Undo-Bench/

R2 v1 2026-07-01T08:25:44.520Z