English

GMO-E$^2$DIT: Grounded Multi-Operation Editing for E-Commerce Images

Computer Vision and Pattern Recognition 2026-07-01 v1

Abstract

Real-world e-commerce image editing often requires multiple, localized, and auditable operations rather than global restyling. This compositional nature poses a dual challenge: models must precisely apply all requested edits to the correct regions while preserving unmodified content, even under ambiguous instructions. Existing one-shot editors conflate intent resolution, spatial grounding, and synthesis into a single step, frequently resulting in partial execution failures, which is unacceptable for commercial scenarios. To address this, we introduce GMO-E2^2DIT, an agentic editing framework that couples a Vision-Language Model (VLM) with a mask-conditioned image editor to tackle structured multi-turn task completion. Given an underspecified instruction, the VLM agent constructs a region-grounded edit agenda, effectively decoupling cognitive reasoning from generative rendering. The framework then executes sub-programs via operation-aware masks and references, utilizing a reflection-driven loop to inspect intermediate results and determine the subsequent state. This iterative mechanism reliably preserves safe partial progress, retries unfinished operations, and recovers from errors. Furthermore, we develop a unified data pipeline providing aligned supervision for planning, execution, and reflection, alongside EComEditBench, a comprehensive benchmark for instruction-driven evaluation. Extensive experiments demonstrate that GMO-E2^2DIT achieves competitive performance compared to strong closed-source models, yielding superior instruction accuracy and edit fidelity over existing baselines.

Cite

@article{arxiv.2607.00920,
  title  = {GMO-E$^2$DIT: Grounded Multi-Operation Editing for E-Commerce Images},
  author = {Zipeng Guo and Xiaoan Liu and Lichen Ma and Cheng Wang and Yu He and Xiaolong Fu and Jingling Fu and Xinyuan Shan and Shaojie Guo and Luohang Liu and Junshi Huang and Yan Li},
  journal= {arXiv preprint arXiv:2607.00920},
  year   = {2026}
}