English

Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots

Computer Vision and Pattern Recognition 2026-02-17 v1 Artificial Intelligence Robotics

Abstract

Automated warehouses execute millions of stow operations, where robots place objects into storage bins. For these systems it is valuable to anticipate how a bin will look from the current observations and the planned stow behavior before real execution. We propose FOREST, a stow-intent-conditioned world model that represents bin states as item-aligned instance masks and uses a latent diffusion transformer to predict the post-stow configuration from the observed context. Our evaluation shows that FOREST substantially improves the geometric agreement between predicted and true post-stow layouts compared with heuristic baselines. We further evaluate the predicted post-stow layouts in two downstream tasks, in which replacing the real post-stow masks with FOREST predictions causes only modest performance loss in load-quality assessment and multi-stow reasoning, indicating that our model can provide useful foresight signals for warehouse planning.

Keywords

Cite

@article{arxiv.2602.13347,
  title  = {Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots},
  author = {Lijun Zhang and Nikhil Chacko and Petter Nilsson and Ruinian Xu and Shantanu Thakar and Bai Lou and Harpreet Sawhney and Zhebin Zhang and Mudit Agrawal and Bhavana Chandrashekhar and Aaron Parness},
  journal= {arXiv preprint arXiv:2602.13347},
  year   = {2026}
}

Comments

20 pages, 16 figures

R2 v1 2026-07-01T10:36:02.526Z