English

KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models

Robotics 2025-09-26 v1 Computer Vision and Pattern Recognition

Abstract

Robotic world models are a promising paradigm for forecasting future environment states, yet their inference speed and the physical plausibility of generated trajectories remain critical bottlenecks, limiting their real-world applications. This stems from the redundancy of the prevailing frame-to-frame generation approach, where the model conducts costly computation on similar frames, as well as neglecting the semantic importance of key transitions. To address this inefficiency, we propose KeyWorld, a framework that improves text-conditioned robotic world models by concentrating transformers computation on a few semantic key frames while employing a lightweight convolutional model to fill the intermediate frames. Specifically, KeyWorld first identifies significant transitions by iteratively simplifying the robot's motion trajectories, obtaining the ground truth key frames. Then, a DiT model is trained to reason and generate these physically meaningful key frames from textual task descriptions. Finally, a lightweight interpolator efficiently reconstructs the full video by inpainting all intermediate frames. Evaluations on the LIBERO benchmark demonstrate that KeyWorld achieves a 5.68×\times acceleration compared to the frame-to-frame generation baseline, and focusing on the motion-aware key frames further contributes to the physical validity of the generated videos, especially on complex tasks. Our approach highlights a practical path toward deploying world models in real-time robotic control and other domains requiring both efficient and effective world models. Code is released at https://anonymous.4open.science/r/Keyworld-E43D.

Keywords

Cite

@article{arxiv.2509.21027,
  title  = {KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models},
  author = {Sibo Li and Qianyue Hao and Yu Shang and Yong Li},
  journal= {arXiv preprint arXiv:2509.21027},
  year   = {2025}
}
R2 v1 2026-07-01T05:55:54.093Z