English

Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement

Computer Vision and Pattern Recognition 2025-11-26 v1

Abstract

Recent progress in video generation has led to impressive visual quality, yet current models still struggle to produce results that align with real-world physical principles. To this end, we propose an iterative self-refinement framework that leverages large language models and vision-language models to provide physics-aware guidance for video generation. Specifically, we introduce a multimodal chain-of-thought (MM-CoT) process that refines prompts based on feedback from physical inconsistencies, progressively enhancing generation quality. This method is training-free and plug-and-play, making it readily applicable to a wide range of video generation models. Experiments on the PhyIQ benchmark show that our method improves the Physics-IQ score from 56.31 to 62.38. We hope this work serves as a preliminary exploration of physics-consistent video generation and may offer insights for future research.

Keywords

Cite

@article{arxiv.2511.20280,
  title  = {Bootstrapping Physics-Grounded Video Generation through VLM-Guided Iterative Self-Refinement},
  author = {Yang Liu and Xilin Zhao and Peisong Wen and Siran Dai and Qingming Huang},
  journal= {arXiv preprint arXiv:2511.20280},
  year   = {2025}
}

Comments

ICCV 2025 Physics-IQ Challenge Third Place Solution

R2 v1 2026-07-01T07:54:11.355Z