English
Related papers

Related papers: PhyGround: Benchmarking Physical Reasoning in Gene…

200 papers

Video generation has achieved remarkable progress, with generated videos increasingly resembling real ones. However, the rapid advance in generation has outpaced the development of adequate evaluation metrics. Currently, the assessment of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Nabyl Quignon , Baptiste Chopin , Yaohui Wang , Antitza Dantcheva

Multimodal Large Language Models (MLLMs) have made rapid progress in single-video understanding, yet their ability to reason across multiple independent video streams remains poorly understood. Existing multi-video benchmarks rely largely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Sara Ghazanfari , Siddharth Garg , Prashanth Krishnamurthy , Farshad Khorrami

While Chain-of-Thought (CoT) prompting enables sophisticated symbolic reasoning in LLMs, it remains confined to discrete text and cannot simulate the continuous, physics-governed dynamics of the real world. Recent video generation models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Xinxin Liu , Zhaopan Xu , Ming Li , Kai Wang , Yong Jae Lee , Yuzhang Shang

Recent advances in video generation models have sparked interest in world models capable of simulating realistic environments. While navigation has been well-explored, physically meaningful interactions that mimic real-world forces remain…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Nate Gillman , Charles Herrmann , Michael Freeman , Daksh Aggarwal , Evan Luo , Deqing Sun , Chen Sun

The rapid advancement of large multimodal models (LMMs) has led to the rapid expansion of artificial intelligence generated videos (AIGVs), which highlights the pressing need for effective video quality assessment (VQA) models designed…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiarui Wang , Huiyu Duan , Guangtao Zhai , Juntong Wang , Xiongkuo Min

While recent video generation models have achieved significant visual fidelity, they often suffer from the lack of explicit physical controllability and plausibility. To address this, some recent studies attempted to guide the video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Haoze Zhang , Tianyu Huang , Zichen Wan , Xiaowei Jin , Hongzhi Zhang , Hui Li , Wangmeng Zuo

Humans detect real-world object anomalies by perceiving, interacting, and reasoning based on object-conditioned physical knowledge. The long-term goal of Industrial Anomaly Detection (IAD) is to enable machines to autonomously replicate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wenqiao Li , Yao Gu , Xintao Chen , Xiaohao Xu , Ming Hu , Xiaonan Huang , Yingna Wu

Recent advances in multi-modal generative models have driven substantial improvements in image editing. However, current generative models still struggle with handling diverse and complex image editing tasks that require implicit reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Feng Han , Yibin Wang , Chenglin Li , Zheming Liang , Dianyi Wang , Yang Jiao , Zhipeng Wei , Chao Gong , Cheng Jin , Jingjing Chen , Jiaqi Wang

Video reasoning models are a core component of egocentric and embodied agents. However, standard benchmarks for assessing models provide only evaluation of the output (e.g. the answer to a question), without evaluation of intermediate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Arsha Nagrani , Jasper Uijilings , Shyamal Buch , Tobias Weyand , Sudheendra Vijayanarasimhan , Bo Hu , Ramin Mehran , David A Ross , Cordelia Schmid

Despite significant advances in video generation, synthesizing physically plausible human actions remains a persistent challenge, particularly in modeling fine-grained semantics and complex temporal dynamics. For instance, generating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Dian Shao , Mingfei Shi , Shengda Xu , Haodong Chen , Yongle Huang , Binglu Wang

Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Ziqi Huang , Yinan He , Jiashuo Yu , Fan Zhang , Chenyang Si , Yuming Jiang , Yuanhan Zhang , Tianxing Wu , Qingyang Jin , Nattapol Chanpaisit , Yaohui Wang , Xinyuan Chen , Limin Wang , Dahua Lin , Yu Qiao , Ziwei Liu

High-quality benchmarks are crucial for driving progress in machine learning research. However, despite the growing interest in video generation, there is no comprehensive dataset to evaluate human generation. Humans can perform a wide…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Emanuele Bugliarello , Anurag Arnab , Roni Paiss , Pieter-Jan Kindermans , Cordelia Schmid

Generative world models hold significant potential for simulating interactions with visuomotor policies in varied environments. Frontier video models can enable generation of realistic observations and environment interactions in a scalable…

Despite impressive visual fidelity, modern video generative models frequently produce sequences that violate intuitive physical laws, such as objects floating, teleporting, or morphing in ways that defy causality. While humans can easily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Saman Motamed , Minghao Chen , Luc Van Gool , Iro Laina

Text-to-image (T2I) models today are capable of producing photorealistic, instruction-following images, yet they still frequently fail on prompts that require implicit world knowledge. Existing evaluation protocols either emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tianyang Han , Junhao Su , Junjie Hu , Peizhen Yang , Hengyu Shi , Junfeng Luo , Jialin Gao

The advent of multi-modal large language models (MLLMs) has greatly advanced research on video fake news detection (VFND) tasks. Existing benchmarks typically focus on the detection accuracy, while failing to provide fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Cui Yakun , Peng Qi , Fushuo Huo , Hang Du , Weijie Shi , Juntao Dai , Zhenghao Zhu , Sirui Han , Yike Guo

Driven by the growing capacity and training scale, Text-to-Video (T2V) generation models have recently achieved substantial progress in video quality, length, and instruction-following capability. However, whether these models can…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zeqing Wang , Keze Wang , Lei Zhang

Understanding fine-grained temporal dynamics is crucial for multimodal video comprehension and generation. Due to the lack of fine-grained temporal annotations, existing video benchmarks mostly resemble static image benchmarks and are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Mu Cai , Reuben Tan , Jianrui Zhang , Bocheng Zou , Kai Zhang , Feng Yao , Fangrui Zhu , Jing Gu , Yiwu Zhong , Yuzhang Shang , Yao Dou , Jaden Park , Jianfeng Gao , Yong Jae Lee , Jianwei Yang

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in general video understanding, yet they often struggle with the fine-grained comprehension crucial for real-world applications requiring nuanced interpretation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Gueter Josmy Faure , Min-Hung Chen , Jia-Fong Yeh , Hung-Ting Su , Winston H. Hsu

State-of-the-art text-to-video generation models such as Sora 2 and Veo 3 can now produce high-fidelity videos with synchronized audio directly from a textual prompt, marking a new milestone in multi-modal generation. However, evaluating…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Susan Liang , Chao Huang , Filippos Bellos , Yolo Yunlong Tang , Qianxiang Shen , Jing Bi , Luchuan Song , Zeliang Zhang , Jason Corso , Chenliang Xu