English
Related papers

Related papers: Towards World Simulator: Crafting Physical Commons…

200 papers

Video generation has advanced rapidly, improving evaluation methods, yet assessing video's motion remains a major challenge. Specifically, there are two key issues: 1) current motion metrics do not fully align with human perceptions; 2) the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Xinran Ling , Chen Zhu , Meiqi Wu , Hangyu Li , Xiaokun Feng , Cundian Yang , Aiming Hao , Jiashu Zhu , Jiahong Wu , Xiangxiang Chu

Large language models (LLMs) have rapidly advanced and are increasingly capable of tackling complex scientific problems, including those in physics. Despite this progress, current LLMs often fail to emulate the concise, principle-based…

Machine Learning · Computer Science 2025-06-02 Yinggan Xu , Yue Liu , Zhiqiang Gao , Changnan Peng , Di Luo

Video generation has advanced significantly, evolving from producing unrealistic outputs to generating videos that appear visually convincing and temporally coherent. To evaluate these video generative models, benchmarks such as VBench have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Dian Zheng , Ziqi Huang , Hongbo Liu , Kai Zou , Yinan He , Fan Zhang , Lulu Gu , Yuanhan Zhang , Jingwen He , Wei-Shi Zheng , Yu Qiao , Ziwei Liu

Humans develop an understanding of intuitive physics through active interaction with the world. This approach is in stark contrast to current video models, such as Sora, which rely on passive observation and therefore struggle with grasping…

We present a novel task and benchmark for evaluating the ability of text-to-image(T2I) generation models to produce images that align with commonsense in real life, which we call Commonsense-T2I. Given two adversarial text prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xingyu Fu , Muyu He , Yujie Lu , William Yang Wang , Dan Roth

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

Synthetic videos nowadays is widely used to complement data scarcity and diversity of real-world videos. Current synthetic datasets primarily replicate real-world scenarios, leaving impossible, counterfactual and anti-reality video concepts…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zechen Bai , Hai Ci , Mike Zheng Shou

Current video generation models produce high-quality aesthetic videos but often struggle to learn representations of real-world physics dynamics, resulting in artifacts such as unnatural object collisions, inconsistent gravity, and temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Siddarth Nilol Kundur Satish , Devesh Jaiswal , Hongyu Chen , Abhishek Bakshi

Physical principles are fundamental to realistic visual simulation, but remain a significant oversight in transformer-based video generation. This gap highlights a critical limitation in rendering rigid body motion, a core tenet of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Qiyuan Zhang , Biao Gong , Shuai Tan , Zheng Zhang , Yujun Shen , Xing Zhu , Yuyuan Li , Kelu Yao , Chunhua Shen , Changqing Zou

Text-to-video (T2V) generation models have made significant progress in creating visually appealing videos. However, they struggle with generating coherent sequential narratives that require logical progression through multiple events.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Zhengxu Tang , Zizheng Wang , Luning Wang , Zitao Shuai , Chenhao Zhang , Siyu Qian , Yirui Wu , Bohao Wang , Haosong Rao , Zhenyu Yang , Chenwei Wu

Video generation models have rapidly progressed, positioning themselves as video world models capable of supporting decision-making applications like robotics and autonomous driving. However, current benchmarks fail to rigorously evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dacheng Li , Yunhao Fang , Yukang Chen , Shuo Yang , Shiyi Cao , Justin Wong , Michael Luo , Xiaolong Wang , Hongxu Yin , Joseph E. Gonzalez , Ion Stoica , Song Han , Yao Lu

Exams are a fundamental test of expert-level intelligence and require integrated understanding, reasoning, and generation. Existing exam-style benchmarks mainly focus on understanding and reasoning tasks, and current generation benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhaokai Wang , Penghao Yin , Xiangyu Zhao , Changyao Tian , Yu Qiao , Wenhai Wang , Jifeng Dai , Gen Luo

Recent rapid advancements in text-to-video (T2V) generation, such as SoRA and Kling, have shown great potential for building world simulators. However, current T2V models struggle to grasp abstract physical principles and generate videos…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jing Wang , Ao Ma , Ke Cao , Jun Zheng , Zhanjie Zhang , Jiasong Feng , Shanyuan Liu , Yuhang Ma , Bo Cheng , Dawei Leng , Yuhui Yin , Xiaodan Liang

Despite remarkable progress toward general-purpose video models, a critical question remains unanswered: how far are these models from achieving true multimodal reasoning? Existing benchmarks fail to address this question rigorously, as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xiaotian Zhang , Jianhui Wei , Yuan Wang , Jie Tan , Yichen Li , Yan Zhang , Ziyi Chen , Daoan Zhang , Dezhi YU , Wei Xu , Songtao Jiang , Zuozhu Liu

Recent advances in video generation have opened new avenues for macroscopic simulation of complex dynamic systems, but their application to microscopic phenomena remains largely unexplored. Microscale simulation holds great promise for…

Artificial Intelligence · Computer Science 2026-03-03 Rongsheng Wang , Minghao Wu , Hongru Zhou , Zhihan Yu , Zhenyang Cai , Junying Chen , Benyou Wang

While generative video models have achieved remarkable visual fidelity, their capacity to internalize and reason over implicit world rules remains a critical yet under-explored frontier. To bridge this gap, we present RISE-Video, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mingxin Liu , Shuran Ma , Shibei Meng , Xiangyu Zhao , Zicheng Zhang , Shaofeng Zhang , Zhihang Zhong , Peixian Chen , Haoyu Cao , Xing Sun , Haodong Duan , Xue Yang

Querying generative AI models, e.g., large language models (LLMs), has become a prevalent method for information acquisition. However, existing query-answer datasets primarily focus on textual responses, making it challenging to address…

Artificial Intelligence · Computer Science 2025-06-03 Shuting Wang , Yunqi Liu , Zixin Yang , Ning Hu , Zhicheng Dou , Chenyan Xiong

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Large Vision-Language Models (LVLMs) have made significant strides in the field of video understanding in recent times. Nevertheless, existing video benchmarks predominantly rely on text prompts for evaluation, which often require complex…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yiming Zhao , Yu Zeng , Yukun Qi , YaoYang Liu , Xikun Bao , Lin Chen , Zehui Chen , Qing Miao , Chenxi Liu , Jie Zhao , Feng Zhao

The current state-of-the-art video generative models can produce commercial-grade videos with highly realistic details. However, they still struggle to coherently present multiple sequential events in the stories specified by the prompts,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yiping Wang , Xuehai He , Kuan Wang , Luyao Ma , Jianwei Yang , Shuohang Wang , Simon Shaolei Du , Yelong Shen