English
Related papers

Related papers: WorldJen: An End-to-End Multi-Dimensional Benchmar…

200 papers

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

Recent advances in video generation have been driven by diffusion models and autoregressive frameworks, yet critical challenges persist in harmonizing prompt adherence, visual quality, motion dynamics, and duration: compromises in motion…

Despite rapid advancements in video generation models, aligning their outputs with complex user intent remains challenging. Existing test-time optimization methods are typically either computationally expensive or require white-box access…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yiwen Song , Tomas Pfister , Yale Song

Generative diffusion models are developing rapidly and attracting increasing attention due to their wide range of applications. Image-to-Video (I2V) generation has become a major focus in the field of video synthesis. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Ailing Zhang , Lina Lei , Dehong Kong , Zhixin Wang , Jiaqi Xu , Fenglong Song , Chun-Le Guo , Chang Liu , Fan Li , Jie Chen

Recent advances in video generation have enabled the synthesis of videos with strong temporal consistency and impressive visual quality, marking a crucial step toward vision foundation models. To evaluate these video generation models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Xuming He , Zehao Fan , Hengjia Li , Fan Zhuo , Hankun Xu , Senlin Cheng , Di Weng , Haifeng Liu , Can Ye , Boxi Wu

Large Vision Language Models (VLMs) effectively bridge the modality gap through extensive pretraining, acquiring sophisticated visual representations aligned with language. However, it remains underexplored whether these representations,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jiahao Guo , Sinan Du , Jingfeng Yao , Wenyu Liu , Bo Li , Haoxiang Cao , Kun Gai , Chun Yuan , Kai Wu , Xinggang Wang

While text-to-visual models now produce photo-realistic images and videos, they struggle with compositional text prompts involving attributes, relationships, and higher-order reasoning such as logic and comparison. In this work, we conduct…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Baiqi Li , Zhiqiu Lin , Deepak Pathak , Jiayao Li , Yixin Fei , Kewen Wu , Tiffany Ling , Xide Xia , Pengchuan Zhang , Graham Neubig , Deva Ramanan

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Commercial video generation systems such as Seedance2.0 and Veo3.1 have rapidly improved, strengthening the view that video generators may be evolving into "world simulators." Yet the community still lacks a benchmark that directly tests…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Keming Wu , Yijing Cui , Wenhan Xue , Qijie Wang , Xuan Luo , Zhiyuan Feng , Zuhao Yang , Sudong Wang , Sicong Jiang , Haowei Zhu , Zihan Wang , Ping Nie , Wenhu Chen , Bin Wang

Video generation models (VGMs) are rapidly entering classrooms, yet existing benchmarks evaluate only perceptual quality, intrinsic faithfulness, generic safety, or video as a reasoning medium, and none assesses whether the outputs are…

Witnessed by the recent advancements on leveraging LLM for coding and multimodal understanding, we present WebGen-V, a new benchmark and framework for instruction-to-HTML generation that enhances both data quality and evaluation…

Artificial Intelligence · Computer Science 2025-10-20 Kuang-Da Wang , Zhao Wang , Yotaro Shimose , Wei-Yao Wang , Shingo Takamatsu

Scaling generative inverse and forward rendering to real-world scenarios is bottlenecked by the limited realism and temporal coherence of existing synthetic datasets. To bridge this persistent domain gap, we introduce a large-scale, dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Zheng-Hui Huang , Zhixiang Wang , Jiaming Tan , Ruihan Yu , Yidan Zhang , Bo Zheng , Yu-Lun Liu , Yung-Yu Chuang , Kaipeng Zhang

Multi-modal Large Language Models (MLLMs) have introduced a novel dimension to document understanding, i.e., they endow large language models with visual comprehension capabilities; however, how to design a suitable image-text pre-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zining Wang , Tongkun Guan , Pei Fu , Chen Duan , Qianyi Jiang , Zhentao Guo , Shan Guo , Junfeng Luo , Wei Shen , Xiaokang Yang

Recent video multimodal large language models achieve impressive results across various benchmarks. However, current evaluations suffer from two critical limitations: (1) inflated scores can mask deficiencies in fine-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahao Meng , Tan Yue , Qi Xu , Haochen Wang , Zhongwei Ren , Weisong Liu , Yuhao Wang , Renrui Zhang , Yunhai Tong , Haodong Duan

Reward models play an essential role in training vision-language models (VLMs) by assessing output quality to enable aligning with human preferences. Despite their importance, the research community lacks comprehensive open benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Michihiro Yasunaga , Luke Zettlemoyer , Marjan Ghazvininejad

The advent of large vision-language models (LVLMs) has spurred research into their applications in multi-modal contexts, particularly in video understanding. Traditional VideoQA benchmarks, despite providing quantitative metrics, often fail…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Xinyu Fang , Kangrui Mao , Haodong Duan , Xiangyu Zhao , Yining Li , Dahua Lin , Kai Chen

Recent Vision-Language Models (VLMs) have made remarkable progress in multimodal understanding tasks, yet their evaluation on long video understanding remains unreliable. Due to limited frame inputs, key frames necessary for answering the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xueqing Yu , Bohan Li , Yan Li , Zhenheng Yang

Today's driving world models can generate remarkably realistic dash-cam videos, yet no single model excels universally. Some generate photorealistic textures but violate basic physics; others maintain geometric consistency but fail when…

The ability to distinguish subtle differences between visually similar images is essential for diverse domains such as industrial anomaly detection, medical imaging, and aerial surveillance. While comparative reasoning benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minkyu Kim , Sangheon Lee , Dongmin Park

Visual Question-Answering (VQA) has become key to user experience, particularly after improved generalization capabilities of Vision-Language Models (VLMs). But evaluating VLMs for an application requirement using a standardized framework…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Neelabh Sinha , Vinija Jain , Aman Chadha