English
Related papers

Related papers: Benchmarking Scientific Understanding and Reasonin…

200 papers

Video generation has many unique challenges beyond those of image generation. The temporal dimension introduces extensive possible variations across frames, over which consistency and continuity may be violated. In this study, we move…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Weixi Feng , Jiachen Li , Michael Saxon , Tsu-jui Fu , Wenhu Chen , William Yang Wang

Real-world video editing demands not only expert knowledge of cinematic techniques but also multimodal reasoning to select, align, and combine footage into coherent narratives. While recent Large Multimodal Models (LMMs) have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Andong Deng , Dawei Du , Zhenfang Chen , Wen Zhong , Fan Chen , Guang Chen , Chia-Wen Kuo , Longyin Wen , Chen Chen , Sijie Zhu

Large multimodal models (LMMs) are processing increasingly longer and richer inputs. Albeit the progress, few public benchmark is available to measure such development. To mitigate this gap, we introduce LongVideoBench, a question-answering…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Haoning Wu , Dongxu Li , Bei Chen , Junnan Li

The rapid advancement of AIGC-based video generation has underscored the critical need for comprehensive evaluation frameworks that go beyond traditional generation quality metrics to encompass aesthetic appeal. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Longteng Jiang , DanDan Zheng , Qianqian Qiao , Heng Huang , Huaye Wang , Yihang Bo , Bao Peng , Jingdong Chen , Jun Zhou , Xin Jin

Multi-modal large language models (MLLMs) have demonstrated promising capabilities across various tasks by integrating textual and visual information to achieve visual understanding in complex scenarios. Despite the availability of several…

Artificial Intelligence · Computer Science 2024-12-03 Zhihuan Jiang , Zhen Yang , Jinhao Chen , Zhengxiao Du , Weihan Wang , Bin Xu , Jie Tang

Despite progress in video large language models (Video-LLMs), research on instructional video understanding, crucial for enhancing access to instructional content, remains insufficient. To address this, we introduce InstructionBench, an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Haiwan Wei , Yitian Yuan , Xiaohan Lan , Wei Ke , Lin Ma

Video foundation models aim to integrate video understanding, generation, editing, and instruction following within a single framework, making them a central direction for next-generation multimodal systems. However, existing evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jianhui Wei , Xiaotian Zhang , Yichen Li , Yuan Wang , Yan Zhang , Ziyi Chen , Zhihang Tang , Wei Xu , Zuozhu Liu

Recent advances in large language models (LLMs) have improved reasoning in text and image domains, yet achieving robust video reasoning remains a significant challenge. Existing video benchmarks mainly assess shallow understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuchen Li , Xuzhao Li , Shiyu Hu , Kaiqi Huang , Wentao Zhang

Cinematography is a cornerstone of film production and appreciation, shaping mood, emotion, and narrative through visual elements such as camera movement, shot composition, and lighting. Despite recent progress in multimodal large language…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xinran Wang , Songyu Xu , Xiangxuan Shan , Yuxuan Zhang , Muxi Diao , Xueyan Duan , Yanhua Huang , Kongming Liang , Zhanyu Ma

With AI-generated videos increasingly indistinguishable from reality, current benchmarks primarily focus on broad semantic alignment and basic physical consistency, offering limited discriminative power for evaluating them. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Jiaqi Wang , Weijia Wu , Yi Zhan , Rui Zhao , Ming Hu , James Cheng , Wei Liu , Philip Torr , Kevin Qinghong Lin

Despite the significant advancements of Large Vision-Language Models (LVLMs) on established benchmarks, there remains a notable gap in suitable evaluation regarding their applicability in the emerging domain of long-context streaming video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenyu Yang , Yuhang Hu , Zemin Du , Dizhan Xue , Shengsheng Qian , Jiahong Wu , Fan Yang , Weiming Dong , Changsheng Xu

Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning, but their grasp of the underlying physics remains underexplored. Existing…

Video generation has advanced rapidly, with recent methods producing increasingly convincing animated results. However, existing benchmarks-largely designed for realistic videos-struggle to evaluate animation-style generation with its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Leyi Wu , Pengjun Fang , Kai Sun , Yazhou Xing , Yinwei Wu , Songsong Wang , Ziqi Huang , Dan Zhou , Yingqing He , Ying-Cong Chen , Qifeng Chen

Recent video multimodal large language models achieve impressive results across various benchmarks. However, current evaluations suffer from two critical limitations: (1) inflated scores can mask deficiencies in fine-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahao Meng , Tan Yue , Qi Xu , Haochen Wang , Zhongwei Ren , Weisong Liu , Yuhao Wang , Renrui Zhang , Yunhai Tong , Haodong Duan

Video generative models show emerging reasoning behaviors. It is essential to ensure that generated events remain causally consistent across frames for reliable deployment, a property we define as reasoning coherence. To bridge the gap in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yu Qi , Xinyi Xu , Ziyu Guo , Siyuan Ma , Renrui Zhang , Xinyan Chen , Ruichuan An , Ruofan Xing , Jiayi Zhang , Haojie Huang , Pheng-Ann Heng , Jonathan Tremblay , Lawson L. S. Wong

Multimodal Large Language Models (MLLMs) have made rapid progress in perception, understanding, and reasoning, yet existing benchmarks fall short in evaluating these abilities under continuous and dynamic real-world video streams. Such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Shuhang Xun , Sicheng Tao , Jungang Li , Yibo Shi , Zhixin Lin , Zhanhui Zhu , Yibo Yan , Hanqian Li , Linghao Zhang , Shikang Wang , Yixin Liu , Hanbo Zhang , Ying Ma , Xuming Hu

With the rapid development of Multi-modal Large Language Models (MLLMs), a number of diagnostic benchmarks have recently emerged to evaluate the comprehension capabilities of these models. However, most benchmarks predominantly assess…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Kunchang Li , Yali Wang , Yinan He , Yizhuo Li , Yi Wang , Yi Liu , Zun Wang , Jilan Xu , Guo Chen , Ping Luo , Limin Wang , Yu Qiao

Recent advances in image and video generation raise hopes that these models possess world modeling capabilities, the ability to generate realistic, physically plausible videos. This could revolutionize applications in robotics, autonomous…

Multimodal reward models (MRMs) play a crucial role in the training, inference, and evaluation of Large Vision Language Models (LVLMs) by assessing response quality. However, existing benchmarks for evaluating MRMs in the video domain…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhihong Zhang , Xiaojian Huang , Jin Xu , Zhuodong Luo , Xinzhi Wang , Jiansheng Wei , Xuejin Chen

Evaluating generative video models remains an open problem. Reference-based metrics such as Structural Similarity Index Measure (SSIM) and Peak Signal to Noise Ratio (PSNR) reward pixel fidelity over semantic correctness, while Frechet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Karthik Inbasekar , Guy Rom , Omer Shlomovits