English
Related papers

Related papers: TiViBench: Benchmarking Think-in-Video Reasoning f…

200 papers

Despite rapid advances in vision-language models (VLMs), current benchmarks for multimodal reasoning fall short in three key dimensions. First, they overwhelmingly rely on static images, failing to capture the temporal complexity of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zikui Cai , Andrew Wang , Anirudh Satheesh , Ankit Nakhawa , Hyunwoo Jae , Keenan Powell , Minghui Liu , Neel Jay , Sungbin Oh , Xiyao Wang , Yongyuan Liang , Tom Goldstein , Furong Huang

Recent advances in text-to-video generation have produced increasingly realistic and diverse content, yet evaluating such videos remains a fundamental challenge due to their multi-faceted nature encompassing visual quality, semantic…

Inspired by DeepSeek-R1's success in eliciting reasoning abilities through rule-based reinforcement learning (RL), we introduce Video-R1 as the first attempt to systematically explore the R1 paradigm for incentivizing video reasoning within…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Kaituo Feng , Kaixiong Gong , Bohao Li , Zonghao Guo , Yibing Wang , Tianshuo Peng , Junfei Wu , Xiaoying Zhang , Benyou Wang , Xiangyu Yue

Visual Chain-of-Thought (VCoT) has emerged as a promising paradigm for enhancing multimodal reasoning by integrating visual perception into intermediate reasoning steps. However, existing VCoT approaches are largely confined to static…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Junhua Liu , Zhangcheng Wang , Zhike Han , Ningli Wang , Guotao Liang , Kun Kuang

Large language models have demonstrated impressive performance when integrated with vision models even enabling video understanding. However, evaluating video models presents its own unique challenges, for which several benchmarks have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Daniel Cores , Michael Dorkenwald , Manuel Mucientes , Cees G. M. Snoek , Yuki M. Asano

Vision-Language Models (VLMs) have demonstrated impressive world knowledge across a wide range of tasks, making them promising candidates for embodied reasoning applications. However, existing benchmarks primarily evaluate the embodied…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Haotian Xue , Yunhao Ge , Yu Zeng , Zhaoshuo Li , Ming-Yu Liu , Yongxin Chen , Jiaojiao Fan

Despite recent progress on the short-video Text-Visual Question Answering (ViteVQA) task - largely driven by benchmarks such as M4-ViteVQA - existing datasets still suffer from limited video duration and narrow evaluation scopes, making it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yangyang Zhong , Ji Qi , Yuan Yao , Pengxin Luo , Yunfeng Yan , Donglian Qi , Zhiyuan Liu , Tat-Seng Chua

Video generation assessment is essential for ensuring that generative models produce visually realistic, high-quality videos while aligning with human expectations. Current video generation benchmarks fall into two main categories:…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Hui Han , Siyuan Li , Jiaqi Chen , Yiwen Yuan , Yuling Wu , Chak Tou Leong , Hanwen Du , Junchen Fu , Youhua Li , Jie Zhang , Chi Zhang , Li-jia Li , Yongxin Ni

Recently, improving the reasoning ability of large multimodal models (LMMs) through reinforcement learning has made great progress. However, most existing works are based on highly reasoning-intensive datasets such as mathematics and code,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Xingjian Zhang , Siwei Wen , Wenjun Wu , Lei Huang

Video understanding plays a vital role in bridging low-level visual signals with high-level cognitive reasoning, and is fundamental to applications such as autonomous driving, embodied AI, and the broader pursuit of AGI. The rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yongheng Zhang , Xu Liu , Ruihan Tao , Qiguang Chen , Hao Fei , Wanxiang Che , Libo Qin

Recent multimodal large language models (MLLMs) show strong capabilities in visual-language reasoning, yet their performance on ultra-high-resolution imagery remains largely unexplored. Existing visual question answering (VQA) benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Siqi Li , Xinyu Cai , Jianbiao Mei , Nianchen Deng , Pinlong Cai , Licheng Wen , Yufan Shen , Xuemeng Yang , Botian Shi , Yong Liu

Multimodal Large Language Models (MLLMs) are increasingly applied in real-world scenarios where user-provided images are often imperfect, requiring active image manipulations such as cropping, editing, or enhancement to uncover salient…

The advancement of Large Vision Language Models (LVLMs) has significantly improved multimodal understanding, yet challenges remain in video reasoning tasks due to the scarcity of high-quality, large-scale datasets. Existing video…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Songhao Han , Wei Huang , Hairong Shi , Le Zhuo , Xiu Su , Shifeng Zhang , Xu Zhou , Xiaojuan Qi , Yue Liao , Si Liu

Text-to-Image (T2I) models and Unified Multimodal Models (UMMs) have achieved remarkable progress in visual generation. However, their reliance on a single-pass generation paradigm limits their ability to handle complex prompts requiring…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junjie Wang , Xinghua Lou , Jason Li , Ye Tian , Keyu Chen , Yulin Li , Bin Kang , Jacky Mai , Yanwei Li , Zhuotao Tian , Liqiang Nie

Thanks to recent advancements in scalable deep architectures and large-scale pretraining, text-to-video generation has achieved unprecedented capabilities in producing high-fidelity, instruction-following content across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

Structure reasoning is a fundamental capability of large language models (LLMs), enabling them to reason about structured commonsense and answer multi-hop questions. However, existing benchmarks for structure reasoning mainly focus on…

Computation and Language · Computer Science 2025-03-04 Zhuohang Jiang , Pangjing Wu , Ziran Liang , Peter Q. Chen , Xu Yuan , Ye Jia , Jiancheng Tu , Chen Li , Peter H. F. Ng , Qing Li

Recent video multimodal large language models achieve impressive results across various benchmarks. However, current evaluations suffer from two critical limitations: (1) inflated scores can mask deficiencies in fine-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahao Meng , Tan Yue , Qi Xu , Haochen Wang , Zhongwei Ren , Weisong Liu , Yuhao Wang , Renrui Zhang , Yunhai Tong , Haodong Duan

Extracting structured information from visual documents (Visual Information Extraction, VIE) is a cornerstone of business automation. While recent Multimodal Large Language Models (MLLMs) have shown promising capabilities, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yandi Wang , Libin Zhan , Ziwei Huang , Tiancheng Luo , Yuxuan Jiang , Wang Dong , Leilei Gan , Jun Chen

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao