English
Related papers

Related papers: Reasoning over Video: Evaluating How MLLMs Extract…

200 papers

Large Language Models (LLMs) often struggle with deductive judgment in syllogistic reasoning, systematically conflating semantic plausibility with formal validity a phenomenon known as content effect. This bias persists even when models…

Computation and Language · Computer Science 2026-02-03 Gabriele Maraia , Marco Valentino , Fabio Massimo Zanzotto , Leonardo Ranaldi

Video understanding represents the most challenging frontier in computer vision, requiring models to reason about complex spatiotemporal relationships, long-term dependencies, and multimodal evidence. The recent emergence of Video-Large…

Recent advancements in Large Language Models (LLMs) have led to the development of Video Large Multi-modal Models (Video-LMMs) that can handle a wide range of video understanding tasks. These models have the potential to be deployed in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Muhammad Uzair Khattak , Muhammad Ferjad Naeem , Jameel Hassan , Muzammal Naseer , Federico Tombari , Fahad Shahbaz Khan , Salman Khan

Current evaluation paradigms for large language models (LLMs) represent a critical blind spot in AI research--relying on opaque numerical metrics that conceal fundamental limitations in spatial reasoning while providing no intuitive…

Computation and Language · Computer Science 2025-11-05 Liuhao Lin , Ke Li , Zihan Xu , Yuchen Shi , Yulei Qin , Yan Zhang , Xing Sun , Rongrong Ji

Large language models (LLMs) have shown emerging potential in spatiotemporal reasoning, making them promising candidates for building urban agents that support diverse urban downstream applications. Despite these benefits, existing studies…

Artificial Intelligence · Computer Science 2025-05-26 Siqi Lai , Yansong Ning , Zirui Yuan , Zhixi Chen , Hao Liu

Recent progress in generative video models, such as Veo-3, has shown surprising zero-shot reasoning abilities, creating a growing need for systematic and reliable evaluation. We introduce V-ReasonBench, a benchmark designed to assess video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Yang Luo , Xuanlei Zhao , Baijiong Lin , Lingting Zhu , Liyao Tang , Yuqi Liu , Ying-Cong Chen , Shengju Qian , Xin Wang , Yang You

Short video platforms are evolving rapidly, making the identification of inappropriate content increasingly critical. Existing approaches typically train separate and small classification models for each type of issue, which requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zixuan Wang , Yu Sun , Hongwei Wang , Baoyu Jing , Xiang Shen , Xin Dong , Zhuolin Hao , Hongyu Xiong , Yang Song

Multimodal Large Language Models (MLLMs) have demonstrated significant advances in visual understanding tasks involving both images and videos. However, their capacity to comprehend human-centric video data remains underexplored, primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuxuan Cai , Jiangning Zhang , Zhenye Gan , Qingdong He , Xiaobin Hu , Junwei Zhu , Yabiao Wang , Chengjie Wang , Zhucun Xue , Chaoyou Fu , Xinwei He , Xiang Bai

Multimodal Large Language Models (MLLMs) have demonstrated impressive performance in general vision-language tasks. However, recent studies have exposed critical limitations in their spatial reasoning capabilities. This deficiency in…

Machine Learning · Computer Science 2025-06-04 Huanyu Zhang , Chengzu Li , Wenshan Wu , Shaoguang Mao , Yifan Zhang , Haochen Tian , Ivan Vulić , Zhang Zhang , Liang Wang , Tieniu Tan , Furu Wei

Reinforcement Learning with Verifiable Rewards (RLVR) has substantially advanced the video understanding capabilities of Multimodal Large Language Models (MLLMs). However, the rapid progress of MLLMs is outpacing the complexity of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Zefeng He , Xiaoye Qu , Yafu Li , Siyuan Huang , Daizong Liu , Yu Cheng

Large language models (LLMs) have revolutionized video-based computer vision applications, including action recognition, anomaly detection, and video summarization. Videos inherently pose unique challenges, combining spatial complexity with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xi Ding , Lei Wang

Recent progress in multimodal large language models has markedly enhanced the understanding of short videos (typically under one minute), and several evaluation datasets have emerged accordingly. However, these advancements fall short of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Weihan Wang , Zehai He , Wenyi Hong , Yean Cheng , Xiaohan Zhang , Ji Qi , Xiaotao Gu , Shiyu Huang , Bin Xu , Yuxiao Dong , Ming Ding , Jie Tang

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Recent advances in multimodal large language models (MLLMs) have significantly enhanced video understanding capabilities, opening new possibilities for practical applications. Yet current video benchmarks focus largely on indoor scenes or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Hao Wang , Eiki Murata , Lingfang Zhang , Ayako Sato , So Fukuda , Ziqi Yin , Wentao Hu , Keisuke Nakao , Yusuke Nakamura , Sebastian Zwirner , Yi-Chia Chen , Hiroyuki Otomo , Hiroki Ouchi , Daisuke Kawahara

Accurately estimating task progress is critical for embodied agents to plan and execute long-horizon, multi-step tasks. Despite promising advances, existing Vision-Language Models (VLMs) based methods primarily leverage their video…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yuelin Zhang , Sijie Cheng , Chen Li , Zongzhao Li , Yuxin Huang , Yang Liu , Wenbing Huang

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated strong semantic understanding capabilities, but struggles to perform precise spatio-temporal understanding. Existing spatio-temporal methods primarily focus on the…

Artificial Intelligence · Computer Science 2025-10-14 Wentao Wang , Heqing Zou , Tianze Luo , Rui Huang , Yutian Zhao , Zhuochen Wang , Hansheng Zhang , Chengwei Qin , Yan Wang , Lin Zhao , Huaijian Zhang

Spatio-temporal reasoning is essential in understanding real-world environments in various fields, eg, autonomous driving and sports analytics. Recent advances have improved the spatial reasoning ability of Vision-Language Models (VLMs) by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Dohwan Ko , Sihyeon Kim , Yumin Suh , Vijay Kumar B. G , Minseo Yoon , Manmohan Chandraker , Hyunwoo J. Kim

Achieving human-like reasoning in deep learning models for complex tasks in unknown environments remains a critical challenge in embodied intelligence. While advanced vision-language models (VLMs) excel in static scene understanding, their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Jinzhou Tang , Jusheng zhang , Sidi Liu , Waikit Xiu , Qinhan Lv , Xiying Li

Despite recent advancements in Multi-modal Large Language Models (MLLMs) on diverse understanding tasks, these models struggle to solve problems which require extensive multi-step reasoning. This is primarily due to the progressive dilution…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Byungwoo Jeon , Yoonwoo Jeong , Hyunseok Lee , Minsu Cho , Jinwoo Shin

Large Multimodal Models (LMMs) have achieved strong performance across a range of vision and language tasks. However, their spatial reasoning capabilities are under-investigated. In this paper, we construct a novel VQA dataset, Spatial-MM,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Fatemeh Shiri , Xiao-Yu Guo , Mona Golestan Far , Xin Yu , Gholamreza Haffari , Yuan-Fang Li
‹ Prev 1 4 5 6 7 8 10 Next ›