English
Related papers

Related papers: TOMATO: Assessing Visual Temporal Reasoning Capabi…

200 papers

As large language models (LLMs) continue to advance, there is increasing interest in their ability to infer human mental states and demonstrate a human-like Theory of Mind (ToM). Most existing ToM evaluations, however, are centered on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Siqi Liu , Xinyang Li , Bochao Zou , Junbao Zhuo , Huimin Ma , Jiansheng Chen

Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models. Existing methods either compress video tokens to reduce temporal resolution, or treat videos as…

Multimodal Large Language Models have achieved strong performance in single-video understanding, yet their ability to reason across multiple videos remains limited. Existing approaches typically concatenate multiple videos into a single…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Zhang , Liqiang Jing , Jia Li , Yapeng Tian , Xinya Du , Yunhui Guo , Vibhav Gogate

Compositional visual reasoning has emerged as a key research frontier in multimodal AI, aiming to endow machines with the human-like ability to decompose visual scenes, ground intermediate concepts, and perform multi-step logical inference.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Fucai Ke , Joy Hsu , Zhixi Cai , Zixian Ma , Xin Zheng , Xindi Wu , Sukai Huang , Weiqing Wang , Pari Delir Haghighi , Gholamreza Haffari , Ranjay Krishna , Jiajun Wu , Hamid Rezatofighi

Long video understanding is essential for human-like intelligence, enabling coherent perception and reasoning over extended temporal contexts. While the emerging thinking-with-frames paradigm, which alternates between global temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Pengfei Hu , Meng Cao , Yingyao Wang , Yi Wang , Jiahua Dong , Jun Song , Yu Cheng , Bo Zheng , Xiaodan Liang

Reasoning is central to purposeful action, yet most robotic foundation models map perception and instructions directly to control, which limits adaptability, generalization, and semantic grounding. We introduce Action Reasoning Models…

Understanding temporal information and how the visual world changes over time is a fundamental ability of intelligent systems. In video understanding, temporal information is at the core of many current challenges, including compression,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Laura Sevilla-Lara , Shengxin Zha , Zhicheng Yan , Vedanuj Goswami , Matt Feiszli , Lorenzo Torresani

Large Multimodal Models (LMMs) have achieved strong performance across a range of vision and language tasks. However, their spatial reasoning capabilities are under-investigated. In this paper, we construct a novel VQA dataset, Spatial-MM,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Fatemeh Shiri , Xiao-Yu Guo , Mona Golestan Far , Xin Yu , Gholamreza Haffari , Yuan-Fang Li

Visual mathematical reasoning, as a fundamental visual reasoning ability, has received widespread attention from the Large Multimodal Models (LMMs) community. Existing benchmarks, such as MathVista and MathVerse, focus more on the…

Vision-Language Models (VLMs) have achieved substantial progress across a wide range of understanding and reasoning tasks, driven by large-scale image-text training aimed at multimodal fusion. Ideally, replacing a textual question with its…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Feng Han , Zhixiong Zhang , Zheming Liang , Yibin Wang , Jiaqi Wang

Large multimodal models (LMMs) have demonstrated significant potential as generalists in vision-language (VL) tasks. However, adoption of LMMs in real-world tasks is hindered by their poor performance in tasks that require a combination of…

Computation and Language · Computer Science 2025-12-15 Zhoutong Ye , Mingze Sun , Huan-ang Gao , Xutong Wang , Xiangyang Wang , Yu Mei , Chang Liu , Qinwei Li , Chengwen Zhang , Qinghuan Lan , Chun Yu , Yuanchun Shi

Large Language Models (LLMs) and Large Multimodal Models (LMMs) exhibit impressive problem-solving skills in many tasks and domains, but their ability in mathematical reasoning in visual contexts has not been systematically studied. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Pan Lu , Hritik Bansal , Tony Xia , Jiacheng Liu , Chunyuan Li , Hannaneh Hajishirzi , Hao Cheng , Kai-Wei Chang , Michel Galley , Jianfeng Gao

Rapid progress in video models has largely focused on visual quality, leaving their reasoning capabilities underexplored. Video reasoning grounds intelligence in spatiotemporally consistent visual environments that go beyond what text can…

Reasoning Video Object Segmentation (ReasonVOS) is a challenging task that requires stable object segmentation across video sequences using implicit and complex textual inputs. Previous methods fine-tune Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhengtong Zhu , Jiaqing Fan , Zhixuan Liu , Fanzhang Li

Multimodal Large Language Models (MLLMs) have achieved significant advances in integrating visual and linguistic information, yet their ability to reason about complex and real-world scenarios remains limited. The existing benchmarks are…

Despite rapid progress, multimodal reasoning still lacks a systematic approach to synthesize large-scale vision-centric datasets beyond visual math. We introduce a framework able to synthesize vision-centric problems spanning diverse levels…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 David Acuna , Chao-Han Huck Yang , Yuntian Deng , Jaehun Jung , Ximing Lu , Prithviraj Ammanabrolu , Hyunwoo Kim , Yuan-Hong Liao , Yejin Choi

Large language models have demonstrated impressive performance when integrated with vision models even enabling video understanding. However, evaluating video models presents its own unique challenges, for which several benchmarks have been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Daniel Cores , Michael Dorkenwald , Manuel Mucientes , Cees G. M. Snoek , Yuki M. Asano

Recent advances in Vision Language Models (VLMs) have driven significant progress in visual reasoning. However, open-source VLMs still lag behind proprietary systems, largely due to the lack of high-quality reasoning data. Existing datasets…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Honglin Lin , Zheng Liu , Yun Zhu , Chonghan Qin , Juekai Lin , Xiaoran Shang , Conghui He , Wentao Zhang , Lijun Wu

Many video reasoning tasks require tracking motion, temporal order, and evolving visual states across frames. Existing methods built on large vision-language models (LVLMs) often address this challenge by externalizing reasoning through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yiming Liang , Yixiao Chen , Yiyang Zhou , Yixuan Wang , Shoubin Yu , Andong Deng , Fuxiao Liu , Qin Zhang , Chen Chen , Mohit Bansal , Huaxiu Yao

While Multimodal Large Language Models (MLLMs) have become adept at recognizing objects, they often lack the intuitive, human-like understanding of the world's underlying physical and social principles. This high-level vision-grounded…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Tianxiang Jiang , Sheng Xia , Yicheng Xu , Linquan Wu , Xiangyu Zeng , Limin Wang , Yu Qiao , Yi Wang