English
Related papers

Related papers: PRISM: A Benchmark for Programmatic Spatial-Tempor…

200 papers

Large Language Models (LLMs) have undergone rapid progress, largely attributed to reinforcement learning on complex reasoning tasks. In contrast, while spatial intelligence is fundamental for Vision-Language Models (VLMs) in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zijian Song , Xiaoxin Lin , Qiuming Huang , Sihan Qin , Guangrun Wang , Liang Lin

The rapid growth in submissions to machine learning venues has strained the scientific peer-review system and intensified interest in LLM-based automated peer reviewers. However, how good these systems are actually, especially compared to…

Despite rapid advances in video generative models, robust metrics for evaluating visual and temporal correctness of complex human actions remain elusive. Critically, existing pure-vision encoders and Multimodal Large Language Models (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xavier Thomas , Youngsun Lim , Ananya Srinivasan , Audrey Zheng , Deepti Ghadiyaram

Process-level Reward Models (PRMs) are crucial for complex reasoning and decision-making tasks, where each intermediate step plays an important role in the reasoning process. Since language models are prone to various types of errors during…

Computation and Language · Computer Science 2025-07-01 Mingyang Song , Zhaochen Su , Xiaoye Qu , Jiawei Zhou , Yu Cheng

We propose a Vision-Language Simulation Model (VLSM) that unifies visual and textual understanding to synthesize executable FlexScript from layout sketches and natural-language prompts, enabling cross-modal reasoning for industrial…

Artificial Intelligence · Computer Science 2026-01-14 YuChe Hsu , AnJui Wang , TsaiChing Ni , YuanFu Yang

Video generation assessment is essential for ensuring that generative models produce visually realistic, high-quality videos while aligning with human expectations. Current video generation benchmarks fall into two main categories:…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Hui Han , Siyuan Li , Jiaqi Chen , Yiwen Yuan , Yuling Wu , Chak Tou Leong , Hanwen Du , Junchen Fu , Youhua Li , Jie Zhang , Chi Zhang , Li-jia Li , Yongxin Ni

Vision Language Models (VLMs) achieve strong performance on many vision-language tasks but often struggle with spatial reasoning$\unicode{x2014}$a prerequisite for many applications. Empirically, we find that a dataset produced by a current…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Karim Elmaaroufi , Liheng Lai , Justin Svegliato , Yutong Bai , Sanjit A. Seshia , Matei Zaharia

Existing video-language pre-training methods primarily focus on instance-level alignment between video clips and captions via global contrastive learning but neglect rich fine-grained local information in both videos and text, which is of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuanhao Xiong , Long Zhao , Boqing Gong , Ming-Hsuan Yang , Florian Schroff , Ting Liu , Cho-Jui Hsieh , Liangzhe Yuan

Humans can imagine and manipulate visual images mentally, a capability known as spatial visualization. While many multi-modal benchmarks assess reasoning on visible visual information, the ability to infer unseen relationships through…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siting Wang , Minnan Pei , Luoyang Sun , Cheng Deng , Yuchen Li , Kun Shao , Zheng Tian , Haifeng Zhang , Jun Wang

Spatial reasoning is a core component of human cognition, enabling individuals to perceive, comprehend, and interact with the physical world. It relies on a nuanced understanding of spatial structures and inter-object relationships, serving…

Artificial Intelligence · Computer Science 2025-08-27 Zesen Lyu , Dandan Zhang , Wei Ye , Fangdi Li , Zhihang Jiang , Yao Yang

This work investigates a fundamental question: Do Video-Language Models (VidLMs) robustly account for video content, temporal sequence, and motion? Our investigation shows that, surprisingly, they often do not. We introduce REVEAL{}, a…

Recent breakthroughs in video generation have demonstrated an emerging capability termed Chain-of-Frames (CoF) reasoning, where models resolve complex tasks through the generation of continuous frames. While these models show promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yifan Li , Yukai Gu , Yingqian Min , Zikang Liu , Yifan Du , Kun Zhou , Min Yang , Wayne Xin Zhao , Minghui Qiu

Multimodal large language models (MLLMs) have advanced from image-level reasoning to pixel-level grounding, but extending these capabilities to videos remains challenging as models must achieve spatial precision and temporally consistent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Mohamad Alansari , Naufal Suryanto , Divya Velayudhan , Sajid Javed , Naoufel Werghi , Muzammal Naseer

Although many video prediction methods have obtained good performance in low-resolution (64$\sim$128) videos, predictive models for high-resolution (512$\sim$4K) videos have not been fully explored yet, which are more meaningful due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Zheng Chang , Xinfeng Zhang , Shanshe Wang , Siwei Ma , Wen Gao

This paper presents VideoLoom, a unified Video Large Language Model (Video LLM) for joint spatial-temporal understanding. To facilitate the development of fine-grained spatial and temporal localization capabilities, we curate LoomData-8.7k,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Jiapeng Shi , Junke Wang , Zuyao You , Bo He , Zuxuan Wu

Vision-Language Models (VLMs) have advanced rapidly in multimodal perception and language understanding, yet it remains unclear whether they can reliably ground language into spatially coherent, plausibly executable actions in 3D digital…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Niyati Rawal , Sushant Ravva , Shah Alam Abir , Saksham Jain , Aman Chadha , Vinija Jain , Suranjana Trivedy , Amitava Das

Recent video multimodal large language models achieve impressive results across various benchmarks. However, current evaluations suffer from two critical limitations: (1) inflated scores can mask deficiencies in fine-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Jiahao Meng , Tan Yue , Qi Xu , Haochen Wang , Zhongwei Ren , Weisong Liu , Yuhao Wang , Renrui Zhang , Yunhai Tong , Haodong Duan

We introduce Thinking with Spatial Code, a framework that transforms RGB video into explicit, temporally coherent 3D representations for physical-world visual question answering. We highlight the empirical finding that our proposed spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jieneng Chen , Wenxin Ma , Ruisheng Yuan , Yunzhi Zhang , Jiajun Wu , Alan Yuille

Existing video benchmarks often resemble image-based benchmarks, with question types like "What actions does the person perform throughout the video?" or "What color is the woman's dress in the video?" For these, models can often answer by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yiyang Zhou , Linjie Li , Shi Qiu , Zhengyuan Yang , Yuyang Zhao , Siwei Han , Yangfan He , Kangqi Li , Haonian Ji , Zihao Zhao , Haibo Tong , Lijuan Wang , Huaxiu Yao

While generative text-to-speech (TTS) models approach human-level quality, monolithic metrics fail to diagnose fine-grained acoustic artifacts or explain perceptual collapse. To address this, we propose TTS-PRISM, a multi-dimensional…

Computation and Language · Computer Science 2026-04-27 Xi Wang , Jie Wang , Xingchen Song , Baijun Song , Jingran Xie , Jiahe Shao , Zijian Lin , Di Wu , Meng Meng , Jian Luan , Zhiyong Wu