English
Related papers

Related papers: Q-GeoMem: Question-Guided Geometric Memory for Vid…

200 papers

Long-term memory is increasingly important for personalized AI agents, yet existing benchmarks and methods remain largely text-centric. Even when images are included, the user-specific information needed for later questions is typically…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Viet Nguyen , Thao Nguyen , Vishal M. Patel , Yuheng Li

Benchmarking spatial reasoning in multimodal large language models (MLLMs) has attracted growing interest in computer vision due to its importance for embodied AI and other agentic systems that require precise interaction with the physical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Zelin Xu , Yupu Zhang , Saugat Adhikari , Saiful Islam , Tingsong Xiao , Zibo Liu , Shigang Chen , Da Yan , Zhe Jiang

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sashuai Zhou , Qiang Zhou , Junpeng Ma , Yue Cao , Ruofan Hu , Ziang Zhang , Xiaoda Yang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Zhou Zhao

Recent neuro-symbolic geometry theorem provers have made significant progress on Euclidean problems by coupling neural guidance with symbolic verification. However, most existing systems operate almost exclusively in a symbolic space,…

Artificial Intelligence · Computer Science 2026-02-24 Minfeng Zhu , Zi Wang , Sizhe Ji , Zhengtong Du , Shengqiang Tai , Junming Ke , Xiao Deng , Zanlang Yin , Xiuqi Huang , Heyu Wang , Wei Chen

Large vision-language models (VLMs) show strong multimodal understanding but still struggle with 3D spatial reasoning, such as distance estimation, size comparison, and cross-view consistency. Existing 3D-aware methods either depend on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Ruosen Zhao , Zhikang Zhang , Jialei Xu , Jiahao Chang , Dong Chen , Lingyun Li , Weijian Sun , Zizhuang Wei

Video understanding aims to enable models to perceive, reason about, and interact with the dynamic visual world. In contrast to image understanding, video understanding inherently requires modeling temporal dynamics and evolving visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhaochong An , Zirui Li , Mingqiao Ye , Feng Qiao , Jiaang Li , Zongwei Wu , Vishal Thengane , Chengzu Li , Lei Li , Luc Van Gool , Guolei Sun , Serge Belongie

Spatio-temporal scene-graph approaches to video-based reasoning tasks, such as video question-answering (QA), typically construct such graphs for every video frame. These approaches often ignore the fact that videos are essentially…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Anoop Cherian , Chiori Hori , Tim K. Marks , Jonathan Le Roux

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced performance on 2D visual tasks. However, improving their spatial intelligence remains a challenge. Existing 3D MLLMs always rely on additional 3D or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Diankun Wu , Fangfu Liu , Yi-Hsin Hung , Yueqi Duan

Spatio-temporal reasoning is a core capability for Multimodal Large Language Models (MLLMs) operating in the real world. As such, evaluating it precisely has become an essential challenge. However, existing spatio-temporal reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Jinho Park , Youbin Kim , Hogun Park , Eunbyung Park

Long video understanding is challenging due to rich and complicated multimodal clues in long temporal range.Current methods adopt reasoning to improve the model's ability to analyze complex video clues in long videos via text-form…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Houlun Chen , Xin Wang , Guangyao Li , Yuwei Zhou , Yihan Chen , Jia Jia , Wenwu Zhu

Spatial reasoning is central to navigation and robotics, yet measuring model capabilities on these tasks remains difficult. Existing benchmarks evaluate models in a one-shot setting, requiring full solution generation in a single response,…

Artificial Intelligence · Computer Science 2026-04-13 Lars Benedikt Kaesberg , Tianyu Yang , Niklas Bauer , Terry Ruas , Jan Philip Wahle , Bela Gipp

Existing efforts in text-based video question answering (TextVideoQA) are criticized for their opaque decisionmaking and heavy reliance on scene-text recognition. In this paper, we propose to study Grounded TextVideoQA by forcing models to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Sheng Zhou , Junbin Xiao , Xun Yang , Peipei Song , Dan Guo , Angela Yao , Meng Wang , Tat-Seng Chua

Category-level pose estimation is a challenging task with many potential applications in computer vision and robotics. Recently, deep-learning-based approaches have made great progress, but are typically hindered by the need for large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Pengyuan Wang , Takuya Ikeda , Robert Lee , Koichi Nishiwaki

Feedforward geometric foundation models achieve strong short-window reconstruction, yet scaling them to minutes-long videos is bottlenecked by quadratic attention complexity or limited effective memory in recurrent designs. We present LoGeR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Junyi Zhang , Charles Herrmann , Junhwa Hur , Chen Sun , Ming-Hsuan Yang , Forrester Cole , Trevor Darrell , Deqing Sun

Video reasoning models are a core component of egocentric and embodied agents. However, standard benchmarks for assessing models provide only evaluation of the output (e.g. the answer to a question), without evaluation of intermediate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Arsha Nagrani , Jasper Uijilings , Shyamal Buch , Tobias Weyand , Sudheendra Vijayanarasimhan , Bo Hu , Ramin Mehran , David A Ross , Cordelia Schmid

Reasoning Video Object Segmentation (ReasonVOS) is a challenging task that requires stable object segmentation across video sequences using implicit and complex textual inputs. Previous methods fine-tune Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhengtong Zhu , Jiaqing Fan , Zhixuan Liu , Fanzhang Li

Grounded video question answering (GVQA) aims to localize relevant temporal segments in videos and generate accurate answers to a given question; however, large video-language models (LVLMs) exhibit limited temporal awareness. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xiaoqian Shen , Min-Hung Chen , Yu-Chiang Frank Wang , Mohamed Elhoseiny , Ryo Hachiuma

The rapid development of multimodal large-language models (MLLMs) has significantly expanded the scope of visual language reasoning, enabling unified systems to interpret and describe complex visual content. However, applying these models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Xinkui Zhao , Zuxin Wang , Yifan Zhang , Guanjie Cheng , Yueshen Xu , Shuiguang Deng , Chang Liu , Naibo Wang , Jianwei Yin

The main challenge in video question answering (VideoQA) is to capture and understand the complex spatial and temporal relations between objects based on given questions. Existing graph-based methods for VideoQA usually ignore keywords in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Yi Cheng , Hehe Fan , Dongyun Lin , Ying Sun , Mohan Kankanhalli , Joo-Hwee Lim

Video question answering requires the models to understand and reason about both the complex video and language data to correctly derive the answers. Existing efforts have been focused on designing sophisticated cross-modal interactions to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Junbin Xiao , Angela Yao , Zhiyuan Liu , Yicong Li , Wei Ji , Tat-Seng Chua