English
Related papers

Related papers: Beyond Static Visual Tokens: Structured Sequential…

200 papers

Large Vision-Language Models (LVLMs) have achieved significant success in multimodal tasks, with multimodal chain-of-thought (MCoT) further enhancing performance and interpretability. Recent MCoT methods fall into two categories: (i)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zihui Cheng , Qiguang Chen , Xiao Xu , Jiaqi Wang , Weiyun Wang , Hao Fei , Yidong Wang , Alex Jinpeng Wang , Zhi Chen , Wanxiang Che , Libo Qin

Large language models have demonstrated substantial advancements in reasoning capabilities. However, current Vision-Language Models (VLMs) often struggle to perform systematic and structured reasoning, especially when handling complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Guowei Xu , Peng Jin , Ziang Wu , Hao Li , Yibing Song , Lichao Sun , Li Yuan

Chain-of-Thought (CoT) has widely enhanced mathematical reasoning in Large Language Models (LLMs), but it still remains challenging for extending it to multimodal domains. Existing works either adopt a similar textual reasoning for image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Xinyan Chen , Renrui Zhang , Dongzhi Jiang , Aojun Zhou , Shilin Yan , Weifeng Lin , Hongsheng Li

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Visual spatial reasoning (VSR) remains challenging for modern vision-language models (VLMs), despite advances in multimodal architectures. A common strategy is to inject additional information at inference time, such as explicit spatial…

Computation and Language · Computer Science 2026-02-26 Muku Akasaka , Soyeon Caren Han

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced cross-modal understanding and reasoning by incorporating Chain-of-Thought (CoT) reasoning in the semantic space. Building upon this, recent studies…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Chengzhi Liu , Yuzhe Yang , Yue Fan , Qingyue Wei , Sheng Liu , Xin Eric Wang

Visual-spatial understanding, the ability to infer object relationships and layouts from visual input, is fundamental to downstream tasks such as robotic navigation and embodied interaction. However, existing methods face spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Haoyu Zhang , Meng Liu , Zaijing Li , Haokun Wen , Weili Guan , Yaowei Wang , Liqiang Nie

Multi-modal reasoning requires the seamless integration of visual and linguistic cues, yet existing Chain-of-Thought methods suffer from two critical limitations in cross-modal scenarios: (1) over-reliance on single coarse-grained image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wenting Lu , Didi Zhu , Tao Shen , Donglin Zhu , Ayong Ye , Chao Wu

In language reasoning, longer chains of thought consistently yield better performance, which naturally suggests that visual latent reasoning may likewise benefit from longer latent sequences. However, we discover a counterintuitive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chenfeng Wang , Wei He , Xuhan Zhu , Chunpeng Zhou , Qizhen Li , Song Yan , Yufei Zheng , Chengjun Yu , Fan Lu , Wei Zhai , Yang Cao , Pengfei Yu , Zheng-Jun Zha

We study how different Chain-of-Thought (CoT) designs affect the acquisition of the generalizable visual reasoning ability in vision-language models (VLMs). While CoT data, especially long or visual CoT such as "think with image", has been…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Yifan Du , Kun Zhou , Yingqian Min , Yue Ling , Wayne Xin Zhao , Youbin Wu

The advancement of Large Vision-Language Models (LVLMs) requires precise local region-based reasoning that faithfully grounds the model's logic in actual visual evidence. However, existing datasets face limitations in scalability due to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Byeonggeuk Lim , Kyeonghyun Kim , JungMin Yun , YoungBin Kim

We study how to extend chain-of-thought (CoT) beyond language to better handle multimodal reasoning. While CoT helps LLMs and VLMs articulate intermediate steps, its text-only form often fails on vision-intensive problems where key…

Artificial Intelligence · Computer Science 2026-02-03 Yifei Shao , Kun Zhou , Ziming Xu , Mohammad Atif Quamar , Shibo Hao , Zhen Wang , Zhiting Hu , Biwei Huang

Multi-modal large language models (MLLMs) have achieved remarkable capabilities by integrating visual perception with language understanding, enabling applications such as image-grounded dialogue, visual question answering, and scientific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Tianyi Bai , Zengjie Hu , Fupeng Sun , Jiantao Qiu , Yizhen Jiang , Guangxin He , Bohan Zeng , Conghui He , Binhang Yuan , Wentao Zhang

Multimodal large language models are increasingly expected to perform thinking with images, yet existing visual latent reasoning methods still rely on explicit textual chain-of-thought interleaved with visual latent tokens. This interleaved…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Houcheng Jiang , Jiajun Fu , Junfeng Fang , Chen Gao , Xiang Wang , Xiangnan He , Yong Li

Thinking-with-images paradigms have showcased remarkable visual reasoning capability by integrating visual information as dynamic elements into the Chain-of-Thought (CoT). However, optimizing interleaved multimodal CoT (iMCoT) through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Wenxi Yang , Yuzhong Zhao , Fang Wan , Qixiang Ye

While chain-of-thought (CoT) prompting improves reasoning in large language models, its effectiveness in vision-language models (VLMs) remains limited due to over-reliance on textual cues and memorized knowledge. To investigate the visual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Charles Corbière , Simon Roburin , Syrielle Montariol , Antoine Bosselut , Alexandre Alahi

As large vision language models (VLMs) advance, their capabilities in multilingual visual question answering (mVQA) have significantly improved. Chain-of-thought (CoT) reasoning has been proven to enhance interpretability and complex…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jing Huang , Zhiya Tan , Shutao Gong , Fanwei Zeng , Joey Tianyi Zhou , Changtao Miao , Huazhe Tan , Weibin Yao , Jianshu Li

While vision-language models (VLMs) have exhibited multi-turn visual reasoning capabilities, their reasoning trajectories remain relatively shallow and are dominated by a text-centric paradigm, limiting their applicability to complex visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Zhiwei Ning , Wenwen Tong , Xiangli Kong , Shengnan Ma , Ziyi Shang , Jingcheng Ni , Tao Hu , Yong Xien Chng , Jixuan Ying , Zehuan Wu , Hanming Deng , Jie Yang , Yuanjie Zheng , Wei Liu , Lewei Lu

Composed Image Retrieval (CIR) aims to retrieve target images based on a reference image and modified texts. However, existing methods often struggle to extract the correct semantic cues from the reference image that best reflect the user's…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xuri Ge , Chunhao Wang , Xindi Wang , Zheyun Qin , Zhumin Chen , Xin Xin

Chain-of-Thought (CoT) prompting has achieved remarkable success in unlocking the reasoning capabilities of Large Language Models (LLMs). Although CoT prompting enhances reasoning, its verbosity imposes substantial computational overhead.…

Computation and Language · Computer Science 2026-04-21 Yifan Wang , Shiyu Li , Peiming Li , Xiaochen Yang , Yang Tang , Zheng Wei