English
Related papers

Related papers: Monet: Reasoning in Latent Visual Space Beyond Ima…

200 papers

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

Chain-of-Thought (CoT) reasoning has been widely adopted to enhance Large Language Models (LLMs) by decomposing complex tasks into simpler, sequential subtasks. However, extending CoT to vision-language reasoning tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Luozheng Qin , Jia Gong , Yuqing Sun , Tianjiao Li , Mengping Yang , Xiaomeng Yang , Chao Qu , Zhiyu Tan , Hao Li

While explicit Chain-of-Thought (CoT) equips Large Language Models (LLMs) with strong reasoning capabilities, it requires models to verbalize every intermediate step in text tokens, constraining the model thoughts to the discrete vocabulary…

Computation and Language · Computer Science 2026-02-12 Weihao Liu , Dehai Min , Lu Cheng

While Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Vision-Language Models (LVLMs), most existing methods in multimodal reasoning neglect the critical role of visual perception within…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Siyuan Huang , Xiaoye Qu , Yafu Li , Yun Luo , Zefeng He , Daizong Liu , Yu Cheng

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Joint audio-visual reasoning is essential for omnimodal understanding, yet current multimodal large language models (MLLMs) still struggle when reasoning requires fine-grained evidence from both modalities. A central limitation is that…

The rapid success of Vision Large Language Models (VLLMs) often depends on the high-resolution images with abundant visual tokens, which hinders training and deployment efficiency. Current training-free visual token compression methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Jianjian Li , Junquan Fan , Feng Tang , Gang Huang , Shitao Zhu , Songlin Liu , Nian Xie , Wulong Liu , Yong Liao

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit…

Computation and Language · Computer Science 2025-10-24 Zhenrui Yue , Bowen Jin , Huimin Zeng , Honglei Zhuang , Zhen Qin , Jinsung Yoon , Lanyu Shang , Jiawei Han , Dong Wang

Recent studies demonstrate that multimodal large language models (MLLMs) can proficiently evaluate visual quality through interpretable assessments. However, existing approaches typically treat quality scoring and reasoning descriptions as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhuoxuan Cai , Jian Zhang , Xinbin Yuan , Peng-Tao Jiang , Wenxiang Chen , Bowen Tang , Lujian Yao , Qiyuan Wang , Jinwen Chen , Bo Li

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Large language models (LLMs) have exhibited impressive performance in language comprehension and various reasoning tasks. However, their abilities in spatial reasoning, a crucial aspect of human cognition, remain relatively unexplored.…

Computation and Language · Computer Science 2024-10-24 Wenshan Wu , Shaoguang Mao , Yadong Zhang , Yan Xia , Li Dong , Lei Cui , Furu Wei

Recently, reasoning-based MLLMs have achieved a degree of success in generating long-form textual reasoning chains. However, they still struggle with complex tasks that necessitate dynamic and iterative focusing on and revisiting of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Chaoya Jiang , Yongrui Heng , Wei Ye , Han Yang , Haiyang Xu , Ming Yan , Ji Zhang , Fei Huang , Shikun Zhang

Recent large vision-language models (LVLMs) can generate vision-text multimodal chain-of-thought (MCoT) traces after reinforcement fine-tuning (RFT). However, we observe that the visual information incorporated in MCoT is often inaccurate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zujing Liu , Junwen Pan , Qi She , Yuan Gao , Guisong Xia

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Multimodal Large Language Models (MLLMs) often struggle to accurately perceive fine-grained visual details, especially when targets are tiny or visually subtle. This challenge can be addressed through semantic-visual information fusion,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yuxiang Shen , Hailong Huang , Zhenkun Gao , Xueheng Li , Man Zhou , Chengjun Xie , Haoxuan Che , Xuanhua He , Jie Zhang

The advancement of large language models (LLMs) has significantly broadened the scope of applications in natural language processing, with multi-modal LLMs extending these capabilities to integrate and interpret visual data. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bingchen Zhao , Yongshuo Zong , Letian Zhang , Timothy Hospedales

Recently, Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs), but Vision-Language Models (VLMs) still struggle with multi-step reasoning tasks due to limited multimodal reasoning…

Computation and Language · Computer Science 2026-03-23 Yuliang Zhan , Xinyu Tang , Han Wan , Jian Li , Ji-Rong Wen , Hao Sun

With the rapid development of MLLMs, evaluating their visual capabilities has become increasingly crucial. Current benchmarks primarily fall into two main types: basic perception benchmarks, which focus on local details but lack deep…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Chenhui Qiang , Zhaoyang Wei , Xumeng Han , Zipeng Wang , Siyao Li , Xiangyuan Lan , Jianbin Jiao , Zhenjun Han

Multi-modal keyphrase prediction (MMKP) aims to advance beyond text-only methods by incorporating multiple modalities of input information to produce a set of conclusive phrases. Traditional multi-modal approaches have been proven to have…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Qihang Ma , Shengyu Li , Jie Tang , Dingkang Yang , Shaodong Chen , Yingyi Zhang , Chao Feng , Jiao Ran

Although chain-of-thought reasoning and reinforcement learning (RL) have driven breakthroughs in NLP, their integration into generative vision models remains underexplored. We introduce ReasonGen-R1, a two-stage framework that first imbues…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yu Zhang , Yunqi Li , Yifan Yang , Rui Wang , Yuqing Yang , Dai Qi , Jianmin Bao , Dongdong Chen , Chong Luo , Lili Qiu