English
Related papers

Related papers: LlamaV-o1: Rethinking Step-by-step Visual Reasonin…

200 papers

Recent advancements in Vision-Language (VL) research have sparked new benchmarks for complex visual reasoning, challenging models' advanced reasoning ability. Traditional Vision-Language Models (VLMs) perform well in visual perception tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Zhiyuan Li , Dongnan Liu , Chaoyi Zhang , Heng Wang , Tengfei Xue , Weidong Cai

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

The remarkable reasoning capability of large language models (LLMs) stems from cognitive behaviors that emerge through reinforcement with verifiable rewards. This work investigates how to transfer this principle to Multimodal LLMs (MLLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yana Wei , Liang Zhao , Jianjian Sun , Kangheng Lin , Jisheng Yin , Jingcheng Hu , Yinmin Zhang , En Yu , Haoran Lv , Zejia Weng , Jia Wang , Chunrui Han , Yuang Peng , Qi Han , Zheng Ge , Xiangyu Zhang , Daxin Jiang , Vishal M. Patel

Estimating task progress requires reasoning over long-horizon dynamics rather than recognizing static visual content. While modern Vision-Language Models (VLMs) excel at describing what is visible, it remains unclear whether they can infer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Jianshu Zhang , Chengxuan Qian , Haosen Sun , Haoran Lu , Dingcheng Wang , Letian Xue , Han Liu

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

With enhanced capabilities and widespread applications, Multimodal Large Language Models (MLLMs) are increasingly required to process and reason over multiple images simultaneously. However, existing MLLM benchmarks focus either on…

Large Vision-Language Models (LVLMs) have recently demonstrated amazing success in multi-modal tasks, including advancements in Multi-modal Chain-of-Thought (MCoT) reasoning. Despite these successes, current benchmarks still follow a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zihui Cheng , Qiguang Chen , Jin Zhang , Hao Fei , Xiaocheng Feng , Wanxiang Che , Min Li , Libo Qin

Puzzles have long served as compact and revealing probes of human cognition, isolating abstraction, rule discovery, and systematic reasoning with minimal reliance on prior knowledge. Leveraging these properties, visual puzzles have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Maria Lymperaiou , Vasileios Karampinis , Giorgos Filandrianos , Angelos Vlachos , Chrysoula Zerva , Athanasios Voulodimos

Visual-Interleaved Chain-of-Thought (VI-CoT) enables Multi-modal Large Language Models (MLLMs) to continually update their understanding and decision space based on step-wise intermediate visual states (IVS), much like a human would, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xuecheng Wu , Jiaxing Liu , Danlei Huang , Yifan Wang , Yunyun Shi , Kedi Chen , Junxiao Xue , Yang Liu , Chunlin Chen , Hairong Dong , Dingkang Yang

Recent large vision-language models (LVLMs) have demonstrated impressive reasoning ability by generating long chain-of-thought (CoT) responses. However, CoT reasoning in multimodal contexts is highly vulnerable to visual hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yongchang Zhang , Oliver Ma , Tianyi Liu , Guangquan Zhou , Yang Chen

Process Reward Models (PRMs) provide step-level supervision that improves the reliability of reasoning in large language models. While PRMs have been extensively studied in text-based domains, their extension to Vision Language Models…

Artificial Intelligence · Computer Science 2025-10-08 Brandon Ong , Tej Deep Pala , Vernon Toh , William Chandra Tjhi , Soujanya Poria

Multimodal Large Language Models (MLLMs) have shown impressive performance on vision-language tasks, but their long Chain-of-Thought (CoT) capabilities in multimodal scenarios remain underexplored. Inspired by OpenAI's o3 model, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Ye Wang , Qianglong Chen , Zejun Li , Siyuan Wang , Shijie Guo , Zhirui Zhang , Zhongyu Wei

Despite their success, current training pipelines for reasoning VLMs focus on a limited range of tasks, such as mathematical and logical reasoning. As a result, these models face difficulties in generalizing their reasoning capabilities to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Yuheng Zha , Kun Zhou , Yujia Wu , Yushu Wang , Jie Feng , Zhi Xu , Shibo Hao , Zhengzhong Liu , Eric P. Xing , Zhiting Hu

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

The ability of large vision-language models (LVLMs) to critique and correct their reasoning is an essential building block towards their self-improvement. However, a systematic analysis of such capabilities in LVLMs is still lacking. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xueqing Wu , Yuheng Ding , Bingxuan Li , Pan Lu , Da Yin , Kai-Wei Chang , Nanyun Peng

Vision-Language Models (VLMs) have recently demonstrated incredible strides on diverse vision language tasks. We dig into vision-based deductive reasoning, a more sophisticated but less explored realm, and find previously unexposed…

Artificial Intelligence · Computer Science 2024-10-02 Yizhe Zhang , He Bai , Ruixiang Zhang , Jiatao Gu , Shuangfei Zhai , Josh Susskind , Navdeep Jaitly

Understanding multi-image, multi-turn scenarios is a critical yet underexplored capability for Large Vision-Language Models (LVLMs). Existing benchmarks predominantly focus on static or horizontal comparisons -- e.g., spotting visual…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Wenbo Lyu , Yingjun Du , Jinglin Zhao , Xianton Zhen , Ling Shao

Recent multimodal large language models (MLLMs) achieve strong performance on visual reasoning benchmarks, yet it remains unclear to what extent such performance reflects reasoning directly grounded in visual evidence. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Longteng Guo , Yifan Wang , Pengkang Huo , Tailai Chen , Yuze Wu , Jing Liu , Xinxin Zhu

Large vision-language models (VLMs) demonstrate strong performance in medical image understanding, but frequently generate clinically plausible yet incorrect statements, raising significant safety concerns. Existing medical hallucination…

Large language models (LLMs) have recently demonstrated remarkable success in mathematical reasoning. Despite progress in methods like chain-of-thought prompting and self-consistency sampling, these advances often focus on final correctness…