English
Related papers

Related papers: LLaVA-CoT: Let Vision Language Models Reason Step-…

200 papers

Chain-of-Thought (CoT) prompting elicits large language models (LLMs) to produce a series of intermediate reasoning steps before arriving at the final answer. However, when transitioning to vision-language models (VLMs), their text-only…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jun Gao , Yongqi Li , Ziqiang Cao , Wenjie Li

Faithful reasoning in medical vision-language models (VLMs) requires not only accurate predictions but also transparent alignment between textual rationales and visual evidence. While Chain-of-Thought (CoT) prompting has shown promise in…

We study how to extend chain-of-thought (CoT) beyond language to better handle multimodal reasoning. While CoT helps LLMs and VLMs articulate intermediate steps, its text-only form often fails on vision-intensive problems where key…

Artificial Intelligence · Computer Science 2026-02-03 Yifei Shao , Kun Zhou , Ziming Xu , Mohammad Atif Quamar , Shibo Hao , Zhen Wang , Zhiting Hu , Biwei Huang

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

The advancement of Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs) and large vision-language models (LVLMs). However, a rigorous evaluation framework for video CoT reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Yukun Qi , Yiming Zhao , Yu Zeng , Xikun Bao , Wenxuan Huang , Lin Chen , Zehui Chen , Jie Zhao , Zhongang Qi , Feng Zhao

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

Computation and Language · Computer Science 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Recent advancements in Large Vision Language Models (LVLMs) have significantly improved performance in Visual Question Answering (VQA) tasks through multimodal Retrieval-Augmented Generation (RAG). However, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Qi Yang , Chenghao Zhang , Lubin Fan , Kun Ding , Jieping Ye , Shiming Xiang

Multimodal reasoning stands as a pivotal capability for large vision-language models (LVLMs). The integration with Domain-Specific Languages (DSL), offering precise visual representations, equips these models with the opportunity to execute…

Computation and Language · Computer Science 2024-02-22 Xueliang Zhao , Xinting Huang , Tingchen Fu , Qintong Li , Shansan Gong , Lemao Liu , Wei Bi , Lingpeng Kong

Counting serves as a simple but powerful test of a Large Vision-Language Model's (LVLM's) reasoning; it forces the model to identify each individual object and then add them all up. In this study, we investigate how LVLMs implement counting…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Liwei Che , Zhiyu Xue , Yihao Quan , Benlin Liu , Zeru Shi , Michelle Hurst , Jacob Feldman , Ruixiang Tang , Ranjay Krishna , Vladimir Pavlovic

Large Audio-Language Models (LALMs) have demonstrated remarkable performance in tasks involving audio perception and understanding, such as speech recognition and audio captioning. However, their reasoning capabilities - critical for…

Sound · Computer Science 2025-01-14 Ziyang Ma , Zhuo Chen , Yuping Wang , Eng Siong Chng , Xie Chen

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Complex Visual Question Answering (Complex VQA) tasks, which demand sophisticated multi-modal reasoning and external knowledge integration, present significant challenges for existing large vision-language models (LVLMs) often limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Jingwei Peng , Jiehao Chen , Mateo Alejandro Rojas , Meilin Zhang

Large multimodal models (LMMs) have shown great potential for video reasoning with textual Chain-of-Thought. However, they remain vulnerable to hallucinations, especially when processing long-form videos where evidence is sparse and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Zuhao Yang , Sudong Wang , Kaichen Zhang , Keming Wu , Sicong Leng , Yifan Zhang , Bo Li , Chengwei Qin , Shijian Lu , Xingxuan Li , Lidong Bing

Large Language Models (LLMs) demonstrate the ability to solve reasoning and mathematical problems using the Chain-of-Thought (CoT) technique. Expanding CoT length, as seen in models such as DeepSeek-R1, significantly enhances this reasoning…

Computation and Language · Computer Science 2025-07-15 Zihao Li , Xu Wang , Yuzhe Yang , Ziyu Yao , Haoyi Xiong , Mengnan Du

Grounding natural-language instructions into continuous control for quadruped robots remains a fundamental challenge in vision language action. Existing methods struggle to bridge high-level semantic reasoning and low-level actuation,…

Robotics · Computer Science 2025-11-25 Ting Huang , Dongjian Li , Rui Yang , Zeyu Zhang , Zida Yang , Hao Tang

Large Language Models (LLMs) solve many reasoning tasks via chain-of-thought (CoT) prompting, but smaller models (about 7 to 8B parameters) still struggle with multi-step reasoning under tight compute and token budgets. Existing test time…

Computation and Language · Computer Science 2026-04-29 Sagnik Chatterjee , Atharva Patil , Sricharan Ramesh

Thinking Large Language Models (LLMs) generate explicit intermediate reasoning traces before final answers, potentially improving transparency, interpretability, and solution accuracy for code generation. However, the quality of these…

Artificial Intelligence · Computer Science 2025-11-11 Haoran Xue , Gias Uddin , Song Wang

Large Language Models (LLMs) have shown impressive performance in complex reasoning tasks through the use of Chain-of-Thought (CoT) reasoning, allowing models to break down problems into manageable sub-tasks. However, existing CoT…

Computation and Language · Computer Science 2025-07-11 Jean-Francois Ton , Muhammad Faaiz Taufiq , Yang Liu

Multimodal reasoning aims to enhance the capabilities of MLLMs by incorporating intermediate reasoning steps before reaching the final answer. It has evolved from text-only reasoning to the integration of visual information, enabling the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Chao Chen , Zhixin Ma , Yongqi Li , Yupeng Hu , Yinwei Wei , Wenjie Li , Liqiang Nie

Chain-of-Thought (CoT) is a technique that guides Large Language Models (LLMs) to decompose complex tasks into multi-step reasoning through intermediate steps in natural language form. Briefly, CoT enables LLMs to think step by step.…

Computation and Language · Computer Science 2023-10-19 Caoyun Fan , Jidong Tian , Yitian Li , Wenqing Chen , Hao He , Yaohui Jin