English
Related papers

Related papers: Multimodal Chain-of-Thought Reasoning in Language …

200 papers

Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series…

Computation and Language · Computer Science 2023-06-02 Boshi Wang , Sewon Min , Xiang Deng , Jiaming Shen , You Wu , Luke Zettlemoyer , Huan Sun

Multimodal reasoning is a challenging task that requires models to reason across multiple modalities to answer questions. Existing approaches have made progress by incorporating language and visual modalities into a two-stage reasoning…

Artificial Intelligence · Computer Science 2024-07-04 Cheng Tan , Jingxuan Wei , Zhangyang Gao , Linzhuang Sun , Siyuan Li , Ruifeng Guo , Bihui Yu , Stan Z. Li

Chain-of-Thought (CoT) prompting has achieved remarkable success in unlocking the reasoning capabilities of Large Language Models (LLMs). Although CoT prompting enhances reasoning, its verbosity imposes substantial computational overhead.…

Computation and Language · Computer Science 2026-04-21 Yifan Wang , Shiyu Li , Peiming Li , Xiaochen Yang , Yang Tang , Zheng Wei

In the era of large-scale artificial intelligence, Large Language Models (LLMs) have made significant strides in natural language processing. However, they often lack transparency and generate unreliable outputs, raising concerns about…

Computation and Language · Computer Science 2025-06-25 Zhenke Duan , Jiqun Pan , Jiani Tu , Xiaoyi Wang , Yanqing Wang

Multi-Modal Large Language Models (MLLMs) have demonstrated impressive performance in various VQA tasks. However, they often lack interpretability and struggle with complex visual inputs, especially when the resolution of the input image is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Hao Shao , Shengju Qian , Han Xiao , Guanglu Song , Zhuofan Zong , Letian Wang , Yu Liu , Hongsheng Li

Chain of Thought (CoT) prompting can encourage language models to engage in multi-step logical reasoning. The quality of the provided demonstrations significantly influences the success of downstream inference tasks. Current unsupervised…

Computation and Language · Computer Science 2025-05-27 Yufeng Zhang , Xuepeng Wang , Lingxiang Wu , Jinqiao Wang

Multimodal Chain-of-Thought (MCoT) models have demonstrated impressive capability in complex visual reasoning tasks. Unfortunately, recent studies reveal that they suffer from severe hallucination problems due to diminished visual attention…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ji Ma , Wei Suo , Peng Wang , Yanning Zhang

Recently, Chain-of-Thought (CoT) prompting has delivered success on complex reasoning tasks, which aims at designing a simple prompt like ``Let's think step by step'' or multiple in-context exemplars with well-designed rationales to elicit…

Computation and Language · Computer Science 2024-06-04 Jianing Wang , Qiushi Sun , Xiang Li , Ming Gao

Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks. However, the quality and coherence of the reasoning process can still benefit from enhanced…

Computation and Language · Computer Science 2025-01-24 Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Tianhao Xu

Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs). Yet, its potential in multimodal large language models (MLLMs) remains largely untapped, hindered by the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Lingxiao Li , Yifan Wang , Xinyan Gao , Chen Tang , Xiangyu Yue , Chenyu You

The advancement of Large Language Models (LLMs) has brought substantial attention to the Chain of Thought (CoT) approach, primarily due to its ability to enhance the capability of LLMs on complex reasoning tasks. Moreover, the significance…

Computation and Language · Computer Science 2024-03-05 Bingshuai Liu , Chenyang Lyu , Zijun Min , Zhanyu Wang , Jinsong Su , Longyue Wang

This work introduces Symbolic-Aided Chain-of-Thought (CoT), an improved approach to standard CoT, for logical reasoning in large language models (LLMs). The key idea is to integrate lightweight symbolic representations into few-shot…

Artificial Intelligence · Computer Science 2025-10-07 Phuong Minh Nguyen , Tien Huu Dang , Naoya Inoue

Recent advances in large language models (LLMs) have opened new possibilities for automated reasoning and decision-making in wireless networks. However, applying LLMs to wireless communications presents challenges such as limited capability…

Networking and Internet Architecture · Computer Science 2025-05-29 Xudong Wang , Jian Zhu , Ruichen Zhang , Lei Feng , Dusit Niyato , Jiacheng Wang , Hongyang Du , Shiwen Mao , Zhu Han

Recent advancements in Multimodal Large Language Models (MLLMs) have significantly enhanced cross-modal understanding and reasoning by incorporating Chain-of-Thought (CoT) reasoning in the semantic space. Building upon this, recent studies…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Chengzhi Liu , Yuzhe Yang , Yue Fan , Qingyue Wei , Sheng Liu , Xin Eric Wang

Prompting-based large language models (LLMs) are surprisingly powerful at generating natural language reasoning steps or Chains-of-Thoughts (CoT) for multi-step question answering (QA). They struggle, however, when the necessary knowledge…

Computation and Language · Computer Science 2023-06-26 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

Chain-of-Thought (CoT) prompting has proven to be effective in enhancing the reasoning capabilities of Large Language Models (LLMs) with at least 100 billion parameters. However, it is ineffective or even detrimental when applied to…

Computation and Language · Computer Science 2023-10-24 Chengcheng Han , Xiaowei Du , Che Zhang , Yixin Lian , Xiang Li , Ming Gao , Baoyuan Wang

Large reasoning models (LRMs) increasingly rely on step-by-step Chain-of-Thought (CoT) reasoning to improve task performance, particularly in high-resource languages such as English. While recent work has examined final-answer accuracy in…

Computation and Language · Computer Science 2025-10-13 Raoyuan Zhao , Yihong Liu , Hinrich Schütze , Michael A. Hedderich

While the recent Chain-of-Thought (CoT) technique enhances the reasoning ability of large language models (LLMs) with the theory of mind, it might still struggle in handling logical reasoning that relies much on symbolic expressions and…

Computation and Language · Computer Science 2024-06-12 Jundong Xu , Hao Fei , Liangming Pan , Qian Liu , Mong-Li Lee , Wynne Hsu

Compressing long chains of thought (CoT) into compact latent tokens is crucial for efficient reasoning with large language models (LLMs). Recent studies employ autoencoders to achieve this by reconstructing textual CoT from latent tokens,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Xiaoshu Chen , Sihang Zhou , Ke Liang , Taichun Zhou , Xinwang Liu

Large language models (LLMs) equipped with chain-of-thoughts (CoT) prompting have shown significant multi-step reasoning capabilities in factual content like mathematics, commonsense, and logic. However, their performance in narrative…

Computation and Language · Computer Science 2024-09-24 Hung-Ting Su , Ya-Ching Hsu , Xudong Lin , Xiang-Qian Shi , Yulei Niu , Han-Yuan Hsu , Hung-yi Lee , Winston H. Hsu