English
Related papers

Related papers: Automatic Prompt Augmentation and Selection with C…

200 papers

Thinking-with-images paradigms have showcased remarkable visual reasoning capability by integrating visual information as dynamic elements into the Chain-of-Thought (CoT). However, optimizing interleaved multimodal CoT (iMCoT) through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Wenxi Yang , Yuzhong Zhao , Fang Wan , Qixiang Ye

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Enhancing the reasoning capability of large language models (LLMs) remains a core challenge in natural language processing. The Chain-of-Thought (CoT) paradigm dominates practical applications for its single-round efficiency, yet its…

Large language models (LLMs) have shown impressive emergent abilities in a wide range of tasks, but the associated expensive API cost greatly limits the real application. Previous works like chain-of-thought (CoT) and tree-of-thoughts (ToT)…

Computation and Language · Computer Science 2024-08-27 Yu Shang , Yu Li , Fengli Xu , Yong Li

Large language models (LLMs) exhibit strong generative capabilities and have shown great potential in code generation. Existing chain-of-thought (CoT) prompting methods enhance model reasoning by eliciting intermediate steps, but suffer…

Artificial Intelligence · Computer Science 2025-12-17 Shen Li , Li Huang , Shaoxiong Zhan , Weifeng Sun , Tao Yin , Zhongxin Liu , Meng Yan

Chain-of-thought (CoT) significantly enhances the reasoning performance of large language models (LLM). While current theoretical studies often attribute this improvement to increased expressiveness and computational capacity, we argue that…

Machine Learning · Computer Science 2025-03-06 Kaiyue Wen , Huaqing Zhang , Hongzhou Lin , Jingzhao Zhang

Chain-of-thought (CoT) prompting, which offers step-by-step problem-solving rationales, has impressively unlocked the reasoning potential of large language models (LLMs). Yet, the standard CoT is less effective in problems demanding…

Computation and Language · Computer Science 2024-05-09 Song Jiang , Zahra Shakeri , Aaron Chan , Maziar Sanjabi , Hamed Firooz , Yinglong Xia , Bugra Akyildiz , Yizhou Sun , Jinchao Li , Qifan Wang , Asli Celikyilmaz

Recently, there has been significant progress in teaching language models to perform step-by-step reasoning to solve complex numerical reasoning tasks. Chain-of-thoughts prompting (CoT) is by far the state-of-art method for these tasks. CoT…

Computation and Language · Computer Science 2023-10-24 Wenhu Chen , Xueguang Ma , Xinyi Wang , William W. Cohen

Chain of Thought (CoT) reasoning has demonstrated remarkable deep reasoning capabilities in both large language models (LLMs) and multimodal large language models (MLLMs). However, its reliability is often undermined by the accumulation of…

Artificial Intelligence · Computer Science 2025-11-26 Zijun Chen , Wenbo Hu , Richang Hong

To improve the ability of the large language model (LLMs) to tackle complex reasoning problems, chain-of-thoughts (CoT) methods were proposed to guide LLMs to reason step-by-step, enabling problem solving from simple to complex.…

Machine Learning · Computer Science 2024-06-27 Zhen-Yu Zhang , Siwei Han , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Chain-of-Thought (CoT) Prompting is a dominant paradigm in Large Language Models (LLMs) to enhance complex reasoning. It guides LLMs to present multi-step reasoning, rather than generating the final answer directly. However, CoT encounters…

Computation and Language · Computer Science 2025-09-25 Dong-Hai Zhu , Yu-Jie Xiong , Jia-Chen Zhang , Xi-Jiong Xie , Chun-Ming Xia

Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step…

Computation and Language · Computer Science 2023-05-29 Lei Wang , Wanyu Xu , Yihuai Lan , Zhiqiang Hu , Yunshi Lan , Roy Ka-Wei Lee , Ee-Peng Lim

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT heavily relies on the…

Computation and Language · Computer Science 2023-11-03 Jingyuan Qi , Zhiyang Xu , Ying Shen , Minqian Liu , Di Jin , Qifan Wang , Lifu Huang

With the rapid advancement of large reasoning models, long Chain-of-Thought (CoT) prompting has demonstrated strong performance on complex tasks. However, this often comes with a significant increase in token usage. In this paper, we…

Computation and Language · Computer Science 2025-06-05 Ruiqi Zhang , Changyi Xiao , Yixin Cao

Recent advancements in reasoning with large language models (RLLMs), such as OpenAI-O1 and DeepSeek-R1, have demonstrated their impressive capabilities in complex domains like mathematics and coding. A central factor in their success lies…

Artificial Intelligence · Computer Science 2025-07-21 Qiguang Chen , Libo Qin , Jinhao Liu , Dengyun Peng , Jiannan Guan , Peng Wang , Mengkang Hu , Yuhang Zhou , Te Gao , Wanxiang Che

Large language models (LLMs) have shown exceptional performance as general-purpose assistants, excelling across a variety of reasoning tasks. This achievement represents a significant step toward achieving artificial general intelligence…

Artificial Intelligence · Computer Science 2024-08-13 Xiaoyu Tan , Yongxin Deng , Xihe Qiu , Weidi Xu , Chao Qu , Wei Chu , Yinghui Xu , Yuan Qi

It has been shown that Large Language Models' (LLMs) performance can be improved for many tasks using Chain of Thought (CoT) or In-Context Learning (ICL), which involve demonstrating the steps needed to solve a task using a few examples.…

Computation and Language · Computer Science 2024-10-15 Joseph Shtok , Amit Alfassy , Foad Abo Dahood , Eliyahu Schwartz , Sivan Doveh , Assaf Arbelle

Large language models (LLMs) are increasingly deployed in socially sensitive settings despite substantial documentation that they encode gender biases. Chain-of-Thought (CoT) prompting has been proposed as a bias-mitigation approach.…

Computation and Language · Computer Science 2026-05-21 Edie Pearman , Sophia Osborne , Mira Kandlikar-Bloch , Mina Arzaghi , Florian Carichon , Golnoosh Farnadi

Chain-of-thought and more broadly test-time compute are known to augment the expressive capabilities of language models and have led to major innovations in reasoning. Motivated by this success, this paper explores latent chain-of-thought…

Machine Learning · Computer Science 2026-05-20 Carson Dudley , Samet Oymak

Large language models (LLMs) such as GPT-4 have recently demonstrated impressive results across a wide range of tasks. LLMs are still limited, however, in that they frequently fail at complex reasoning, their reasoning processes are opaque,…