English
Related papers

Related papers: Batch-of-Thought: Cross-Instance Learning for Enha…

200 papers

Automated video surveillance with Large Vision-Language Models is limited by their inherent bias towards normality, often failing to detect crimes. While Chain-of-Thought reasoning strategies show significant potential for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Pedro Domingos , João Pereira , Vasco Lopes , João Neves , David Semedo

Zero-shot Chain-of-Thought (CoT) prompting emerges as a simple and effective strategy for enhancing the performance of large language models (LLMs) in real-world reasoning tasks. Nonetheless, the efficacy of a singular, task-level prompt…

Computation and Language · Computer Science 2024-11-01 Xiaosong Yuan , Chen Shen , Shaotian Yan , Xiaofeng Zhang , Liang Xie , Wenxiao Wang , Renchu Guan , Ying Wang , Jieping Ye

Large language models (LLMs) perform better when they produce step-by-step, "Chain-of-Thought" (CoT) reasoning before answering a question, but it is unclear if the stated reasoning is a faithful explanation of the model's actual reasoning…

A common approach for teaching large language models (LLMs) to reason is to train on chain-of-thought (CoT) traces of in-distribution reasoning problems, but such annotated data is costly to obtain for every problem of interest. We want…

Computation and Language · Computer Science 2025-05-29 Fangcong Yin , Zeyu Leo Liu , Liu Leqi , Xi Ye , Greg Durrett

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

Computation and Language · Computer Science 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

Chain-of-thought (CoT) reasoning has exhibited impressive performance in language models for solving complex tasks and answering questions. However, many real-world questions require multi-modal information, such as text and images.…

Artificial Intelligence · Computer Science 2023-12-15 Liqi He , Zuchao Li , Xiantao Cai , Ping Wang

Current literature, aiming to surpass the "Chain-of-Thought" approach, often resorts to external modi operandi involving halting, modifying, and then resuming the generation process to boost Large Language Models' (LLMs) reasoning…

Computation and Language · Computer Science 2024-06-04 Bilgehan Sel , Ahmad Al-Tawaha , Vanshaj Khattar , Ruoxi Jia , Ming Jin

Reasoning methods, best exemplified by the well-known Chain-of-Thought (CoT), empower the reasoning abilities of Large Language Models (LLMs) by eliciting them to solve complex tasks in a step-by-step manner. Although they are achieving…

Computation and Language · Computer Science 2024-06-24 Leonardo Ranaldi , Giulia Pucci , Federico Ranaldi , Elena Sofia Ruzzetti , Fabio Massimo Zanzotto

Large language models (LLMs) have demonstrated remarkable reasoning capabilities when prompted with strategies such as Chain-of-Thought (CoT). However, these approaches focus on token-level output without considering internal weight…

Computation and Language · Computer Science 2025-04-16 Saif Punjwani , Larry Heck

This report examines the effectiveness of Chain-of-Thought (CoT) prompting in improving the multi-step reasoning abilities of large language models (LLMs). Inspired by previous studies \cite{Min2022RethinkingWork}, we analyze the impact of…

Computation and Language · Computer Science 2023-09-29 Aayush Mishra , Karan Thakkar

Large language models (LLMs) possess vast semantic knowledge but often struggle with complex reasoning tasks, particularly in relational reasoning problems such as kinship or spatial reasoning. In this paper, we present Path-of-Thoughts…

Computation and Language · Computer Science 2026-03-25 Ge Zhang , Mohammad Ali Alomrani , Hongjian Gu , Jiaming Zhou , Yaochen Hu , Bin Wang , Qun Liu , Mark Coates , Yingxue Zhang , Jianye Hao

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

Computation and Language · Computer Science 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan

Large language models (LLMs) have demonstrated impressive capability in reasoning and planning when integrated with tree-search-based prompting methods. However, since these methods ignore the previous search experiences, they often make…

Computation and Language · Computer Science 2024-07-19 Wenyang Hui , Kewei Tu

Large language models (LLMs) have achieved remarkable progress on mathematical tasks through Chain-of-Thought (CoT) reasoning. However, existing mathematical CoT datasets often suffer from Thought Leaps due to experts omitting intermediate…

Computation and Language · Computer Science 2025-12-01 Haolei Xu , Yuchen Yan , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Shengpei Jiang , Kaitao Song , Weiming Lu , Jun Xiao , Yueting Zhuang

Chain-of-Thought (CoT) technique has proven effective in improving the performance of large language models (LLMs) on complex reasoning tasks. However, the performance gains are inconsistent across different tasks, and the underlying…

Computation and Language · Computer Science 2025-06-09 Peijie Liu , Fengli Xu , Yong Li

Large Language Models (LLMs) have demonstrated strong reasoning capabilities through \emph{Chain-of-Thought} (CoT) prompting, which enables step-by-step intermediate reasoning. However, explicit CoT methods rely on discrete token-level…

Computation and Language · Computer Science 2025-11-11 Zhikang Chen , Sen Cui , Deheng Ye , Yu Zhang , Yatao Bian , Tingting Zhu

Chain of Thought (CoT) is significant in improving the reasoning abilities of large language models (LLMs). However, the correlation between the effectiveness of CoT and the length of reasoning steps in prompts remains largely unknown. To…

Computation and Language · Computer Science 2024-06-25 Mingyu Jin , Qinkai Yu , Dong Shu , Haiyan Zhao , Wenyue Hua , Yanda Meng , Yongfeng Zhang , Mengnan Du

Chain-of-thought (CoT) prompting is a common technique for improving the reasoning abilities of large language models (LLMs). However, extended reasoning is often unnecessary and substantially increases token usage. As such, a key question…

Computation and Language · Computer Science 2026-01-09 Samuel Lewis-Lim , Xingwei Tan , Zhixue Zhao , Nikolaos Aletras

Chain-of-Thought (CoT) reasoning successfully enhances the reasoning capabilities of Large Language Models (LLMs), yet it incurs substantial computational overhead for inference. Existing CoT compression methods often suffer from a critical…

Machine Learning · Computer Science 2026-05-26 Yuntian Tang , Bohan Jia , Wenxuan Huang , Lianyue Zhang , Jiao Xie , Wenxi Li , Wei Li , Jie Hu , Xinghao Chen Rongrong Ji , Shaohui Lin

Chain-of-Thought (CoT) prompting can effectively elicit complex multi-step reasoning from Large Language Models~(LLMs). For example, by simply adding CoT instruction ``Let's think step-by-step'' to each input query of MultiArith dataset,…

Artificial Intelligence · Computer Science 2023-04-19 Jiuhai Chen , Lichang Chen , Heng Huang , Tianyi Zhou