English
Related papers

Related papers: Error Reflection Prompting: Can Large Language Mod…

200 papers

Instructing the model to generate a sequence of intermediate steps, a.k.a., a chain of thought (CoT), is a highly effective method to improve the accuracy of large language models (LLMs) on arithmetics and symbolic reasoning tasks. However,…

Machine Learning · Computer Science 2024-09-24 Zhiyuan Li , Hong Liu , Denny Zhou , Tengyu Ma

Chain-of-Thought (CoT) prompting has emerged as a powerful technique for enhancing language model's reasoning capabilities. However, generating long and correct CoT trajectories is challenging. Recent studies have demonstrated that Looped…

Computation and Language · Computer Science 2025-02-13 Qifan Yu , Zhenyu He , Sijie Li , Xun Zhou , Jun Zhang , Jingjing Xu , Di He

Chain-of-thought (CoT) prompting, which offers step-by-step problem-solving rationales, has impressively unlocked the reasoning potential of large language models (LLMs). Yet, the standard CoT is less effective in problems demanding…

Computation and Language · Computer Science 2024-05-09 Song Jiang , Zahra Shakeri , Aaron Chan , Maziar Sanjabi , Hamed Firooz , Yinglong Xia , Bugra Akyildiz , Yizhou Sun , Jinchao Li , Qifan Wang , Asli Celikyilmaz

Recent advancements in large language models (LLMs) have significantly advanced complex reasoning capabilities, particularly through extended chain-of-thought (CoT) reasoning that incorporates mechanisms such as backtracking,…

Computation and Language · Computer Science 2025-10-21 Baohao Liao , Xinyi Chen , Sara Rajaee , Yuhui Xu , Christian Herold , Anders Søgaard , Maarten de Rijke , Christof Monz

Referring Expression Comprehension and Segmentation are critical tasks for assessing the integration of language understanding and image comprehension, serving as benchmarks for Multimodal Large Language Models (MLLMs) capabilities. To…

Computation and Language · Computer Science 2026-01-21 Qihua Dong , Luis Figueroa , Handong Zhao , Kushal Kafle , Jason Kuen , Zhihong Ding , Scott Cohen , Yun Fu

Chain-of-thought (CoT) prompting with large language models has proven effective in numerous natural language processing tasks, but designing prompts that generalize well to diverse problem types can be challenging, especially in the…

Computation and Language · Computer Science 2023-06-12 Zhanming Jie , Wei Lu

Few-shot Chain-of-Thought (CoT) prompting has demonstrated strong performance in improving the reasoning capabilities of large language models (LLMs). While theoretical investigations have been conducted to understand CoT, the underlying…

Computation and Language · Computer Science 2024-10-23 Yingqian Cui , Pengfei He , Xianfeng Tang , Qi He , Chen Luo , Jiliang Tang , Yue Xing

Empathetic response generation endows agents with the capability to comprehend dialogue contexts and react to expressed emotions. Previous works predominantly focus on leveraging the speaker's emotional labels, but ignore the importance of…

Computation and Language · Computer Science 2024-08-22 Xinhao Chen , Chong Yang , Man Lan , Li Cai , Yang Chen , Tu Hu , Xinlin Zhuang , Aimin Zhou

Chain-of-Thought (CoT) prompting has achieved remarkable success in unlocking the reasoning capabilities of Large Language Models (LLMs). Although CoT prompting enhances reasoning, its verbosity imposes substantial computational overhead.…

Computation and Language · Computer Science 2026-04-21 Yifan Wang , Shiyu Li , Peiming Li , Xiaochen Yang , Yang Tang , Zheng Wei

Large language models can perform various reasoning tasks by using chain-of-thought prompting, which guides them to find answers through step-by-step demonstrations. However, the quality of the prompts depends on the demonstrations given to…

Computation and Language · Computer Science 2023-02-02 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

Large language models (LLMs) are often constrained by rigid reasoning processes, limiting their ability to generate creative and diverse responses. To address this, a novel framework called LADDER is proposed, combining Chain-of-Thought…

Computation and Language · Computer Science 2025-06-17 Xintong Tang , Meiru Zhang , Shang Xiao , Junzhao Jin , Zihan Zhao , Liwei Li , Yang Zheng , Bangyi Wu

Despite the remarkable reasoning performance, eliciting the long chain-of-thought (CoT) ability in large language models (LLMs) typically requires costly reinforcement learning or supervised fine-tuning on high-quality distilled data. We…

Computation and Language · Computer Science 2025-05-26 Zekai Zhao , Qi Liu , Kun Zhou , Zihan Liu , Yifei Shao , Zhiting Hu , Biwei Huang

We introduce Reprompting, an iterative sampling algorithm that automatically learns the Chain-of-Thought (CoT) recipes for a given task without human intervention. Through Gibbs sampling, Reprompting infers the CoT recipes that work…

Machine Learning · Computer Science 2024-05-27 Weijia Xu , Andrzej Banburski-Fahey , Nebojsa Jojic

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Chain-of-thought (CoT) prompting has been widely adopted to enhance the reasoning capabilities of large language models (LLMs). However, the effectiveness of CoT reasoning is inconsistent across tasks with different reasoning types. This…

Machine Learning · Computer Science 2025-06-17 Yue Wan , Xiaowei Jia , Xiang Lorraine Li

Large language models exhibit high-level commonsense reasoning abilities, especially with enhancement methods like Chain-of-Thought (CoT). However, we find these CoT-like methods lead to a considerable number of originally correct answers…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

Chain-of-thought (CoT) prompting enhances reasoning in large language models (LLMs) but often leads to verbose and redundant outputs, thus increasing inference cost. We hypothesize that many reasoning steps are unnecessary for producing…

Computation and Language · Computer Science 2025-09-30 Xin Liu , Lu Wang

We study the task of prompting large-scale language models to perform multi-step reasoning. Existing work shows that when prompted with a chain of thoughts (CoT), sequences of short sentences describing intermediate reasoning steps towards…

Computation and Language · Computer Science 2023-01-31 Yao Fu , Hao Peng , Ashish Sabharwal , Peter Clark , Tushar Khot

In the era of large-scale artificial intelligence, Large Language Models (LLMs) have made significant strides in natural language processing. However, they often lack transparency and generate unreliable outputs, raising concerns about…

Computation and Language · Computer Science 2025-06-25 Zhenke Duan , Jiqun Pan , Jiani Tu , Xiaoyi Wang , Yanqing Wang

Large Language Models (LLMs) have shown impressive performance in complex reasoning tasks through the use of Chain-of-Thought (CoT) reasoning, allowing models to break down problems into manageable sub-tasks. However, existing CoT…

Computation and Language · Computer Science 2025-07-11 Jean-Francois Ton , Muhammad Faaiz Taufiq , Yang Liu