English
Related papers

Related papers: Chain-of-Thought Matters: Improving Long-Context L…

200 papers

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

Computation and Language · Computer Science 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Requiring a large language model (LLM) to generate intermediary reasoning steps, known as Chain of Thought (CoT), has been shown to be an effective way of boosting performance. Previous approaches have focused on generating multiple…

Computation and Language · Computer Science 2025-05-28 Haritz Puerto , Tilek Chubakov , Xiaodan Zhu , Harish Tayyar Madabushi , Iryna Gurevych

Chain-of-Thought (CoT) prompting significantly enhances large language models' (LLMs) problem-solving capabilities, but still struggles with complex multi-hop questions, often falling into circular reasoning patterns or deviating from the…

Computation and Language · Computer Science 2026-02-20 Chao Wan , Albert Gong , Mihir Mishra , Carl-Leander Henneking , Claas Beger , Kilian Q. Weinberger

Recently, o1-like models have drawn significant attention, where these models produce the long Chain-of-Thought (CoT) reasoning steps to improve the reasoning abilities of existing Large Language Models (LLMs). In this paper, to understand…

Computation and Language · Computer Science 2025-04-01 Yancheng He , Shilong Li , Jiaheng Liu , Weixun Wang , Xingyuan Bu , Ge Zhang , Zhongyuan Peng , Zhaoxiang Zhang , Zhicheng Zheng , Wenbo Su , Bo Zheng

Chain-of-Thought (CoT) prompting has achieved remarkable success in unlocking the reasoning capabilities of Large Language Models (LLMs). Although CoT prompting enhances reasoning, its verbosity imposes substantial computational overhead.…

Computation and Language · Computer Science 2026-04-21 Yifan Wang , Shiyu Li , Peiming Li , Xiaochen Yang , Yang Tang , Zheng Wei

Equipped with Chain-of-Thought (CoT), Large language models (LLMs) have shown impressive reasoning ability in various downstream tasks. Even so, suffering from hallucinations and the inability to access external knowledge, LLMs often come…

Computation and Language · Computer Science 2023-10-31 Keheng Wang , Feiyu Duan , Sirui Wang , Peiguang Li , Yunsen Xian , Chuantao Yin , Wenge Rong , Zhang Xiong

Chain of Thought (CoT) of multi-step benefits from the logical structure of the reasoning steps and task-specific actions, significantly enhancing the mathematical reasoning capabilities of large language models. As the prevalence of long…

Artificial Intelligence · Computer Science 2025-03-07 Wen Yang , Minpeng Liao , Kai Fan

Chain-of-Thought (CoT) reasoning, which breaks down complex tasks into intermediate reasoning steps, has significantly enhanced the performance of large language models (LLMs) on challenging tasks. However, the detailed reasoning process in…

Computation and Language · Computer Science 2025-02-20 Yingqian Cui , Pengfei He , Jingying Zeng , Hui Liu , Xianfeng Tang , Zhenwei Dai , Yan Han , Chen Luo , Jing Huang , Zhen Li , Suhang Wang , Yue Xing , Jiliang Tang , Qi He

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

Computation and Language · Computer Science 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Chain-of-Thought (CoT) reasoning successfully enhances the reasoning capabilities of Large Language Models (LLMs), yet it incurs substantial computational overhead for inference. Existing CoT compression methods often suffer from a critical…

Machine Learning · Computer Science 2026-05-26 Yuntian Tang , Bohan Jia , Wenxuan Huang , Lianyue Zhang , Jiao Xie , Wenxi Li , Wei Li , Jie Hu , Xinghao Chen Rongrong Ji , Shaohui Lin

Chain of thought (CoT) is a reasoning framework that can enhance the performance of Large Language Models (LLMs) on complex inference tasks. In particular, among various studies related to CoT, multi-path inference stands out as a simple…

Computation and Language · Computer Science 2024-12-31 Ziqi Zhang , Cunxiang Wang , Xiong Xiao , Yue Zhang , Donglin Wang

Chain-of-thought (CoT) significantly enhances the reasoning performance of large language models (LLM). While current theoretical studies often attribute this improvement to increased expressiveness and computational capacity, we argue that…

Machine Learning · Computer Science 2025-03-06 Kaiyue Wen , Huaqing Zhang , Hongzhou Lin , Jingzhao Zhang

Chain-of-Thought (CoT) prompting has marked a significant advancement in enhancing the reasoning capabilities of large language models (LLMs). Previous studies have developed various extensions of CoT, which focus primarily on enhancing…

Computation and Language · Computer Science 2025-05-20 Xin Xu , Shizhe Diao , Can Yang , Yang Wang

In recent years, large language models (LLMs) have demonstrated significant potential in complex reasoning tasks like mathematical problem-solving. However, existing research predominantly relies on reinforcement learning (RL) frameworks…

Machine Learning · Computer Science 2026-01-12 ShaoZhen Liu , Xinting Huang , Houwen Peng , Xin Chen , Xinyang Song , Qi Li , Zhenan Sun

Chain-of-thought (CoT), tree-of-thought (ToT), and related techniques work surprisingly well in practice for some complex reasoning tasks with Large Language Models (LLMs), but why? This work seeks the underlying reasons by conducting…

Artificial Intelligence · Computer Science 2024-06-19 Liwei Kang , Zirui Zhao , David Hsu , Wee Sun Lee

Large Language Models (LLMs) face significant accuracy degradation due to insufficient reasoning ability when dealing with complex and abstract tasks. Thought structures such as Chain of Thought (CoT) and Tree of Thought (ToT) focus on…

Computation and Language · Computer Science 2025-09-29 Fengxiao Tang , Yufeng Li , Zongzong Wu , Ming Zhao

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

Computation and Language · Computer Science 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. Although some prompting methods, such as Chain-of-Thought, can…

Computation and Language · Computer Science 2025-02-10 Tongxuan Liu , Wenjiang Xu , Weizhe Huang , Yuting Zeng , Jiaxing Wang , Xingyu Wang , Hailong Yang , Jing Li

Recent Large Reasoning Models (LRMs), such as DeepSeek-R1 and OpenAI o1, have demonstrated strong performance gains by scaling up the length of Chain-of-Thought (CoT) reasoning during inference. However, a growing concern lies in their…

Large reasoning models (LRMs) increasingly rely on step-by-step Chain-of-Thought (CoT) reasoning to improve task performance, particularly in high-resource languages such as English. While recent work has examined final-answer accuracy in…

Computation and Language · Computer Science 2025-10-13 Raoyuan Zhao , Yihong Liu , Hinrich Schütze , Michael A. Hedderich
‹ Prev 1 3 4 5 6 7 10 Next ›