English
Related papers

Related papers: Focused Chain-of-Thought: Efficient LLM Reasoning …

200 papers

Large language models (LLMs) have achieved commendable accomplishments in various natural language processing tasks. However, LLMs still encounter significant challenges when dealing with complex scenarios involving multiple entities. These…

Computation and Language · Computer Science 2024-06-07 Yanming Liu , Xinyue Peng , Tianyu Du , Jianwei Yin , Weihao Liu , Xuhong Zhang

With the widespread use of language models (LMs) in NLP tasks, researchers have discovered the potential of Chain-of-thought (CoT) to assist LMs in accomplishing complex reasoning tasks by generating intermediate steps. However, human…

Computation and Language · Computer Science 2024-03-26 Yao Yao , Zuchao Li , Hai Zhao

Chain-of-Thought prompting has significantly enhanced the reasoning capabilities of large language models, with numerous studies exploring factors influencing its performance. However, the underlying mechanisms remain poorly understood. To…

Artificial Intelligence · Computer Science 2024-12-06 Hao Yang , Qianghua Zhao , Lei Li

Chain of Thought (CoT) reasoning enhances language models' performance but often leads to inefficient "overthinking" on simple problems. We identify that existing approaches directly penalizing reasoning length fail to account for varying…

Computation and Language · Computer Science 2025-05-22 Junjie Yang , Ke Lin , Xing Yu

Reasoning-enhanced large language models (RLLMs), whether explicitly trained for reasoning or prompted via chain-of-thought (CoT), have achieved state-of-the-art performance on many complex reasoning tasks. However, we uncover a surprising…

Computation and Language · Computer Science 2025-09-03 Xiaomin Li , Zhou Yu , Zhiwei Zhang , Xupeng Chen , Ziji Zhang , Yingying Zhuang , Narayanan Sadagopan , Anurag Beniwal

Chain-of-Thought (CoT) has been a widely adopted prompting method, eliciting impressive reasoning abilities of Large Language Models (LLMs). Inspired by the sequential thought structure of CoT, a number of Chain-of-X (CoX) methods have been…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Rui Wang , Xu Liu , Mingyan Li , Tong Yu , Xiang Chen , Julian McAuley , Shuai Li

Large Language Models (LLMs) have recently demonstrated exceptional performance in various Natural Language Processing (NLP) tasks. They have also shown the ability to perform chain-of-thought (CoT) reasoning to solve complex problems.…

Computation and Language · Computer Science 2023-12-19 Lei Wang , Yi Hu , Jiabang He , Xing Xu , Ning Liu , Hui Liu , Heng Tao Shen

Large Language Models (LLMs) have ushered in a transformative era in the field of natural language processing, excelling in tasks related to text comprehension and generation. Nevertheless, they encounter difficulties when confronted with…

Computation and Language · Computer Science 2023-11-16 Yucheng Zhou , Xiubo Geng , Tao Shen , Chongyang Tao , Guodong Long , Jian-Guang Lou , Jianbing Shen

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

Machine Learning · Computer Science 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

Chain-of-Thought (CoT) reasoning, which breaks down complex tasks into intermediate reasoning steps, has significantly enhanced the performance of large language models (LLMs) on challenging tasks. However, the detailed reasoning process in…

Computation and Language · Computer Science 2025-02-20 Yingqian Cui , Pengfei He , Jingying Zeng , Hui Liu , Xianfeng Tang , Zhenwei Dai , Yan Han , Chen Luo , Jing Huang , Zhen Li , Suhang Wang , Yue Xing , Jiliang Tang , Qi He

Exploiting large language models (LLMs) to tackle reasoning has garnered growing attention. It still remains highly challenging to achieve satisfactory results in complex logical problems, characterized by plenty of premises within the…

Computation and Language · Computer Science 2025-03-17 Junjie Liu , Shaotian Yan , Chen Shen , Zhengdong Xiao , Liang Xie , Wenxiao Wang , Jieping Ye

While Chain-of-Thought (CoT) prompting advances LLM reasoning, challenges persist in consistency, accuracy, and self-correction, especially for complex or ethically sensitive tasks. Existing single-dimensional reflection methods offer…

Computation and Language · Computer Science 2026-01-13 Mariana Costa , Alberlucia Rafael Soarez , Daniel Kim , Camila Ferreira

Large language models (LLMs) can now solve complex problems through long chain-of-thought (CoT) reasoning, but the trade-off between performance and token cost remains a central challenge. To address this issue, supervised fine-tuning (SFT)…

Artificial Intelligence · Computer Science 2026-05-28 Kohsei Matsutani , Gouki Minegishi , Takeshi Kojima , Yusuke Iwasawa , Yutaka Matsuo

Large language models (LLMs) can effectively handle outdated information through knowledge editing. However, current approaches face two key limitations: (I) Poor generalization: Most approaches rigidly inject new knowledge without ensuring…

Computation and Language · Computer Science 2026-04-08 Jinhu Fu , Yan Bai , Longzhu He , Yihang Lou , Yanxiao Zhao , Li Sun , Sen Su

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT heavily relies on the…

Computation and Language · Computer Science 2023-11-03 Jingyuan Qi , Zhiyang Xu , Ying Shen , Minqian Liu , Di Jin , Qifan Wang , Lifu Huang

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Chain-of-thought (CoT) prompting demonstrates varying performance under different reasoning tasks. Previous work attempts to evaluate it but falls short in providing an in-depth analysis of patterns that influence the CoT. In this paper, we…

Computation and Language · Computer Science 2025-06-03 Jiachun Li , Pengfei Cao , Yubo Chen , Jiexin Xu , Huaijun Li , Xiaojian Jiang , Kang Liu , Jun Zhao

Large reasoning models (LRMs) increasingly rely on step-by-step Chain-of-Thought (CoT) reasoning to improve task performance, particularly in high-resource languages such as English. While recent work has examined final-answer accuracy in…

Computation and Language · Computer Science 2025-10-13 Raoyuan Zhao , Yihong Liu , Hinrich Schütze , Michael A. Hedderich

Large language models (LLMs) show strong reasoning via chain-of-thought (CoT) prompting, but the process is opaque, which makes verification, debugging, and control difficult in high-stakes settings. We present Vis-CoT, a human-in-the-loop…

Computation and Language · Computer Science 2025-12-30 Kaviraj Pather , Elena Hadjigeorgiou , Arben Krasniqi , Claire Schmit , Irina Rusu , Marc Pons , Kabir Khan

Recent advances in large language models (LLMs) have opened new possibilities for automated reasoning and decision-making in wireless networks. However, applying LLMs to wireless communications presents challenges such as limited capability…

Networking and Internet Architecture · Computer Science 2025-05-29 Xudong Wang , Jian Zhu , Ruichen Zhang , Lei Feng , Dusit Niyato , Jiacheng Wang , Hongyang Du , Shiwen Mao , Zhu Han
‹ Prev 1 8 9 10 Next ›