English
Related papers

Related papers: Buffer of Thoughts: Thought-Augmented Reasoning wi…

200 papers

Cognitive Reframing, a core element of Cognitive Behavioral Therapy (CBT), helps individuals reinterpret negative experiences by finding positive meaning. Recent advances in Large Language Models (LLMs) have demonstrated improved…

Computation and Language · Computer Science 2025-04-02 Yilin Qi , Dong Won Lee , Cynthia Breazeal , Hae Won Park

Large language models (LLMs) are often constrained by rigid reasoning processes, limiting their ability to generate creative and diverse responses. To address this, a novel framework called LADDER is proposed, combining Chain-of-Thought…

Computation and Language · Computer Science 2025-06-17 Xintong Tang , Meiru Zhang , Shang Xiao , Junzhao Jin , Zihan Zhao , Liwei Li , Yang Zheng , Bangyi Wu

With the widespread use of language models (LMs) in NLP tasks, researchers have discovered the potential of Chain-of-thought (CoT) to assist LMs in accomplishing complex reasoning tasks by generating intermediate steps. However, human…

Computation and Language · Computer Science 2024-03-26 Yao Yao , Zuchao Li , Hai Zhao

Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in…

Computation and Language · Computer Science 2024-09-16 Tianqiao Liu , Zui Chen , Zitao Liu , Mi Tian , Weiqi Luo

Open-source Large Language Models (LLMs) increasingly specialize by domain (e.g., math, code, general reasoning), motivating systems that leverage complementary strengths across models. Prior multi-LLM approaches either (i) route a query to…

Machine Learning · Computer Science 2025-09-26 Jacob Fein-Ashley , Dhruv Parikh , Rajgopal Kannan , Viktor Prasanna

Recent developments have enabled advanced reasoning in Large Language Models (LLMs) via long Chain-of-Thought (CoT), while long CoT suffers from high computational costs and significant latency losses owing to the autoregressive nature of…

Computation and Language · Computer Science 2025-10-13 Chengzhengxu Li , Xiaoming Liu , Zhaohan Zhang , Shaochu Zhang , Shengchao Liu , Guoxin Ma , Yu Lan , Chao Shen

Current Large Language Model-based agents reason within an exploration-evaluation framework, navigating problem-solving processes in a tree-like manner. However, these methods often neglect successful reasoning trajectories once a problem…

Artificial Intelligence · Computer Science 2024-03-12 Jia Liu , Jie Shuai , Xiyao Li

Large reasoning language models such as OpenAI-o1 and Deepseek-R1 have recently attracted widespread attention due to their impressive task-solving abilities. However, the enormous model size and the generation of lengthy thought chains…

Computation and Language · Computer Science 2025-05-27 Jikai Wang , Juntao Li , Jianye Hou , Bowen Yan , Lijun Wu , Min Zhang

Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks. However, the quality and coherence of the reasoning process can still benefit from enhanced…

Computation and Language · Computer Science 2025-01-24 Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Tianhao Xu

Explicit Chain-of-Thought improves the reasoning performance of large language models but often incurs high inference cost due to verbose token-level traces. While recent approaches reduce this overhead via concise prompting or step…

Computation and Language · Computer Science 2026-03-09 Yunlong Chu , Minglai Shao , Yuhang Liu , Bing Hao , Yumeng Lin , Jialu Wang , Ruijie Wang

In information retrieval, large language models (LLMs) have demonstrated remarkable potential in text reranking tasks by leveraging their sophisticated natural language understanding and advanced reasoning capabilities. However,…

Information Retrieval · Computer Science 2025-09-22 Haowei Liu , Xuyang Wu , Guohao Sun , Zhiqiang Tao , Yi Fang

Large Language Models (LLMs) have demonstrated remarkable performance across multiple tasks through in-context learning. For complex reasoning tasks that require step-by-step thinking, Chain-of-Thought (CoT) prompting has given impressive…

Computation and Language · Computer Science 2024-10-10 Armel Zebaze , Benoît Sagot , Rachel Bawden

Generating intermediate steps, or Chain of Thought (CoT), is an effective way to significantly improve language models' (LM) multi-step reasoning capability. However, the CoT lengths can grow rapidly with the problem complexity, easily…

Computation and Language · Computer Science 2023-06-13 Soochan Lee , Gunhee Kim

Large Language Models (LLMs) have demonstrated remarkable performance in solving complex reasoning tasks through mechanisms like Chain-of-Thought (CoT) prompting, which emphasizes verbose, step-by-step reasoning. However, humans typically…

Computation and Language · Computer Science 2025-03-04 Silei Xu , Wenhao Xie , Lingxiao Zhao , Pengcheng He

Chain-of-Thought (CoT) reasoning enables Large Language Models (LLMs) to solve complex reasoning tasks by generating intermediate reasoning steps. However, most existing approaches focus on hard token decoding, which constrains reasoning…

Computation and Language · Computer Science 2025-05-28 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Large language models (LLMs) have transformed AI research thanks to their powerful internal capabilities and knowledge. However, existing LLMs still fail to effectively incorporate the massive external knowledge when interacting with the…

Computation and Language · Computer Science 2026-04-15 Tao Feng , Pengrui Han , Guanyu Lin , Ge Liu , Jiaxuan You

Abstract reasoning, the ability to reason from the abstract essence of a problem, serves as a key to generalization in human reasoning. However, eliciting language models to perform reasoning with abstraction remains unexplored. This paper…

Computation and Language · Computer Science 2024-09-27 Ruixin Hong , Hongming Zhang , Xiaoman Pan , Dong Yu , Changshui Zhang

Recent advances in large language models (LLMs) have enabled strong reasoning capabilities through Chain-of-Thought (CoT) prompting, which elicits step-by-step problem solving, but often at the cost of excessive verbosity in intermediate…

Computation and Language · Computer Science 2025-10-27 Simon A. Aytes , Jinheon Baek , Sung Ju Hwang

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Computation and Language · Computer Science 2025-08-25 Yang Sui , Yu-Neng Chuang , Guanchu Wang , Jiamu Zhang , Tianyi Zhang , Jiayi Yuan , Hongyi Liu , Andrew Wen , Shaochen Zhong , Na Zou , Hanjie Chen , Xia Hu

Recent large language models achieve strong reasoning performance by generating detailed chain-of-thought traces, but this often leads to excessive token use and high inference latency. Existing efficiency approaches typically focus on…

Computation and Language · Computer Science 2025-12-01 Lukas Struppek , Dominik Hintersdorf , Hannah Struppek , Daniel Neider , Kristian Kersting