English
Related papers

Related papers: Boosting Logical Reasoning in Large Language Model…

200 papers

Chain-of-thought (CoT) prompting enables large language models (LLMs) to solve complex reasoning tasks by generating an explanation before the final prediction. Despite it's promising ability, a critical downside of CoT prompting is that…

Computation and Language · Computer Science 2023-03-08 Seungone Kim , Se June Joo , Yul Jang , Hyungjoo Chae , Jinyoung Yeo

Large language model (LLM) performance on reasoning problems typically does not generalize out of distribution. Previous work has claimed that this can be mitigated with chain of thought prompting-a method of demonstrating solution…

Artificial Intelligence · Computer Science 2025-03-13 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

Enhancing the reasoning capabilities of Large Language Models remains a critical challenge in artificial intelligence. We introduce RDoLT, Recursive Decomposition of Logical Thought prompting, a novel framework that significantly boosts LLM…

Computation and Language · Computer Science 2025-01-07 Kaleem Ullah Qasim , Jiashu Zhang , Tariq Alsahfi , Ateeq Ur Rehman Butt

Chain of Thought (CoT) prompting has been shown to significantly improve the performance of large language models (LLMs), particularly in arithmetic and reasoning tasks, by instructing the model to produce intermediate reasoning steps.…

Machine Learning · Computer Science 2025-03-03 Jianhao Huang , Zixuan Wang , Jason D. Lee

Large language models (LLMs) have achieved remarkable progress on mathematical tasks through Chain-of-Thought (CoT) reasoning. However, existing mathematical CoT datasets often suffer from Thought Leaps due to experts omitting intermediate…

Computation and Language · Computer Science 2025-12-01 Haolei Xu , Yuchen Yan , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Shengpei Jiang , Kaitao Song , Weiming Lu , Jun Xiao , Yueting Zhuang

Mental illness remains one of the most critical public health issues of our time, due to the severe scarcity and accessibility limit of professionals. Psychotherapy requires high-level expertise to conduct deep, complex reasoning and…

Computation and Language · Computer Science 2023-10-12 Zhiyu Chen , Yujie Lu , William Yang Wang

Chain-of-Thought (CoT) prompting can enhance the reasoning capabilities of large language models (LLMs), establishing itself as a primary approach to solving complex reasoning tasks. Existing CoT synthesis approaches usually focus on…

Computation and Language · Computer Science 2024-03-22 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

Retrieval-Augmented Generation (RAG) has become a robust framework for enhancing Large Language Models (LLMs) with external knowledge. Recent advances in RAG have investigated graph based retrieval for intricate reasoning; however, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tejas Sarnaik , Manan Shah , Ravi Hegde

Chain-of-Thought (CoT) technique has proven effective in improving the performance of large language models (LLMs) on complex reasoning tasks. However, the performance gains are inconsistent across different tasks, and the underlying…

Computation and Language · Computer Science 2025-06-09 Peijie Liu , Fengli Xu , Yong Li

This paper evaluates the visualization literacy of modern Large Language Models (LLMs) and introduces a novel prompting technique called Charts-of-Thought. We tested three state-of-the-art LLMs (Claude-3.7-sonnet, GPT-4.5 preview, and…

Human-Computer Interaction · Computer Science 2025-12-11 Amit Kumar Das , Mohammad Tarun , Klaus Mueller

The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study.…

Human-Computer Interaction · Computer Science 2026-01-27 Runtao Zhou , Giang Nguyen , Nikita Kharya , Anh Totti Nguyen , Chirag Agarwal

Chain-of-Thought (CoT) Prompting is a dominant paradigm in Large Language Models (LLMs) to enhance complex reasoning. It guides LLMs to present multi-step reasoning, rather than generating the final answer directly. However, CoT encounters…

Computation and Language · Computer Science 2025-09-25 Dong-Hai Zhu , Yu-Jie Xiong , Jia-Chen Zhang , Xi-Jiong Xie , Chun-Ming Xia

This paper addresses two limitations of large language models (LLMs) in solving complex problems: (1) their reasoning processes exhibit Bayesian-like stochastic generation, where each token is sampled from a context-dependent probability…

Artificial Intelligence · Computer Science 2026-04-20 Lei Lin , Jizhao Zhu , Yong Liu , Donghong Sun , Hongbo He , Yihua Du

Chain-of-Thought (CoT) reasoning successfully enhances the reasoning capabilities of Large Language Models (LLMs), yet it incurs substantial computational overhead for inference. Existing CoT compression methods often suffer from a critical…

Machine Learning · Computer Science 2026-05-26 Yuntian Tang , Bohan Jia , Wenxuan Huang , Lianyue Zhang , Jiao Xie , Wenxi Li , Wei Li , Jie Hu , Xinghao Chen Rongrong Ji , Shaohui Lin

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

Large language models (LLMs) can achieve highly effective performance on various reasoning tasks by incorporating step-by-step chain-of-thought (CoT) prompting as demonstrations. However, the reasoning chains of demonstrations generated by…

Computation and Language · Computer Science 2024-03-18 Jiashuo Sun , Yi Luo , Yeyun Gong , Chen Lin , Yelong Shen , Jian Guo , Nan Duan

Chain-of-Thought (CoT) reasoning, which breaks down complex tasks into intermediate reasoning steps, has significantly enhanced the performance of large language models (LLMs) on challenging tasks. However, the detailed reasoning process in…

Computation and Language · Computer Science 2025-02-20 Yingqian Cui , Pengfei He , Jingying Zeng , Hui Liu , Xianfeng Tang , Zhenwei Dai , Yan Han , Chen Luo , Jing Huang , Zhen Li , Suhang Wang , Yue Xing , Jiliang Tang , Qi He

Think about how human handles complex reading tasks: marking key points, inferring their relationships, and structuring information to guide understanding and responses. Likewise, can a large language model benefit from text structure to…

Computation and Language · Computer Science 2026-03-05 Qinsi Wang , Hancheng Ye , Jinhee Kim , Jinghan Ke , Yifei Wang , Martin Kuo , Zishan Shao , Dongting Li , Yueqian Lin , Ting Jiang , Chiyue Wei , Qi Qian , Wei Wen , Helen Li , Yiran Chen

Chain-of-Thought (CoT) prompting enhances the reasoning of large language models (LLMs) by decomposing problems into sequential steps, mimicking human logic and reducing errors. However, complex tasks with vast solution spaces and vague…

Computation and Language · Computer Science 2025-12-23 Chenghao Li , Chaoning Zhang , Yi Lu , Jiaquan Zhang , Qigan Sun , Xudong Wang , Jiwei Wei , Guoqing Wang , Yang Yang , Heng Tao Shen

Chain of Thought (CoT) reasoning has demonstrated remarkable deep reasoning capabilities in both large language models (LLMs) and multimodal large language models (MLLMs). However, its reliability is often undermined by the accumulation of…

Artificial Intelligence · Computer Science 2025-11-26 Zijun Chen , Wenbo Hu , Richang Hong