中文
相关论文

相关论文: Boosting Logical Reasoning in Large Language Model…

200 篇论文

Emergent chain-of-thought (CoT) reasoning capabilities promise to improve performance and explainability of large language models (LLMs). However, uncertainties remain about how reasoning strategies formulated for previous model generations…

计算与语言 · 计算机科学 2023-08-04 Konstantin Hebenstreit , Robert Praas , Louis P Kiesewetter , Matthias Samwald

Chain-of-thought (CoT) prompting for language models demonstrates impressive performance across reasoning tasks, but typically needs labeled exemplars of the reasoning process. In this work, we introduce a new prompting approach, analogical…

机器学习 · 计算机科学 2024-03-12 Michihiro Yasunaga , Xinyun Chen , Yujia Li , Panupong Pasupat , Jure Leskovec , Percy Liang , Ed H. Chi , Denny Zhou

Large language models (LLMs) can perform complex reasoning by generating intermediate reasoning steps. Providing these steps for prompting demonstrations is called chain-of-thought (CoT) prompting. CoT prompting has two major paradigms. One…

计算与语言 · 计算机科学 2022-10-10 Zhuosheng Zhang , Aston Zhang , Mu Li , Alex Smola

The method of training language models based on domain datasets has obtained significant achievements in the task of generating scientific paper abstracts. However, such models face problems of generalization and expensive training costs.…

计算与语言 · 计算机科学 2024-03-27 Xinyu Ning , Yutong Zhao , Yitong Liu , Hongwen Yang

Large Language Models (LLMs) have revolutionized natural language processing and hold immense potential for advancing Artificial Intelligence. However, the core architecture of most mainstream LLMs -- the Transformer -- has inherent…

计算与语言 · 计算机科学 2024-10-21 Xiang Zhang , Dujian Ding

Chain-of-thought (CoT) prompting boosts Large Language Models accuracy on multi-step tasks, yet whether the generated "thoughts" reflect the true internal reasoning process is unresolved. We present the first feature-level causal study of…

计算与语言 · 计算机科学 2025-08-01 Xi Chen , Aske Plaat , Niki van Stein

As language models have become increasingly successful at a wide array of tasks, different prompt engineering methods have been developed alongside them in order to adapt these models to new tasks. One of them is Tree-of-Thoughts (ToT), a…

人机交互 · 计算机科学 2024-09-04 Alan Boyle , Isha Gupta , Sebastian Hönig , Lukas Mautner , Kenza Amara , Furui Cheng , Mennatallah El-Assady

Large language models (LLMs) excel in many tasks in 2023, but they still face challenges in complex reasoning. Theory-of-mind (ToM) tasks, which require understanding agents' beliefs, goals, and mental states, are essential for common-sense…

人工智能 · 计算机科学 2023-04-27 Shima Rahimi Moghaddam , Christopher J. Honey

When presented with questions involving visual thinking, humans naturally switch reasoning modalities, often forming mental images or drawing visual aids. Large language models have shown promising results in arithmetic and symbolic…

计算与语言 · 计算机科学 2024-06-21 Sachit Menon , Richard Zemel , Carl Vondrick

Chain-of-thought (CoT) advances the reasoning abilities of large language models (LLMs) and achieves superior performance in complex reasoning tasks. However, most CoT studies rely on carefully designed human-annotated rational chains to…

计算与语言 · 计算机科学 2024-02-28 KaShun Shum , Shizhe Diao , Tong Zhang

Chain-of-Thought (CoT) prompting has been shown to enhance the multi-step reasoning capabilities of Large Language Models (LLMs). However, debates persist about whether LLMs exhibit abstract generalization or rely on shallow heuristics when…

计算与语言 · 计算机科学 2024-10-07 Akshara Prabhakar , Thomas L. Griffiths , R. Thomas McCoy

We study the task of prompting large-scale language models to perform multi-step reasoning. Existing work shows that when prompted with a chain of thoughts (CoT), sequences of short sentences describing intermediate reasoning steps towards…

计算与语言 · 计算机科学 2023-01-31 Yao Fu , Hao Peng , Ashish Sabharwal , Peter Clark , Tushar Khot

Chain-of-Thought (CoT) has been shown to significantly improve the reasoning accuracy of large language models (LLMs) on complex tasks. However, due to the autoregressive, step-by-step generation paradigm, existing CoT methods suffer from…

Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series…

计算与语言 · 计算机科学 2023-06-02 Boshi Wang , Sewon Min , Xiang Deng , Jiaming Shen , You Wu , Luke Zettlemoyer , Huan Sun

To enhance the multi-step reasoning capabilities of large language models, researchers have extensively explored prompting methods, notably the Chain-of-Thought (CoT) method which explicitly elicits human-like rationales. However, they have…

计算与语言 · 计算机科学 2024-04-19 Zhiheng Xi , Senjie Jin , Yuhao Zhou , Rui Zheng , Songyang Gao , Tao Gui , Qi Zhang , Xuanjing Huang

Existing prompting paradigms structure LLM reasoning in limited topologies: Chain-of-Thought (CoT) produces linear traces, while Tree-of-Thought (ToT) performs branching search. Yet complex reasoning often requires merging intermediate…

计算与语言 · 计算机科学 2026-03-24 Fan Huang

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

Chain-of-Thought (CoT) prompting has significantly improved the reasoning capabilities of large language models (LLMs). However, conventional CoT often relies on unstructured, flat reasoning chains that suffer from redundancy and suboptimal…

计算与语言 · 计算机科学 2026-04-02 Xingshuai Huang , Derek Li , Bahareh Nikpour , Parsa Omidi

Chain-of-Thought (CoT) prompting enables large language models to solve complex reasoning problems by generating intermediate steps. However, confined by its inherent single-pass and sequential generation process, CoT heavily relies on the…

计算与语言 · 计算机科学 2023-11-03 Jingyuan Qi , Zhiyang Xu , Ying Shen , Minqian Liu , Di Jin , Qifan Wang , Lifu Huang

Chain-of-thought (CoT) prompting has achieved remarkable success in natural language processing (NLP). However, its vast potential remains largely unexplored for graphs. This raises an interesting question: How can we design CoT prompting…

计算与语言 · 计算机科学 2025-06-03 Xingtong Yu , Chang Zhou , Zhongwei Kuai , Xinming Zhang , Yuan Fang