中文
相关论文

相关论文: Deductive Verification of Chain-of-Thought Reasoni…

200 篇论文

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

计算与语言 · 计算机科学 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Chain-of-thought (CoT) reasoning is useful for monitoring language models only when the reasoning trace faithfully reflects the computation that produces the final answer. However, models can rely on prompt-to-answer shortcuts that bypass…

机器学习 · 计算机科学 2026-05-26 Jinghan Jia , Joe Benton , Eric Easley

Chain-of-thought (CoT) is a method that enables language models to handle complex reasoning tasks by decomposing them into simpler steps. Despite its success, the underlying mechanics of CoT are not yet fully understood. In an attempt to…

机器学习 · 计算机科学 2023-11-09 Yingcong Li , Kartik Sreenivasan , Angeliki Giannou , Dimitris Papailiopoulos , Samet Oymak

Chain-of-thought (CoT) reasoning has emerged as an effective approach for activating latent capabilities in LLMs. Interestingly, we observe that both CoT reasoning and self-training share the core objective: iteratively leveraging…

计算与语言 · 计算机科学 2025-05-27 Zongqian Wu , Baoduo Xu , Ruochen Cui , Mengmeng Zhan , Xiaofeng Zhu , Lei Feng

While chain-of-thought (CoT) distillation from advanced large language models (LLMs) has proven effective in general reasoning tasks, it struggles in scientific domains where even advanced models often produce incorrect or superficial…

计算与语言 · 计算机科学 2025-10-17 Kehua Feng , Keyan Ding , Zhihui Zhu , Lei Liang , Qiang Zhang , Huajun Chen

Despite significant advancements in the general capability of large language models (LLMs), they continue to struggle with consistent and accurate reasoning, especially in complex tasks such as mathematical and code reasoning. One key…

机器学习 · 计算机科学 2024-10-10 Zhenwen Liang , Ye Liu , Tong Niu , Xiangliang Zhang , Yingbo Zhou , Semih Yavuz

Large language models (LLMs) exhibit strong reasoning abilities, often attributed to few-shot or zero-shot chain-of-thought (CoT) prompting. While effective, these methods require labor-intensive prompt engineering, raising the question of…

计算与语言 · 计算机科学 2025-03-19 Hyunbin Jin , Je Won Yeom , Seunghyun Bae , Taesup Kim

A common approach to hallucination detection casts it as a natural language inference (NLI) task, often using LLMs to classify whether the generated text is entailed by corresponding reference texts. Since entailment classification is a…

计算与语言 · 计算机科学 2025-06-06 Ron Eliav , Arie Cattan , Eran Hirsch , Shahaf Bassan , Elias Stengel-Eskin , Mohit Bansal , Ido Dagan

Large Language Models (LLMs) have demonstrated remarkable abilities across various language tasks, but solving complex reasoning problems remains a significant challenge. While existing methods, such as Chain-of-Thought (CoT) and…

计算与语言 · 计算机科学 2025-04-02 Zhenni Bi , Kai Han , Chuanjian Liu , Yehui Tang , Yunhe Wang

Chain-of-Thought reasoning can enhance large language models, but it requires manually designed prompts to guide the model. Recently proposed CoT-decoding enables the model to generate CoT-style reasoning paths without prompts, but it is…

计算与语言 · 计算机科学 2026-04-09 Guanran Luo , Wentao Qiu , Zhongquan Jian , Meihong Wang , Qingqiang Wu

The Chain-of-Thought (CoT) paradigm has emerged as a critical approach for enhancing the reasoning capabilities of large language models (LLMs). However, despite their widespread adoption and success, CoT methods often exhibit instability…

人工智能 · 计算机科学 2024-09-06 Yu Wang , Shiwan Zhao , Zhihu Wang , Heyuan Huang , Ming Fan , Yubo Zhang , Zhixing Wang , Haijun Wang , Ting Liu

Chain-of-Thought (CoT) reasoning has emerged as a powerful tool for enhancing the problem-solving capabilities of large language models (LLMs). However, the theoretical foundations of learning from CoT data remain underdeveloped, and…

人工智能 · 计算机科学 2025-07-29 Shai Shalev-Shwartz , Amnon Shashua

Large Language Models (LLMs) have revolutionized natural language processing and hold immense potential for advancing Artificial Intelligence. However, the core architecture of most mainstream LLMs -- the Transformer -- has inherent…

计算与语言 · 计算机科学 2024-10-21 Xiang Zhang , Dujian Ding

Chain-of-Thought (CoT) prompting has been shown to enhance the multi-step reasoning capabilities of Large Language Models (LLMs). However, debates persist about whether LLMs exhibit abstract generalization or rely on shallow heuristics when…

计算与语言 · 计算机科学 2024-10-07 Akshara Prabhakar , Thomas L. Griffiths , R. Thomas McCoy

Chain of Thought (CoT) of multi-step benefits from the logical structure of the reasoning steps and task-specific actions, significantly enhancing the mathematical reasoning capabilities of large language models. As the prevalence of long…

人工智能 · 计算机科学 2025-03-07 Wen Yang , Minpeng Liao , Kai Fan

The reasoning performance of Large Language Models (LLMs) on a wide range of problems critically relies on chain-of-thought prompting, which involves providing a few chain of thought demonstrations as exemplars in prompts. Recent work,…

计算与语言 · 计算机科学 2025-01-08 Sijia Chen , Baochun Li , Di Niu

Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks. However, the quality and coherence of the reasoning process can still benefit from enhanced…

计算与语言 · 计算机科学 2025-01-24 Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Tianhao Xu

Large Language Models (LLMs) (e.g., ChatGPT) have shown impressive performance in code generation. LLMs take prompts as inputs, and Chain-of-Thought (CoT) prompting is the state-of-the-art prompting technique. CoT prompting asks LLMs first…

软件工程 · 计算机科学 2023-09-08 Jia Li , Ge Li , Yongmin Li , Zhi Jin

Chain-of-thought (CoT) prompting enables large language models (LLMs) to solve complex reasoning tasks by generating an explanation before the final prediction. Despite it's promising ability, a critical downside of CoT prompting is that…

计算与语言 · 计算机科学 2023-03-08 Seungone Kim , Se June Joo , Yul Jang , Hyungjoo Chae , Jinyoung Yeo

Chain-of-Thought (CoT) prompting and its variants have gained popularity as effective methods for solving multi-step reasoning problems using pretrained large language models (LLMs). In this work, we analyze CoT prompting from a statistical…

人工智能 · 计算机科学 2024-08-29 Xinyang Hu , Fengzhuo Zhang , Siyu Chen , Zhuoran Yang