中文
相关论文

相关论文: It's Not Easy Being Wrong: Large Language Models S…

200 篇论文

Large Language Models (LLMs) have demonstrated impressive mathematical reasoning capabilities, yet their performance remains brittle to minor variations in problem description and prompting strategy. Furthermore, reasoning is vulnerable to…

计算与语言 · 计算机科学 2025-06-23 Sam Silver , Jimin Sun , Ivan Zhang , Sara Hooker , Eddie Kim

We explore the extension of chain-of-thought (CoT) prompting to medical reasoning for the task of automatic diagnosis. Motivated by doctors' underlying reasoning process, we present Diagnostic-Reasoning CoT (DR-CoT). Empirical results…

计算与语言 · 计算机科学 2023-07-19 Cheng-Kuang Wu , Wei-Lin Chen , Hsin-Hsi Chen

Large language models (LLMs) equipped with chain-of-thought (CoT) achieve strong performance and offer a window into LLM behavior. However, recent evidence suggests that improvements in CoT capabilities often come with redundant reasoning…

计算与语言 · 计算机科学 2026-02-03 Yanrui Du , Sendong Zhao , Yibo Gao , Danyang Zhao , Qika Lin , Ming Ma , Jiayun Li , Yi Jiang , Kai He , Qianyi Xu , Bing Qin , Mengling Feng

As chain-of-thought (CoT) has become central to scaling reasoning capabilities in large language models (LLMs), it has also emerged as a promising tool for interpretability, suggesting the opportunity to understand model decisions through…

人工智能 · 计算机科学 2026-03-03 Kyle Cox , Darius Kianersi , Adrià Garriga-Alonso

Large Language Models (LLMs) have revolutionized natural language processing and hold immense potential for advancing Artificial Intelligence. However, the core architecture of most mainstream LLMs -- the Transformer -- has inherent…

计算与语言 · 计算机科学 2024-10-21 Xiang Zhang , Dujian Ding

Large language models (LLMs) have achieved strong performance on medical question answering (medical QA), and chain-of-thought (CoT) prompting has further improved results by eliciting explicit intermediate reasoning; meanwhile,…

计算与语言 · 计算机科学 2026-04-03 Zaifu Zhan , Mengyuan Cui , Rui Zhang

Logical reasoning is a critical benchmark for evaluating the capabilities of large language models (LLMs), as it reflects their ability to derive valid conclusions from given premises. While the combination of test-time scaling with…

计算与语言 · 计算机科学 2025-08-28 Ramya Keerthy Thatikonda , Wray Buntine , Ehsan Shareghi

Large Language Models (LLMs) often exhibit strong linguistic abilities while remaining unreliable on multi-step reasoning tasks, particularly when deployed without additional training or fine-tuning. In this work, we study inference-time…

计算与语言 · 计算机科学 2026-03-24 Vinay Sharma , Manish Jain

Large language models (LLMs) equipped with chain-of-thoughts (CoT) prompting have shown significant multi-step reasoning capabilities in factual content like mathematics, commonsense, and logic. However, their performance in narrative…

计算与语言 · 计算机科学 2024-09-24 Hung-Ting Su , Ya-Ching Hsu , Xudong Lin , Xiang-Qian Shi , Yulei Niu , Han-Yuan Hsu , Hung-yi Lee , Winston H. Hsu

Large Language Models (LLMs) demonstrate the ability to solve reasoning and mathematical problems using the Chain-of-Thought (CoT) technique. Expanding CoT length, as seen in models such as DeepSeek-R1, significantly enhances this reasoning…

计算与语言 · 计算机科学 2025-07-15 Zihao Li , Xu Wang , Yuzhe Yang , Ziyu Yao , Haoyi Xiong , Mengnan Du

Large language models (LLMs) are increasingly used for causal and counterfactual reasoning, yet their reliability in real-world policy evaluation remains underexplored. We construct a benchmark of 40 empirical policy evaluation cases drawn…

人工智能 · 计算机科学 2026-05-29 Yanjie He

While chain-of-thought (CoT) distillation from advanced large language models (LLMs) has proven effective in general reasoning tasks, it struggles in scientific domains where even advanced models often produce incorrect or superficial…

计算与语言 · 计算机科学 2025-10-17 Kehua Feng , Keyan Ding , Zhihui Zhu , Lei Liang , Qiang Zhang , Huajun Chen

Many language tasks can be modeled as classification problems where a large language model (LLM) is given a prompt and selects one among many possible answers. We show that the classification error in such problems scales as a power law in…

机器学习 · 计算机科学 2026-05-22 Amrut Nadgir , Vijay Balasubramanian , Pratik Chaudhari

Chain-of-thought (CoT) advances the reasoning abilities of large language models (LLMs) and achieves superior performance in complex reasoning tasks. However, most CoT studies rely on carefully designed human-annotated rational chains to…

计算与语言 · 计算机科学 2024-02-28 KaShun Shum , Shizhe Diao , Tong Zhang

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

机器学习 · 计算机科学 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

The honesty of large language models (LLMs) is a critical alignment challenge, especially as advanced systems with chain-of-thought (CoT) reasoning may strategically deceive humans. Unlike traditional honesty issues on LLMs, which could be…

人工智能 · 计算机科学 2025-06-06 Kai Wang , Yihao Zhang , Meng Sun

Large Language Models (LLMs) significantly benefit from Chain-of-Thought (CoT) prompting in performing various reasoning tasks. While CoT allows models to produce more comprehensive reasoning processes, its emphasis on intermediate…

计算与语言 · 计算机科学 2023-10-05 Zhan Ling , Yunhao Fang , Xuanlin Li , Zhiao Huang , Mingu Lee , Roland Memisevic , Hao Su

Large Language Models (LLMs) demonstrate strong reasoning capabilities for many tasks, often by explicitly decomposing the task via Chain-of-Thought (CoT) reasoning. Recent work on LLM-based translation designs hand-crafted prompts to…

计算与语言 · 计算机科学 2025-09-24 Di Wu , Seth Aycock , Christof Monz

Chain-of-thought (CoT) reasoning boosts large language models' (LLMs) performance on complex tasks but faces two key limitations: a lack of reliability when solely relying on LLM-generated reasoning chains and lower reasoning performance…

计算与语言 · 计算机科学 2025-09-11 Feiyang Li , Peng Fang , Zhan Shi , Arijit Khan , Fang Wang , Weihao Wang , Xin Zhang , Yongjian Cui

The advancement of Large Language Models (LLMs) has brought substantial attention to the Chain of Thought (CoT) approach, primarily due to its ability to enhance the capability of LLMs on complex reasoning tasks. Moreover, the significance…

计算与语言 · 计算机科学 2024-03-05 Bingshuai Liu , Chenyang Lyu , Zijun Min , Zhanyu Wang , Jinsong Su , Longyue Wang