中文
相关论文

相关论文: Reasoning Large Language Model Errors Arise from H…

200 篇论文

Chain-of-thought (CoT) prompting has become central to mathematical reasoning in large language models, yet models remain brittle to early errors: a single arithmetic slip or unjustified inference typically propagates uncorrected to an…

机器学习 · 计算机科学 2025-12-22 Saraswathy Amjith , Mihika Dusad , Neha Muramalla , Shweta Shah

Large Language Models (LLMs) often exhibit strong linguistic abilities while remaining unreliable on multi-step reasoning tasks, particularly when deployed without additional training or fine-tuning. In this work, we study inference-time…

计算与语言 · 计算机科学 2026-03-24 Vinay Sharma , Manish Jain

Variation in human annotation (i.e., disagreements) is common in NLP, often reflecting important information like task subjectivity and sample ambiguity. Modeling this variation is important for applications that are sensitive to such…

计算与语言 · 计算机科学 2026-01-13 Jingwei Ni , Yu Fan , Vilém Zouhar , Donya Rooein , Alexander Hoyle , Mrinmaya Sachan , Markus Leippold , Dirk Hovy , Elliott Ash

Despite the recent advancement in large language models (LLMs) and their high performances across numerous benchmarks, recent research has unveiled that LLMs suffer from hallucinations and unfaithful reasoning. This work studies a specific…

计算与语言 · 计算机科学 2024-04-09 Bangzheng Li , Ben Zhou , Fei Wang , Xingyu Fu , Dan Roth , Muhao Chen

Chain-of-thought (CoT) has proven to improve the reasoning capability of large language models (LLMs). However, due to the complexity of multimodal scenarios and the difficulty in collecting high-quality CoT data, CoT reasoning in…

机器学习 · 计算机科学 2024-11-05 Kanzhi Cheng , Yantao Li , Fangzhi Xu , Jianbing Zhang , Hao Zhou , Yang Liu

Large Reasoning Models like DeepSeek-R1 mark a fundamental shift in how LLMs approach complex problems. Instead of directly producing an answer for a given input, DeepSeek-R1 creates detailed multi-step reasoning chains, seemingly…

This paper examines the reasoning capabilities of Large Language Models (LLMs) from a novel perspective, focusing on their ability to operate within formally specified, rule-governed environments. We evaluate four LLMs (Gemini 2.5 Pro and…

人工智能 · 计算机科学 2026-02-24 Maciej Świechowski , Adam Żychowski , Jacek Mańdziuk

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

计算与语言 · 计算机科学 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Large language models (LLMs) are increasingly being applied to clinical care, a domain where both accuracy and transparent reasoning are critical for safe and trustworthy deployment. Chain-of-thought (CoT) prompting, which elicits…

计算与语言 · 计算机科学 2025-12-09 Jiageng Wu , Kevin Xie , Bowen Gu , Nils Krüger , Kueiyu Joshua Lin , Jie Yang

Large Language Models (LLMs) have achieved great success in various reasoning tasks. In this work, we focus on the graph reasoning ability of LLMs. Although theoretical studies proved that LLMs are capable of handling graph reasoning tasks,…

计算与语言 · 计算机科学 2025-01-09 Xinnan Dai , Qihao Wen , Yifei Shen , Hongzhi Wen , Dongsheng Li , Jiliang Tang , Caihua Shan

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

计算与语言 · 计算机科学 2025-04-16 Thilo Hagendorff , Sarah Fabi

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

计算与语言 · 计算机科学 2024-10-30 Rob Sullivan , Nelly Elsayed

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs…

计算与语言 · 计算机科学 2023-10-10 Thilo Hagendorff , Sarah Fabi , Michal Kosinski

Recent advancements in large audio-language models (LALMs) have shown impressive capabilities in understanding and reasoning about audio and speech information. However, these models still face challenges, including hallucinating…

音频与语音处理 · 电气工程与系统科学 2025-01-03 Chun-Yi Kuan , Hung-yi Lee

Chain-of-thought emerges as a promising technique for eliciting reasoning capabilities from Large Language Models (LLMs). However, it does not always improve task performance or accurately represent reasoning processes, leaving unresolved…

计算与语言 · 计算机科学 2024-12-13 Guangsheng Bao , Hongbo Zhang , Cunxiang Wang , Linyi Yang , Yue Zhang

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

With the emergence of advanced reasoning models like OpenAI o3 and DeepSeek-R1, large language models (LLMs) have demonstrated remarkable reasoning capabilities. However, their ability to perform rigorous logical reasoning remains an open…

人工智能 · 计算机科学 2025-02-14 Hanmeng Liu , Zhizhang Fu , Mengru Ding , Ruoxi Ning , Chaoli Zhang , Xiaozhang Liu , Yue Zhang

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

人工智能 · 计算机科学 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

Hallucinations in large language models (LLMs) produce fluent continuations that are not supported by the prompt, especially under minimal contextual cues and ambiguity. We introduce Distributional Semantics Tracing (DST), a model-native…

计算与语言 · 计算机科学 2026-03-17 Gagan Bhatia , Somayajulu G Sripada , Kevin Allan , Jacobo Azcona

Despite the recent success of large language models (LLMs) in reasoning such as DeepSeek, we for the first time identify a key dilemma in reasoning robustness and generalization: significant performance degradation on novel or incomplete…

人工智能 · 计算机科学 2025-03-07 Tong Yu , Yongcheng Jing , Xikun Zhang , Wentao Jiang , Wenjie Wu , Yingjie Wang , Wenbin Hu , Bo Du , Dacheng Tao