中文
相关论文

相关论文: Are Reasoning Models More Prone to Hallucination?

200 篇论文

Retrieval-Augmented Generation (RAG) systems offer a powerful approach to enhancing large language model (LLM) outputs by incorporating fact-checked, contextually relevant information. However, fairness and reliability concerns persist, as…

人机交互 · 计算机科学 2025-04-24 Xuyang Zhu , Sejoon Chang , Andrew Kuik

Large language models (LLMs) frequently generate hallucinations -- plausible but factually incorrect outputs -- undermining their reliability. While prior work has examined hallucinations from macroscopic perspectives such as training data…

人工智能 · 计算机科学 2025-12-03 Cheng Gao , Huimin Chen , Chaojun Xiao , Zhiyi Chen , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) have significantly advanced natural language processing tasks, yet they are susceptible to generating inaccurate or unreliable responses, a phenomenon known as hallucination. In critical domains such as health…

计算与语言 · 计算机科学 2024-09-20 Sumera Anjum , Hanzhi Zhang , Wenjun Zhou , Eun Jin Paek , Xiaopeng Zhao , Yunhe Feng

The recent advent of reasoning models like OpenAI's o1 was met with excited speculation by the AI community about the mechanisms underlying these capabilities in closed models, followed by a rush of replication efforts, particularly from…

计算与语言 · 计算机科学 2025-11-21 Brown Ebouky , Andrea Bartezzaghi , Mattia Rigotti

Despite significant advancements in multimodal reasoning tasks, existing Large Vision-Language Models (LVLMs) are prone to producing visually ungrounded responses when interpreting associated images. In contrast, when humans embark on…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Zexian Yang , Dian Li , Dayan Wu , Gang Liu , Weiping Wang

Multimodal Large Reasoning Models introduce the reasoning paradigm, demonstrating strong capabilities on complex vision-language tasks. However, they still suffer from severe hallucinations. Existing training-based methods typically…

人工智能 · 计算机科学 2026-05-28 Jiawei Kong , Hao Fang , Shunxiang Liao , Jinyu Li , Bin Chen , Hao Wu , Shu-Tao Xia , Min Zhang

Chain-of-thought emerges as a promising technique for eliciting reasoning capabilities from Large Language Models (LLMs). However, it does not always improve task performance or accurately represent reasoning processes, leaving unresolved…

计算与语言 · 计算机科学 2024-12-13 Guangsheng Bao , Hongbo Zhang , Cunxiang Wang , Linyi Yang , Yue Zhang

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

计算与语言 · 计算机科学 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Large Language Models (LLMs) often hallucinate, producing unfaithful or factually incorrect outputs by misrepresenting the provided context or incorrectly recalling internal knowledge. Recent studies have identified specific attention heads…

Theory of Mind (ToM), the ability to attribute mental states to others, is fundamental for human social intelligence and a critical capability for advanced Artificial Intelligence. Recent advancements in Large Language Models (LLMs) have…

计算与语言 · 计算机科学 2025-05-19 Yi-Long Lu , Chunhui Zhang , Jiajun Song , Lifeng Fan , Wei Wang

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large Language Models (LLMs) have been touted as AI models possessing advanced reasoning abilities. In theory, autoregressive LLMs with Chain-of-Thought (CoT) can perform more serial computations to solve complex reasoning tasks. However,…

人工智能 · 计算机科学 2025-04-08 Rishi Hazra , Gabriele Venturato , Pedro Zuidberg Dos Martires , Luc De Raedt

Hallucination in large language models (LLMs) continues to be a significant issue, particularly in tasks like question answering, where models often generate plausible yet incorrect or irrelevant information. Although various methods have…

计算与语言 · 计算机科学 2026-04-09 Ziqin Luo , Yihao Quan , Xiaofeng Zhang , Xiaosong Yuan , Chen Shen

The table reasoning task, crucial for efficient data acquisition, aims to answer questions based on the given table. Recently, reasoning large language models (RLLMs) with Long Chain-of-Thought (Long CoT) significantly enhance reasoning…

计算与语言 · 计算机科学 2025-05-22 Xuanliang Zhang , Dingzirui Wang , Keyan Xu , Qingfu Zhu , Wanxiang Che

Despite the impressive performance of general-purpose large language models (LLMs), they often require fine-tuning or post-training to excel at specific tasks. For instance, large reasoning models (LRMs), such as the DeepSeek-R1 series,…

计算与语言 · 计算机科学 2026-04-02 Mingjie Li , Wai Man Si , Michael Backes , Yang Zhang , Yisen Wang

Recent work has demonstrated state-of-the-art results in large language model (LLM) hallucination detection and mitigation through consistency-based approaches which involve aggregating multiple responses sampled from a single LLM for a…

机器学习 · 计算机科学 2025-10-24 Demian Till , John Smeaton , Peter Haubrick , Gouse Saheb , Florian Graef , David Berman

Large language model (LLM) systems suffer from the models' unstable ability to generate valid and factual content, resulting in hallucination generation. Current hallucination detection methods heavily rely on out-of-model information…

计算与语言 · 计算机科学 2025-02-20 Peiran Wang , Yang Liu , Yunfei Lu , Jue Hong , Ye Wu

Multi-round incomplete information tasks are crucial for evaluating the lateral thinking capabilities of large language models (LLMs). Currently, research primarily relies on multiple benchmarks and automated evaluation metrics to assess…

计算与语言 · 计算机科学 2025-06-02 Wenhan Dong , Tianyi Hu , Jingyi Zheng , Zhen Sun , Yuemeng Zhao , Yule Liu , Xinlei He , Xinyi Huang

Reasoning Language Models (RLMs) have gained traction for their ability to perform complex, multi-step reasoning tasks through mechanisms such as Chain-of-Thought (CoT) prompting or fine-tuned reasoning traces. While these capabilities…

计算与语言 · 计算机科学 2025-07-04 Riccardo Cantini , Nicola Gabriele , Alessio Orsino , Domenico Talia

Large language models (LLMs) have recently shown impressive performance on tasks involving reasoning, leading to a lively debate on whether these models possess reasoning capabilities similar to humans. However, despite these successes, the…

计算与语言 · 计算机科学 2024-08-07 Philipp Mondorf , Barbara Plank