中文
相关论文

相关论文: $\textit{Dial BeInfo for Faithfulness}$: Improving…

200 篇论文

Large language models have demonstrated significant potential as the next-generation information access engines. However, their reliability is hindered by issues of hallucination and generating non-factual content. This is particularly…

计算与语言 · 计算机科学 2024-10-03 Chao-Wei Huang , Yun-Nung Chen

While improving neural dialogue agents' factual accuracy is the object of much research, another important aspect of communication, less studied in the setting of neural dialogue, is transparency about ignorance. In this work, we analyze to…

计算与语言 · 计算机科学 2022-06-28 Sabrina J. Mielke , Arthur Szlam , Emily Dinan , Y-Lan Boureau

Fact-checking based on commercial LLMs has become mainstream. Although these methods offer high explainability, it falls short in accuracy compared to traditional fine-tuning approaches, and data security is also a significant concern. In…

计算与语言 · 计算机科学 2024-05-24 Guangyao Lu , Yulin Liu

We present a novel framework addressing a critical vulnerability in Large Language Models (LLMs): the prevalence of factual inaccuracies within intermediate reasoning steps despite correct final answers. This phenomenon poses substantial…

计算与语言 · 计算机科学 2025-08-05 Rui Jiao , Yue Zhang , Jinku Li

This paper presents a comprehensive analysis of explainable fact-checking through a series of experiments, focusing on the ability of large language models to verify public health claims and provide explanations or justifications for their…

计算与语言 · 计算机科学 2024-12-19 Majid Zarharan , Pascal Wullschleger , Babak Behkam Kia , Mohammad Taher Pilehvar , Jennifer Foster

Despite their success at many natural language processing (NLP) tasks, large language models still struggle to effectively leverage knowledge for knowledge-intensive tasks, manifesting limitations such as generating incomplete, non-factual,…

计算与语言 · 计算机科学 2024-10-03 Yougang Lyu , Lingyong Yan , Shuaiqiang Wang , Haibo Shi , Dawei Yin , Pengjie Ren , Zhumin Chen , Maarten de Rijke , Zhaochun Ren

Large language models (LLMs) have shown remarkable capabilities in various natural language processing tasks, yet they often struggle with maintaining factual accuracy, particularly in knowledge-intensive domains like healthcare. This study…

计算与语言 · 计算机科学 2024-11-01 Hieu Tran , Junda Wang , Yujan Ting , Weijing Huang , Terrence Chen

Large language models (LLMs) are increasingly used in decision-making contexts, but when they present answers without signaling low confidence, users may unknowingly act on erroneous outputs. Prior work shows that LLMs maintain internal…

计算与语言 · 计算机科学 2025-10-23 Mark Steyvers , Catarina Belem , Padhraic Smyth

Instruction-tuning enhances the ability of large language models (LLMs) to follow user instructions more accurately, improving usability while reducing harmful outputs. However, this process may increase the model's dependence on user…

计算与语言 · 计算机科学 2025-07-25 Kyubeen Han , Junseo Jang , Hongjin Kim , Geunyeong Jeong , Harksoo Kim

Despite showing increasingly human-like abilities, large language models (LLMs) often struggle with factual inaccuracies, i.e. "hallucinations", even when they hold relevant knowledge. To address these hallucinations, current approaches…

计算与语言 · 计算机科学 2024-06-12 Xiaoying Zhang , Baolin Peng , Ye Tian , Jingyan Zhou , Lifeng Jin , Linfeng Song , Haitao Mi , Helen Meng

Large language models (LLMs) can generate long-form and coherent text, yet they often hallucinate facts, which undermines their reliability. To mitigate this issue, inference-time methods steer LLM representations toward the "truthful…

计算与语言 · 计算机科学 2024-06-10 Farima Fatahi Bayat , Xin Liu , H. V. Jagadish , Lu Wang

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

计算与语言 · 计算机科学 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

In day-to-day communication, people often approximate the truth - for example, rounding the time or omitting details - in order to be maximally helpful to the listener. How do large language models (LLMs) handle such nuanced trade-offs? To…

计算与语言 · 计算机科学 2024-02-14 Ryan Liu , Theodore R. Sumers , Ishita Dasgupta , Thomas L. Griffiths

Effective interlocutors account for the uncertain goals, beliefs, and emotions of others. But even the best human conversationalist cannot perfectly anticipate the trajectory of a dialogue. How well can language models represent inherent…

计算与语言 · 计算机科学 2024-02-06 Anthony Sicilia , Hyunwoo Kim , Khyathi Raghavi Chandu , Malihe Alikhani , Jack Hessel

Instruction tuning is an emergent paradigm in NLP wherein natural language instructions are leveraged with language models to induce zero-shot performance on unseen tasks. Instructions have been shown to enable good performance on unseen…

计算与语言 · 计算机科学 2022-10-27 Prakhar Gupta , Cathy Jiao , Yi-Ting Yeh , Shikib Mehri , Maxine Eskenazi , Jeffrey P. Bigham

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

计算与语言 · 计算机科学 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

Text-based misinformation permeates online discourses, yet evidence of people's ability to discern truth from such deceptive textual content is scarce. We analyze a novel TV game show data where conversations in a high-stake environment…

计算与语言 · 计算机科学 2024-04-09 Sanchaita Hazra , Bodhisattwa Prasad Majumder

The rapid adoption of language models (LMs) across diverse applications has raised concerns about their factuality, i.e., their consistency with real-world facts. We first present VERIFY (Verification and Evidence RetrIeval for FactualitY…

计算与语言 · 计算机科学 2025-01-09 Farima Fatahi Bayat , Lechen Zhang , Sheza Munir , Lu Wang

Pretrained language models (PLMs) based knowledge-grounded dialogue systems are prone to generate responses that are factually inconsistent with the provided knowledge source. In such inconsistent responses, the dialogue models fail to…

计算与语言 · 计算机科学 2023-11-06 Boyang Xue , Weichao Wang , Hongru Wang , Fei Mi , Rui Wang , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs). Nevertheless, LLMs frequently "hallucinate," resulting in non-factual outputs. Our carefully-designed human evaluation…

计算与语言 · 计算机科学 2024-03-22 Jian Guan , Jesse Dodge , David Wadden , Minlie Huang , Hao Peng