中文
相关论文

相关论文: Reducing Hallucinations in Summarization via Reinf…

200 篇论文

Modern abstractive summarization models often generate summaries that contain hallucinated or contradictory information. In this paper, we propose a simple but effective contrastive learning framework that incorporates recent developments…

计算与语言 · 计算机科学 2023-07-11 I-Chun Chern , Zhiruo Wang , Sanjan Das , Bhavuk Sharma , Pengfei Liu , Graham Neubig

The emergence of Large Language Models (LLMs) has revolutionized how users access information, shifting from traditional search engines to direct question-and-answer interactions with LLMs. However, the widespread adoption of LLMs has…

计算与语言 · 计算机科学 2024-07-23 Weihang Su , Yichen Tang , Qingyao Ai , Changyue Wang , Zhijing Wu , Yiqun Liu

Despite the state-of-the-art performance of Large Language Models (LLMs), these models often suffer from hallucinations, which can undermine their performance in critical applications. In this work, we propose SAFE, a novel method for…

计算与语言 · 计算机科学 2025-03-06 Samir Abdaljalil , Filippo Pallucchini , Andrea Seveso , Hasan Kurban , Fabio Mercorio , Erchin Serpedin

Embedding-based methods have attracted increasing attention in recent entity alignment (EA) studies. Although great promise they can offer, there are still several limitations. The most notable is that they identify the aligned entities…

人工智能 · 计算机科学 2022-03-08 Lingbing Guo , Yuqiang Han , Qiang Zhang , Huajun Chen

One of the challenges of developing a summarization model arises from the difficulty in measuring the factual inconsistency of the generated text. In this study, we reinterpret the decoder overconfidence-regularizing objective suggested in…

计算与语言 · 计算机科学 2022-11-28 Seonil Son , Junsoo Park , Jeong-in Hwang , Junghwa Lee , Hyungjong Noh , Yeonsoo Lee

Reliable question answering with large language models (LLMs) is challenged by hallucinations, fluent but factually incorrect outputs arising from epistemic uncertainty. Existing entropy-based semantic-level uncertainty estimation methods…

计算与语言 · 计算机科学 2025-09-29 Chaodong Tong , Qi Zhang , Lei Jiang , Yanbing Liu , Nannan Sun , Wei Li

Large language models (LLMs) often generate hallucinations -- unsupported content that undermines reliability. While most prior works frame hallucination detection as a binary task, many real-world applications require identifying…

Multimodal large language models (MLLMs) have attracted increasing attention in the past few years, but they may still generate descriptions that include objects not present in the corresponding images, a phenomenon known as object…

计算与语言 · 计算机科学 2024-09-24 Shangyu Xing , Fei Zhao , Zhen Wu , Tuo An , Weihao Chen , Chunhui Li , Jianbing Zhang , Xinyu Dai

Large language models (LLMs) produce context inconsistency hallucinations, which are LLM generated outputs that are misaligned with the user prompt. This research project investigates whether prompt engineering (PE) methods can mitigate…

计算与语言 · 计算机科学 2025-12-19 Imane Jaaouine , Ross D. King

Despite the striking advances in recent language generation performance, model-generated responses have suffered from the chronic problem of hallucinations that are either untrue or unfaithful to a given source. Especially in the task of…

计算与语言 · 计算机科学 2024-06-18 Yoonna Jang , Suhyune Son , Jeongwoo Lee , Junyoung Son , Yuna Hur , Jungwoo Lim , Hyeonseok Moon , Kisu Yang , Heuiseok Lim

Document summarisation can be formulated as a sequential decision-making problem, which can be solved by Reinforcement Learning (RL) algorithms. The predominant RL paradigm for summarisation learns a cross-input policy, which requires…

计算与语言 · 计算机科学 2019-07-31 Yang Gao , Christian M. Meyer , Mohsen Mesgar , Iryna Gurevych

Despite the remarkable performance of generative large language models (LLMs) on abstractive summarization, they face two significant challenges: their considerable size and tendency to hallucinate. Hallucinations are concerning because…

计算与语言 · 计算机科学 2024-10-28 George Chrysostomou , Zhixue Zhao , Miles Williams , Nikolaos Aletras

With the rapid development of large language models (LLMs), LLM-as-a-judge has emerged as a widely adopted approach for text quality evaluation, including hallucination evaluation. While previous studies have focused exclusively on…

计算与语言 · 计算机科学 2025-03-04 Siya Qi , Rui Cao , Yulan He , Zheng Yuan

Attribution is a key concept in large language models (LLMs) as it enables control over information sources and enhances the factuality of LLMs. While existing approaches utilize open book question answering to improve attribution, factual…

计算与语言 · 计算机科学 2023-11-14 Abdullatif Köksal , Renat Aksitov , Chung-Ching Chang

Small language models (SLMs) are increasingly used for financial classification due to their fast inference and local deployability. However, compared with large language models, SLMs are more prone to factual hallucinations in reasoning…

人工智能 · 计算机科学 2026-01-06 Han Yuan , Yilin Wu , Li Zhang , Zheng Ma

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Current abstractive summarization systems present important weaknesses which prevent their deployment in real-world applications, such as the omission of relevant information and the generation of factual inconsistencies (also known as…

计算与语言 · 计算机科学 2022-11-08 Diogo Pernes , Afonso Mendes , André F. T. Martins

Automated evaluation is crucial for streamlining text summarization benchmarking and model development, given the costly and time-consuming nature of human evaluation. Traditional methods like ROUGE do not correlate well with human…

计算与语言 · 计算机科学 2024-07-23 Hwanjun Song , Hang Su , Igor Shalyminov , Jason Cai , Saab Mansour

When asked to summarize articles or answer questions given a passage, large language models (LLMs) can hallucinate details and respond with unsubstantiated answers that are inaccurate with respect to the input context. This paper describes…

计算与语言 · 计算机科学 2024-10-04 Yung-Sung Chuang , Linlu Qiu , Cheng-Yu Hsieh , Ranjay Krishna , Yoon Kim , James Glass

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

计算与语言 · 计算机科学 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal