中文
相关论文

相关论文: Factuality Beyond Coherence: Evaluating LLM Waterm…

200 篇论文

Hallucination in large language models (LLMs) remains an acute concern, contributing to the spread of misinformation and diminished public trust, particularly in high-risk domains. Among hallucination types, factuality is crucial, as it…

计算与语言 · 计算机科学 2026-01-23 Adam Szelestey , Sofie van Engelen , Tianhao Huang , Justin Snelders , Qintao Zeng , Songgaojun Deng

The task of discerning between generated and natural texts is increasingly challenging. In this context, watermarking emerges as a promising technique for ascribing generated text to a specific model. It alters the sampling generation…

计算与语言 · 计算机科学 2023-11-09 Pierre Fernandez , Antoine Chaffin , Karim Tit , Vivien Chappelier , Teddy Furon

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the…

计算与语言 · 计算机科学 2025-06-02 Giovanni Servedio , Alessandro De Bellis , Dario Di Palma , Vito Walter Anelli , Tommaso Di Noia

As large language models (LLMs) are increasingly deployed for text generation, watermarking has become essential for authorship attribution, intellectual property protection, and misuse detection. While existing watermarking methods perform…

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

信息检索 · 计算机科学 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

LLM hallucination, i.e. generating factually incorrect yet seemingly convincing answers, is currently a major threat to the trustworthiness and reliability of LLMs. The first step towards solving this complicated problem is to measure it.…

计算与语言 · 计算机科学 2024-06-10 Jiaheng Wei , Yuanshun Yao , Jean-Francois Ton , Hongyi Guo , Andrew Estornell , Yang Liu

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

多媒体 · 计算机科学 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step.…

密码学与安全 · 计算机科学 2024-05-21 Aiwei Liu , Leyi Pan , Xuming Hu , Shiao Meng , Lijie Wen

As large language models (LLMs) generate increasingly human-like text, watermarking has emerged as a promising solution for reliable attribution beyond mere detection. While multi-bit watermarking enables richer provenance encoding,…

计算与语言 · 计算机科学 2026-05-11 Yidan Wang , Yubing Ren , Yanan Cao , Li Guo

Text-based explainable recommendation aims to generate natural-language explanations that justify item recommendations, to improve user trust and system transparency. Although recent advances leverage LLMs to produce fluent outputs, a…

信息检索 · 计算机科学 2026-05-18 Ben Kabongo , Vincent Guigue

Large Language Model (LLM) watermarking is crucial for establishing the provenance of machine-generated text, but most existing methods rely on a centralized trust model. This model forces users to reveal potentially sensitive text to a…

密码学与安全 · 计算机科学 2026-05-01 Xiaokun Luan , Yihao Zhang , Pengcheng Su , Feiran Lei , Meng Sun

This paper introduces a novel problem, distributional information embedding, motivated by the practical demands of multi-bit watermarking for large language models (LLMs). Unlike traditional information embedding, which embeds information…

密码学与安全 · 计算机科学 2025-07-03 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

密码学与安全 · 计算机科学 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos

Driven by surging submission volumes, scientific peer review has catalyzed two parallel trends: individual over-reliance on LLMs and institutional AI-powered assessment systems. This study investigates the robustness of "LLM-as-a-Judge"…

人工智能 · 计算机科学 2026-01-07 Devanshu Sahoo , Manish Prasad , Vasudev Majhi , Jahnvi Singh , Vinay Chamola , Yash Sinha , Murari Mandal , Dhruv Kumar

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

机器学习 · 计算机科学 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Large language models (LLMs) can be trained or fine-tuned on data obtained without the owner's consent. Verifying whether a specific LLM was trained on particular data instances or an entire dataset is extremely challenging. Dataset…

计算与语言 · 计算机科学 2025-10-07 Eyal German , Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in…

计算与语言 · 计算机科学 2023-11-10 Nan Zhang , Yusen Zhang , Wu Guo , Prasenjit Mitra , Rui Zhang

Large language models (LLMs) are increasingly integrated into real-world personalized applications through retrieval-augmented generation (RAG) mechanisms to supplement their responses with domain-specific knowledge. However, the valuable…

密码学与安全 · 计算机科学 2025-05-26 Junfeng Guo , Yiming Li , Ruibo Chen , Yihan Wu , Chenxi Liu , Yanshuo Chen , Heng Huang

Current Large Language Models (LLMs) benchmarks are often based on open-ended or close-ended QA evaluations, avoiding the requirement of human labor. Close-ended measurements evaluate the factuality of responses but lack expressiveness.…