English
Related papers

Related papers: Factuality Beyond Coherence: Evaluating LLM Waterm…

200 papers

Hallucination in large language models (LLMs) remains an acute concern, contributing to the spread of misinformation and diminished public trust, particularly in high-risk domains. Among hallucination types, factuality is crucial, as it…

Computation and Language · Computer Science 2026-01-23 Adam Szelestey , Sofie van Engelen , Tianhao Huang , Justin Snelders , Qintao Zeng , Songgaojun Deng

The task of discerning between generated and natural texts is increasingly challenging. In this context, watermarking emerges as a promising technique for ascribing generated text to a specific model. It alters the sampling generation…

Computation and Language · Computer Science 2023-11-09 Pierre Fernandez , Antoine Chaffin , Karim Tit , Vivien Chappelier , Teddy Furon

Factual hallucinations are a major challenge for Large Language Models (LLMs). They undermine reliability and user trust by generating inaccurate or fabricated content. Recent studies suggest that when generating false statements, the…

Computation and Language · Computer Science 2025-06-02 Giovanni Servedio , Alessandro De Bellis , Dario Di Palma , Vito Walter Anelli , Tommaso Di Noia

As large language models (LLMs) are increasingly deployed for text generation, watermarking has become essential for authorship attribution, intellectual property protection, and misuse detection. While existing watermarking methods perform…

Computation and Language · Computer Science 2026-01-09 Amit Bin Tariqul , A N M Zahid Hossain Milkan , Sahab-Al-Chowdhury , Syed Rifat Raiyan , Hasan Mahmud , Md Kamrul Hasan

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

LLM hallucination, i.e. generating factually incorrect yet seemingly convincing answers, is currently a major threat to the trustworthiness and reliability of LLMs. The first step towards solving this complicated problem is to measure it.…

Computation and Language · Computer Science 2024-06-10 Jiaheng Wei , Yuanshun Yao , Jean-Francois Ton , Hongyi Guo , Andrew Estornell , Yang Liu

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

Multimedia · Computer Science 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step.…

Cryptography and Security · Computer Science 2024-05-21 Aiwei Liu , Leyi Pan , Xuming Hu , Shiao Meng , Lijie Wen

As large language models (LLMs) generate increasingly human-like text, watermarking has emerged as a promising solution for reliable attribution beyond mere detection. While multi-bit watermarking enables richer provenance encoding,…

Computation and Language · Computer Science 2026-05-11 Yidan Wang , Yubing Ren , Yanan Cao , Li Guo

Text-based explainable recommendation aims to generate natural-language explanations that justify item recommendations, to improve user trust and system transparency. Although recent advances leverage LLMs to produce fluent outputs, a…

Information Retrieval · Computer Science 2026-05-18 Ben Kabongo , Vincent Guigue

Large Language Model (LLM) watermarking is crucial for establishing the provenance of machine-generated text, but most existing methods rely on a centralized trust model. This model forces users to reveal potentially sensitive text to a…

Cryptography and Security · Computer Science 2026-05-01 Xiaokun Luan , Yihao Zhang , Pengcheng Su , Feiran Lei , Meng Sun

This paper introduces a novel problem, distributional information embedding, motivated by the practical demands of multi-bit watermarking for large language models (LLMs). Unlike traditional information embedding, which embeds information…

Cryptography and Security · Computer Science 2025-07-03 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

Cryptography and Security · Computer Science 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos

Driven by surging submission volumes, scientific peer review has catalyzed two parallel trends: individual over-reliance on LLMs and institutional AI-powered assessment systems. This study investigates the robustness of "LLM-as-a-Judge"…

Artificial Intelligence · Computer Science 2026-01-07 Devanshu Sahoo , Manish Prasad , Vasudev Majhi , Jahnvi Singh , Vinay Chamola , Yash Sinha , Murari Mandal , Dhruv Kumar

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Large language models (LLMs) can be trained or fine-tuned on data obtained without the owner's consent. Verifying whether a specific LLM was trained on particular data instances or an entire dataset is extremely challenging. Dataset…

Computation and Language · Computer Science 2025-10-07 Eyal German , Sagiv Antebi , Edan Habler , Asaf Shabtai , Yuval Elovici

Summaries of medical text shall be faithful by being consistent and factual with source inputs, which is an important but understudied topic for safety and efficiency in healthcare. In this paper, we investigate and improve faithfulness in…

Computation and Language · Computer Science 2023-11-10 Nan Zhang , Yusen Zhang , Wu Guo , Prasenjit Mitra , Rui Zhang

Large language models (LLMs) are increasingly integrated into real-world personalized applications through retrieval-augmented generation (RAG) mechanisms to supplement their responses with domain-specific knowledge. However, the valuable…

Cryptography and Security · Computer Science 2025-05-26 Junfeng Guo , Yiming Li , Ruibo Chen , Yihan Wu , Chenxi Liu , Yanshuo Chen , Heng Huang

Current Large Language Models (LLMs) benchmarks are often based on open-ended or close-ended QA evaluations, avoiding the requirement of human labor. Close-ended measurements evaluate the factuality of responses but lack expressiveness.…