中文
相关论文

相关论文: Real-time Factuality Assessment from Adversarial F…

200 篇论文

In the current digital era, the rapid spread of misinformation on online platforms presents significant challenges to societal well-being, public trust, and democratic processes, influencing critical decision making and public opinion. To…

计算与语言 · 计算机科学 2024-05-06 Xinyi Li , Yongfeng Zhang , Edward C. Malthouse

Assessing factuality of text generated by large language models (LLMs) is an emerging yet crucial research area, aimed at alerting users to potential errors and guiding the development of more reliable LLMs. Nonetheless, the evaluators…

计算与语言 · 计算机科学 2023-11-29 Shiqi Chen , Yiran Zhao , Jinghan Zhang , I-Chun Chern , Siyang Gao , Pengfei Liu , Junxian He

Fake news poses a significant threat to public opinion and social stability in modern society. This study presents a comparative evaluation of BERT-like encoder-only models and autoregressive decoder-only large language models (LLMs) for…

计算与语言 · 计算机科学 2024-12-23 Shaina Raza , Drai Paulen-Patterson , Chen Ding

Before deploying a language model (LM) within a given domain, it is important to measure its tendency to generate factually incorrect information in that domain. Existing methods for factuality evaluation of LLM generation focus on facts…

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

计算与语言 · 计算机科学 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

The fluency and creativity of large pre-trained language models (LLMs) have led to their widespread use, sometimes even as a replacement for traditional search engines. Yet language models are prone to making convincing but factually…

计算与语言 · 计算机科学 2023-11-15 Katherine Tian , Eric Mitchell , Huaxiu Yao , Christopher D. Manning , Chelsea Finn

Reasoning Large Language Models (R-LLMs) have significantly advanced complex reasoning tasks but often struggle with factuality, generating substantially more hallucinations than their non-reasoning counterparts on long-form factuality…

计算与语言 · 计算机科学 2025-08-08 Xilun Chen , Ilia Kulikov , Vincent-Pierre Berges , Barlas Oğuz , Rulin Shao , Gargi Ghosh , Jason Weston , Wen-tau Yih

Automatic fake news detection models are ostensibly based on logic, where the truth of a claim made in a headline can be determined by supporting or refuting evidence found in a resulting web query. These models are believed to be reasoning…

计算与语言 · 计算机科学 2022-04-18 Ian Kelk , Benjamin Basseri , Wee Yi Lee , Richard Qiu , Chris Tanner

Given the constantly growing proliferation of false claims online in recent years, there has been also a growing research interest in automatically distinguishing false rumors from factually true claims. Here, we propose a general-purpose…

计算与语言 · 计算机科学 2017-10-03 Georgi Karadzhov , Preslav Nakov , Lluis Marquez , Alberto Barron-Cedeno , Ivan Koychev

Large Language Models (LLMs) have great potential to accelerate and support scholarly peer review and are increasingly used as fully automatic review generators (ARGs). However, potential biases and systematic errors may pose significant…

计算与语言 · 计算机科学 2026-02-02 Nils Dycke , Iryna Gurevych

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

计算与语言 · 计算机科学 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Successful defense against dynamically evolving cyber threats requires advanced and sophisticated techniques. This research presents a novel approach to enhance real-time cybersecurity threat detection and response by integrating large…

密码学与安全 · 计算机科学 2025-04-02 Shuva Paul , Farhad Alemi , Richard Macwan

Automated fact checking with large language models (LLMs) offers a scalable alternative to manual verification. Evaluating fact checking is challenging as existing benchmark datasets often include post claim analysis and annotator cues,…

计算与语言 · 计算机科学 2025-07-08 Satyam Shukla , Himanshu Dutta , Pushpak Bhattacharyya

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

In the age of large language models (LLMs) and the widespread adoption of AI-driven content creation, the landscape of information dissemination has witnessed a paradigm shift. With the proliferation of both human-written and…

计算与语言 · 计算机科学 2024-04-16 Jinyan Su , Claire Cardie , Preslav Nakov

Evaluating the factuality of long-form output generated by large language models (LLMs) remains challenging, particularly when responses are open-ended and contain many fine-grained factual statements. Existing evaluation methods primarily…

计算与语言 · 计算机科学 2026-04-06 Nazanin Jafari , James Allan , Mohit Iyyer

In an age characterized by the proliferation of mis- and disinformation online, it is critical to empower readers to understand the content they are reading. Important efforts in this direction rely on manual or automatic fact-checking,…

计算与语言 · 计算机科学 2025-06-17 Zain Muhammad Mujahid , Dilshod Azizov , Maha Tufail Agro , Preslav Nakov

Explainable fake news detection aims to assess the veracity of news claims while providing human-friendly explanations. Existing methods incorporating investigative journalism are often inefficient and struggle with breaking news. Recent…

计算与语言 · 计算机科学 2026-04-09 Bo Wang , Jing Ma , Hongzhan Lin , Zhiwei Yang , Ruichao Yang , Yuan Tian , Yi Chang

In specialized domains, humans often compare new problems against similar examples, highlight nuances, and draw conclusions instead of analyzing information in isolation. When applying reasoning in specialized contexts with LLMs on top of a…

计算与语言 · 计算机科学 2025-10-07 Ali Elahi

Detecting factual errors in textual information, whether generated by large language models (LLM) or curated by humans, is crucial for making informed decisions. LLMs' inability to attribute their claims to external knowledge and their…

计算与语言 · 计算机科学 2023-10-27 Farima Fatahi Bayat , Kun Qian , Benjamin Han , Yisi Sang , Anton Belyi , Samira Khorshidi , Fei Wu , Ihab F. Ilyas , Yunyao Li