English
Related papers

Related papers: Evaluating open-source Large Language Models for a…

200 papers

Traditional fact-checking relies on humans to formulate relevant and targeted fact-checking questions (FCQs), search for evidence, and verify the factuality of claims. While Large Language Models (LLMs) have been commonly used to automate…

Computation and Language · Computer Science 2025-02-24 Alimohammad Beigi , Bohan Jiang , Dawei Li , Zhen Tan , Pouya Shaeri , Tharindu Kumarage , Amrita Bhattacharjee , Huan Liu

While Large Language Models (LLMs) can amplify online misinformation, they also show promise in tackling misinformation. In this paper, we empirically study the capabilities of three LLMs -- ChatGPT, Gemini, and Claude -- in countering…

Computation and Language · Computer Science 2025-09-29 Adiba Mahbub Proma , Neeley Pate , James Druckman , Gourab Ghoshal , Hangfeng He , Ehsan Hoque

Online disinformation poses a global challenge, placing significant demands on fact-checkers who must verify claims efficiently to prevent the spread of false information. A major issue in this process is the redundant verification of…

Computation and Language · Computer Science 2025-04-30 Ivan Vykopal , Martin Hyben , Robert Moro , Michal Gregor , Jakub Simko

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Large Language Models (LLMs) have garnered significant attention for their powerful ability in natural language understanding and reasoning. In this paper, we present a comprehensive empirical study to explore the performance of LLMs on…

Computation and Language · Computer Science 2024-12-30 Mengyang Chen , Lingwei Wei , Han Cao , Wei Zhou , Songlin Hu

Political misinformation poses significant challenges to democratic processes, shaping public opinion and trust in media. Manual fact-checking methods face issues of scalability and annotator bias, while machine learning models require…

Computation and Language · Computer Science 2024-11-11 Veronica Chatrath , Marcelo Lotif , Shaina Raza

The large and ever-increasing amount of data available on the Internet coupled with the laborious task of manual claim and fact verification has sparked the interest in the development of automated claim verification systems. Several deep…

Computation and Language · Computer Science 2025-02-12 Alphaeus Dmonte , Roland Oruche , Marcos Zampieri , Prasad Calyam , Isabelle Augenstein

False information poses a significant global challenge, and manually verifying claims is a time-consuming and resource-intensive process. In this research paper, we experiment with different approaches to investigate the effectiveness of…

Computation and Language · Computer Science 2025-12-11 Ravi Kiran Chikkala , Tatiana Anikina , Natalia Skachkova , Ivan Vykopal , Rodrigo Agerri , Josef van Genabith

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

Computation and Language · Computer Science 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Large language models (LLMs) excel in generating fluent utterances but can lack reliable grounding in verified information. At the same time, knowledge-graph-based fact-checkers deliver precise and interpretable evidence, yet suffer from…

Computation and Language · Computer Science 2025-11-06 Shaghayegh Kolli , Richard Rosenbaum , Timo Cavelius , Lasse Strothe , Andrii Lata , Jana Diesner

Large Language Models (LLMs) are increasingly integrated into search services, providing direct answers that can reduce users' reliance on traditional result pages. Yet their factual reliability in non-English web ecosystems remains poorly…

Information Retrieval · Computer Science 2026-02-27 Geng Liu , Junjie Mu , Li Feng , Mengxiao Zhu , Francesco Pierri

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are…

Large language models (LLMs) are increasingly being used for complex research tasks such as literature review, idea generation, and scientific paper analysis, yet their ability to truly understand and process the intricate relationships…

Computation and Language · Computer Science 2025-06-11 Shashidhar Reddy Javaji , Yupeng Cao , Haohang Li , Yangyang Yu , Nikhil Muralidhar , Zining Zhu

Advances in the general capabilities of large language models (LLMs) have led to their use for information retrieval, and as components in automated decision systems. A faithful representation of probabilistic reasoning in these models may…

Artificial Intelligence · Computer Science 2025-04-21 Gabriel Freedman , Francesca Toni

Large Language Models (LLMs) tend to be unreliable in the factuality of their answers. To address this problem, NLP researchers have proposed a range of techniques to estimate LLM's confidence over facts. However, due to the lack of a…

Computation and Language · Computer Science 2024-11-28 Matéo Mahaut , Laura Aina , Paula Czarnowska , Momchil Hardalov , Thomas Müller , Lluís Màrquez

Assessing factuality of text generated by large language models (LLMs) is an emerging yet crucial research area, aimed at alerting users to potential errors and guiding the development of more reliable LLMs. Nonetheless, the evaluators…

Computation and Language · Computer Science 2023-11-29 Shiqi Chen , Yiran Zhao , Jinghan Zhang , I-Chun Chern , Siyang Gao , Pengfei Liu , Junxian He

This survey addresses the crucial issue of factuality in Large Language Models (LLMs). As LLMs find applications across diverse domains, the reliability and accuracy of their outputs become vital. We define the Factuality Issue as the…

The proliferation of misinformation necessitates scalable, automated fact-checking solutions. Yet, current benchmarks often overlook multilingual and topical diversity. This paper introduces a novel, dynamically extensible data set that…

Computers and Society · Computer Science 2025-10-22 Lorraine Saju , Arnim Bleier , Jana Lasser , Claudia Wagner