English
Related papers

Related papers: Fact or Fiction? Can LLMs be Reliable Annotators f…

200 papers

In an age characterized by the proliferation of mis- and disinformation online, it is critical to empower readers to understand the content they are reading. Important efforts in this direction rely on manual or automatic fact-checking,…

Computation and Language · Computer Science 2025-06-17 Zain Muhammad Mujahid , Dilshod Azizov , Maha Tufail Agro , Preslav Nakov

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

Computers and Society · Computer Science 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

The dissemination of false information on online platforms presents a serious societal challenge. While manual fact-checking remains crucial, Large Language Models (LLMs) offer promising opportunities to support fact-checkers with their…

Computation and Language · Computer Science 2024-10-31 Ivan Vykopal , Matúš Pikuliak , Simon Ostermann , Marián Šimko

The spread of media bias is a significant concern as political discourse shapes beliefs and opinions. Addressing this challenge computationally requires improved methods for interpreting news. While large language models (LLMs) can scale…

Human-Computer Interaction · Computer Science 2026-02-24 Qile Wang , Prerana Khatiwada , Avinash Chouhan , Ashrey Mahesh , Joy Mwaria , Duy Duc Tran , Kenneth E. Barner , Matthew Louis Mauriello

The increased use of large language models (LLMs) across a variety of real-world applications calls for mechanisms to verify the factual accuracy of their outputs. In this work, we present a holistic end-to-end solution for annotating the…

Evaluating the quality of arguments is a crucial aspect of any system leveraging argument mining. However, it is a challenge to obtain reliable and consistent annotations regarding argument quality, as this usually requires domain-specific…

Computation and Language · Computer Science 2024-04-16 Nailia Mirzakhmedova , Marcel Gohsen , Chia Hao Chang , Benno Stein

Automated fact-checking, using machine learning to verify claims, has grown vital as misinformation spreads beyond human fact-checking capacity. Large Language Models (LLMs) like GPT-4 are increasingly trusted to write academic papers,…

Computation and Language · Computer Science 2024-02-08 Dorian Quelle , Alexandre Bovet

Inconsistent political statements represent a form of misinformation. They erode public trust and pose challenges to accountability, when left unnoticed. Detecting inconsistencies automatically could support journalists in asking…

Computation and Language · Computer Science 2025-05-27 Nursulu Sagimbayeva , Ruveyda Betül Bahçeci , Ingmar Weber

Large Language Models (LLMs) have emerged as powerful support tools across various natural language tasks and a range of application domains. Recent studies focus on exploring their capabilities for data annotation. This paper provides a…

Computation and Language · Computer Science 2025-07-01 Maja Pavlovic , Massimo Poesio

Climate misinformation is a problem that has the potential to be substantially aggravated by the development of Large Language Models (LLMs). In this study we evaluate the potential for LLMs to be part of the solution for mitigating online…

Computers and Society · Computer Science 2025-03-11 Mowafak Allaham , Ayse D. Lokmanoglu , P. Sol Hart , Erik C. Nisbet

Assessing factuality of text generated by large language models (LLMs) is an emerging yet crucial research area, aimed at alerting users to potential errors and guiding the development of more reliable LLMs. Nonetheless, the evaluators…

Computation and Language · Computer Science 2023-11-29 Shiqi Chen , Yiran Zhao , Jinghan Zhang , I-Chun Chern , Siyang Gao , Pengfei Liu , Junxian He

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Public Narratives (PNs) are key tools for leadership development and civic mobilization, yet their systematic analysis remains challenging due to their subjective interpretation and the high cost of expert annotation. In this work, we…

Computation and Language · Computer Science 2025-11-18 Elinor Poole-Dayan , Daniel T Kessler , Hannah Chiou , Margaret Hughes , Emily S Lin , Marshall Ganz , Deb Roy

High annotation costs from hiring or crowdsourcing complicate the creation of large, high-quality datasets needed for training reliable text classifiers. Recent research suggests using Large Language Models (LLMs) to automate the annotation…

Computation and Language · Computer Science 2025-01-27 Tomas Horych , Christoph Mandl , Terry Ruas , Andre Greiner-Petter , Bela Gipp , Akiko Aizawa , Timo Spinde

Large language models (LLMs) make it possible to generate synthetic behavioural data at scale, offering an ethical and low-cost alternative to human experiments. Whether such data can faithfully capture psychological differences driven by…

Computation and Language · Computer Science 2025-11-27 Manuel Pratelli , Marinella Petrocchi

In the current digital era, the rapid spread of misinformation on online platforms presents significant challenges to societal well-being, public trust, and democratic processes, influencing critical decision making and public opinion. To…

Computation and Language · Computer Science 2024-05-06 Xinyi Li , Yongfeng Zhang , Edward C. Malthouse

Scientific facts are often spun in the popular press with the intent to influence public opinion and action, as was evidenced during the COVID-19 pandemic. Automatic detection of misinformation in the scientific domain is challenging…

Computation and Language · Computer Science 2025-11-25 Yupeng Cao , Aishwarya Muralidharan Nair , Nastaran Jamalipour Soofi , Elyon Eyimife , K. P. Subbalakshmi

Fact checking can be an effective strategy against misinformation, but its implementation at scale is impeded by the overwhelming volume of information online. Recent artificial intelligence (AI) language models have shown impressive…

Human-Computer Interaction · Computer Science 2025-05-23 Matthew R. DeVerna , Harry Yaojun Yan , Kai-Cheng Yang , Filippo Menczer

Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results. As mainstream chatbots increasingly ship with reasoning capabilities and web search tools -- and millions of…

Computation and Language · Computer Science 2025-11-25 Matthew R. DeVerna , Kai-Cheng Yang , Harry Yaojun Yan , Filippo Menczer
‹ Prev 1 2 3 10 Next ›