English
Related papers

Related papers: CANDY: Benchmarking LLMs' Limitations and Assistiv…

200 papers

Political misinformation poses significant challenges to democratic processes, shaping public opinion and trust in media. Manual fact-checking methods face issues of scalability and annotator bias, while machine learning models require…

Computation and Language · Computer Science 2024-11-11 Veronica Chatrath , Marcelo Lotif , Shaina Raza

In recent years, large language models (LLMs) have demonstrated significant success in performing varied natural language tasks such as language translation, question-answering, summarizing, fact-checking, etc. Despite LLMs' impressive…

Computation and Language · Computer Science 2025-03-03 Bishwamittra Ghosh , Sarah Hasan , Naheed Anjum Arafat , Arijit Khan

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning, positioning them as promising tools for supporting human problem-solving. However, what happens when their performance is affected by misinformation, i.e.,…

Computation and Language · Computer Science 2025-09-24 Yiyang Feng , Yichen Wang , Shaobo Cui , Boi Faltings , Mina Lee , Jiawei Zhou

Many studies have demonstrated that large language models (LLMs) can produce harmful responses, exposing users to unexpected risks when LLMs are deployed. Previous studies have proposed comprehensive taxonomies of the risks posed by LLMs,…

Computation and Language · Computer Science 2024-08-06 Yuxia Wang , Zenan Zhai , Haonan Li , Xudong Han , Lizhi Lin , Zhenxuan Zhang , Jingru Zhao , Preslav Nakov , Timothy Baldwin

Large Language Models (LLMs) have shown remarkable capabilities in knowledge-intensive tasks, while they remain vulnerable when encountering misinformation. Existing studies have explored the role of LLMs in combating misinformation, but…

Computation and Language · Computer Science 2025-05-29 Miao Peng , Nuo Chen , Jianheng Tang , Jia Li

The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and…

Computation and Language · Computer Science 2024-04-01 Shulin Liu , Chengcheng Xu , Hao Liu , Tinghao Yu , Tao Yang

This paper investigates the potential benefits of language-specific fact-checking models, focusing on the case of Chinese. We first demonstrate the limitations of translation-based methods and multilingual large language models (e.g.,…

Computation and Language · Computer Science 2024-10-07 Caiqi Zhang , Zhijiang Guo , Andreas Vlachos

Fact checking can be an effective strategy against misinformation, but its implementation at scale is impeded by the overwhelming volume of information online. Recent artificial intelligence (AI) language models have shown impressive…

Human-Computer Interaction · Computer Science 2025-05-23 Matthew R. DeVerna , Harry Yaojun Yan , Kai-Cheng Yang , Filippo Menczer

Large language models (LLMs) are increasingly being used for complex research tasks such as literature review, idea generation, and scientific paper analysis, yet their ability to truly understand and process the intricate relationships…

Computation and Language · Computer Science 2025-06-11 Shashidhar Reddy Javaji , Yupeng Cao , Haohang Li , Yangyang Yu , Nikhil Muralidhar , Zining Zhu

The proliferation of misinformation necessitates scalable, automated fact-checking solutions. Yet, current benchmarks often overlook multilingual and topical diversity. This paper introduces a novel, dynamically extensible data set that…

Computers and Society · Computer Science 2025-10-22 Lorraine Saju , Arnim Bleier , Jana Lasser , Claudia Wagner

Large language models (LLMs) have raised hopes for automated end-to-end fact-checking, but prior studies report mixed results. As mainstream chatbots increasingly ship with reasoning capabilities and web search tools -- and millions of…

Computation and Language · Computer Science 2025-11-25 Matthew R. DeVerna , Kai-Cheng Yang , Harry Yaojun Yan , Filippo Menczer

Large language models (LLMs) have been increasingly applied to automated harmful content detection tasks, assisting moderators in identifying policy violations and improving the overall efficiency and accuracy of content review. However,…

Computation and Language · Computer Science 2025-08-14 Kangwei Liu , Siyuan Cheng , Bozhong Tian , Xiaozhuan Liang , Yuyang Yin , Meng Han , Ningyu Zhang , Bryan Hooi , Xi Chen , Shumin Deng

In the digital age, the prevalence of misleading news headlines poses a significant challenge to information integrity, necessitating robust detection mechanisms. This study explores the efficacy of Large Language Models (LLMs) in…

Computation and Language · Computer Science 2024-05-07 Md Main Uddin Rony , Md Mahfuzul Haque , Mohammad Ali , Ahmed Shatil Alam , Naeemul Hassan

Short-video platforms have become major channels for misinformation, where deceptive claims frequently leverage visual experiments and social cues. While Multimodal Large Language Models (MLLMs) have demonstrated impressive reasoning…

Computation and Language · Computer Science 2026-05-19 Jen-tse Huang , Chang Chen , Shiyang Lai , Wenxuan Wang , Michelle R. Kaufman , Mark Dredze

Recent advances in large language models (LLMs) have shown that they can answer questions requiring complex reasoning. However, their ability to identify and respond to text containing logical fallacies or deliberately misleading premises…

Computation and Language · Computer Science 2025-02-19 Zenan Zhai , Hao Li , Xudong Han , Zhenxuan Zhang , Yixuan Zhang , Timothy Baldwin , Haonan Li

A prominent weakness of modern language models (LMs) is their tendency to generate factually incorrect text, which hinders their usability. A natural question is whether such factual errors can be detected automatically. Inspired by…

Computation and Language · Computer Science 2023-05-23 Roi Cohen , May Hamri , Mor Geva , Amir Globerson

Traditional fact-checking relies on humans to formulate relevant and targeted fact-checking questions (FCQs), search for evidence, and verify the factuality of claims. While Large Language Models (LLMs) have been commonly used to automate…

Computation and Language · Computer Science 2025-02-24 Alimohammad Beigi , Bohan Jiang , Dawei Li , Zhen Tan , Pouya Shaeri , Tharindu Kumarage , Amrita Bhattacharjee , Huan Liu

The prevalence of unwarranted beliefs, spanning pseudoscience, logical fallacies, and conspiracy theories, presents substantial societal hurdles and the risk of disseminating misinformation. Utilizing established psychometric assessments,…

Artificial Intelligence · Computer Science 2024-05-03 Sowmya S Sundaram , Balaji Alwar

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

As the modern tools of choice for text understanding and generation, large language models (LLMs) are expected to accurately output answers by leveraging the input context. This requires LLMs to possess both context-faithfulness and factual…

Computation and Language · Computer Science 2024-10-07 Baolong Bi , Shenghua Liu , Yiwei Wang , Lingrui Mei , Junfeng Fang , Hongcheng Gao , Shiyu Ni , Xueqi Cheng