English
Related papers

Related papers: VeriTaS: The First Dynamic Benchmark for Multimoda…

200 papers

Large language models (LLMs) have demonstrated remarkable progress in code generation, but many existing benchmarks are approaching saturation and offer little guarantee on the trustworthiness of the generated programs. To improve…

Software Engineering · Computer Science 2025-10-08 Xun Deng , Sicheng Zhong , Barış Bayazıt , Andreas Veneris , Fan Long , Xujie Si

Fact verification is essential for ensuring the reliability of LLM applications. In this study, we evaluate 12 pre-trained LLMs and one specialized fact-verifier, including frontier LLMs and open-weight reasoning LLMs, using a collection of…

Artificial Intelligence · Computer Science 2026-02-06 Wooseok Seo , Seungju Han , Jaehun Jung , Benjamin Newman , Seungwon Lim , Seungbeen Lee , Ximing Lu , Yejin Choi , Youngjae Yu

Large language models (LLMs) often fail to synthesize information from their context to generate an accurate response. This renders them unreliable in knowledge intensive settings where reliability of the output is key. A critical component…

Computation and Language · Computer Science 2024-11-06 Rajkumar Ramamurthy , Meghana Arakkal Rajeev , Oliver Molenschot , James Zou , Nazneen Rajani

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

Computation and Language · Computer Science 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

The misuse of advanced generative AI models has resulted in the widespread proliferation of falsified data, particularly forged human-centric audiovisual content, which poses substantial societal risks (e.g., financial fraud and social…

Cryptography and Security · Computer Science 2025-10-28 Kangran Zhao , Yupeng Chen , Xiaoyu Zhang , Yize Chen , Weinan Guan , Baicheng Chen , Chengzhe Sun , Soumyya Kanti Datta , Qingshan Liu , Siwei Lyu , Baoyuan Wu

Research on misinformation has focused almost exclusively on supply, asking what falsehoods circulate, who produces them, and whether corrections work. A basic demand-side question remains unanswered. When ordinary people can fact-check…

Human-Computer Interaction · Computer Science 2026-02-12 Bijean Ghafouri , Dorsaf Sallami , Luca Luceri , Taylor Lynn Curtis , Jean-Francois Godbout , Emilio Ferrara , Reihaneh Rabbany

Assessing the veracity of a claim made online is a complex and important task with real-world implications. When these claims are directed at communities with limited access to information and the content concerns issues such as healthcare…

The pervasiveness of large language models and generative AI in online media has amplified the need for effective automated fact-checking to assist fact-checkers in tackling the increasing volume and sophistication of misinformation. The…

Human-Computer Interaction · Computer Science 2025-05-13 Greta Warren , Irina Shklovski , Isabelle Augenstein

We introduce ClaimCheck, an LLM-guided automatic fact-checking system designed to verify real-world claims using live Web evidence and small language models. Unlike prior systems that rely on large, closed-source models and static knowledge…

Computation and Language · Computer Science 2025-10-03 Akshith Reddy Putta , Jacob Devasier , Chengkai Li

The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To…

Fact-checking systems with search-enabled large language models (LLMs) have shown strong potential for verifying claims by dynamically retrieving external evidence. However, the robustness of such systems against adversarial attack remains…

Cryptography and Security · Computer Science 2026-03-17 Haoran Ou , Kangjie Chen , Gelei Deng , Hangcheng Liu , Jie Zhang , Tianwei Zhang , Kwok-Yan Lam

Automatic fact-checking aims to support professional fact-checkers by offering tools that can help speed up manual fact-checking. Yet, existing frameworks fail to address the key step of producing output suitable for broader dissemination…

The rise of micro-videos has reshaped how misinformation spreads, amplifying its speed, reach, and impact on public trust. Existing benchmarks typically focus on a single deception type, overlooking the diversity of real-world cases that…

Social and Information Networks · Computer Science 2026-03-27 Zhi Zeng , Yifei Yang , Jiaying Wu , Xulang Zhang , Xiangzheng Kong , Herun Wan , Zihan Ma , Minnan Luo

While there has been substantial progress in developing systems to automate fact-checking, they still lack credibility in the eyes of the users. Thus, an interesting approach has emerged: to perform automatic fact-checking by verifying…

Computation and Language · Computer Science 2022-10-11 Momchil Hardalov , Anton Chernyavskiy , Ivan Koychev , Dmitry Ilvovsky , Preslav Nakov

Evaluating large language models (LLMs) on question answering often relies on static benchmarks that reward memorization and understate the role of retrieval, failing to capture the dynamic nature of world knowledge. We present…

Computation and Language · Computer Science 2025-11-07 Heng Zhou , Ao Yu , Yuchen Fan , Jianing Shi , Li Kang , Hejia Geng , Yongting Zhang , Yutao Fan , Yuhao Wu , Tiancheng He , Yiran Qin , Lei Bai , Zhenfei Yin

Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation. In this paper, we present an automated fact-checking platform which given a…

Computation and Language · Computer Science 2019-04-04 Sebastião Miranda , David Nogueira , Afonso Mendes , Andreas Vlachos , Andrew Secker , Rebecca Garrett , Jeff Mitchel , Zita Marinho

This article presents a pipeline for automated fact-checking leveraging publicly available Language Models and data. The objective is to assess the accuracy of textual claims using evidence from a ground-truth evidence corpus. The pipeline…

Computation and Language · Computer Science 2024-08-23 Jan Drchal , Herbert Ullrich , Tomáš Mlynář , Václav Moravec

Automated data visualization plays a crucial role in simplifying data interpretation, enhancing decision-making, and improving efficiency. While large language models (LLMs) have shown promise in generating visualizations from natural…

Computation and Language · Computer Science 2025-07-29 Mizanur Rahman , Md Tahmid Rahman Laskar , Shafiq Joty , Enamul Hoque

In the context of fact-checking, claims are often repeated across various platforms and in different languages, which can benefit from a process that reduces this redundancy. While retrieving previously fact-checked claims has been…

Computation and Language · Computer Science 2025-03-31 Rrubaa Panchendrarajan , Rubén Míguez , Arkaitz Zubiaga