English
Related papers

Related papers: A Guide to Misinformation Detection Data and Evalu…

200 papers

The spread of misinformation is a pressing global problem that has elicited a range of responses from researchers, policymakers, civil society and industry. Over the past decade, these stakeholders have developed many interventions to…

Computers and Society · Computer Science 2022-12-23 Pica Johansson , Florence Enock , Scott Hale , Bertie Vidgen , Cassidy Bereskin , Helen Margetts , Jonathan Bright

As social media becomes increasingly prominent in our day to day lives, it is increasingly important to detect informative content and prevent the spread of disinformation and unverified rumours. While many sophisticated and successful…

Computation and Language · Computer Science 2021-04-15 Kellin Pelrine , Jacob Danovitch , Reihaneh Rabbany

The automatic detection of disinformation presents a significant challenge in the field of natural language processing. This task addresses a multifaceted societal and communication issue, which needs approaches that extend beyond the…

Computation and Language · Computer Science 2025-02-10 Santiago González-Silot , Andrés Montoro-Montarroso , Eugenio Martínez Cámara , Juan Gómez-Romero

Datasets have played a foundational role in the advancement of machine learning research. They form the basis for the models we design and deploy, as well as our primary medium for benchmarking and evaluation. Furthermore, the ways in which…

Machine Learning · Computer Science 2021-11-16 Amandalynne Paullada , Inioluwa Deborah Raji , Emily M. Bender , Emily Denton , Alex Hanna

The massive spread of misinformation in social networks has become a global risk, implicitly influencing public opinion and threatening social/political development. Misinformation detection (MID) has thus become a surging research topic in…

Social and Information Networks · Computer Science 2019-09-10 Bin Guo , Yasan Ding , Lina Yao , Yunji Liang , Zhiwen Yu

Inconsistent political statements represent a form of misinformation. They erode public trust and pose challenges to accountability, when left unnoticed. Detecting inconsistencies automatically could support journalists in asking…

Computation and Language · Computer Science 2025-05-27 Nursulu Sagimbayeva , Ruveyda Betül Bahçeci , Ingmar Weber

Mis- and disinformation online have become a major societal problem as major sources of online harms of different kinds. One common form of mis- and disinformation is out-of-context (OOC) information, where different pieces of information…

Computation and Language · Computer Science 2025-09-09 Xin Yuan , Jie Guo , Weidong Qiu , Zheng Huang , Shujun Li

Misinformation detection models often rely on superficial cues (i.e., \emph{shortcuts}) that correlate with misinformation in training data but fail to generalize to the diverse and evolving nature of real-world misinformation. This issue…

Computation and Language · Computer Science 2025-06-04 Herun Wan , Jiaying Wu , Minnan Luo , Zhi Zeng , Zhixiong Su

Annotated data is an essential ingredient in natural language processing for training and evaluating machine learning models. It is therefore very desirable for the annotations to be of high quality. Recent work, however, has shown that…

Computation and Language · Computer Science 2022-09-27 Jan-Christoph Klie , Bonnie Webber , Iryna Gurevych

The quality of underlying training data is very crucial for building performant machine learning models with wider generalizabilty. However, current machine learning (ML) tools lack streamlined processes for improving the data quality. So,…

Machine Learning · Computer Science 2021-12-16 Atindriyo Sanyal , Vikram Chatterji , Nidhi Vyas , Ben Epstein , Nikita Demir , Anthony Corletti

The rise of micro-videos has reshaped how misinformation spreads, amplifying its speed, reach, and impact on public trust. Existing benchmarks typically focus on a single deception type, overlooking the diversity of real-world cases that…

Social and Information Networks · Computer Science 2026-03-27 Zhi Zeng , Yifei Yang , Jiaying Wu , Xulang Zhang , Xiangzheng Kong , Herun Wan , Zihan Ma , Minnan Luo

Misinformation posting and spreading in Social Media is ignited by personal decisions on the truthfulness of news that may cause wide and deep cascades at a large scale in a fraction of minutes. When individuals are exposed to information,…

Computers and Society · Computer Science 2022-10-11 Giancarlo Ruffo , Alfonso Semeraro

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic…

Computation and Language · Computer Science 2024-10-01 Fengzhu Zeng , Wenqian Li , Wei Gao , Yan Pang

Recent years have witnessed the sustained evolution of misinformation that aims at manipulating public opinions. Unlike traditional rumors or fake news editors who mainly rely on generated and/or counterfeited images, text and videos,…

Computation and Language · Computer Science 2024-04-09 Yizhou Zhang , Loc Trinh , Defu Cao , Zijun Cui , Yan Liu

Fake news has now grown into a big problem for societies and also a major challenge for people fighting disinformation. This phenomenon plagues democratic elections, reputations of individual persons or organizations, and has negatively…

We present PeerQA, a real-world, scientific, document-level Question Answering (QA) dataset. PeerQA questions have been sourced from peer reviews, which contain questions that reviewers raised while thoroughly examining the scientific…

Computation and Language · Computer Science 2025-02-20 Tim Baumgärtner , Ted Briscoe , Iryna Gurevych

The rapid advancement of generative models in creating highly realistic images poses substantial risks for misinformation dissemination. For instance, a synthetic image, when shared on social media, can mislead extensive audiences and erode…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Zhenglin Huang , Jinwei Hu , Xiangtai Li , Yiwei He , Xingyu Zhao , Bei Peng , Baoyuan Wu , Xiaowei Huang , Guangliang Cheng

The landscape of social media content has evolved significantly, extending from text to multimodal formats. This evolution presents a significant challenge in combating misinformation. Previous research has primarily focused on single…

Multimedia · Computer Science 2024-09-04 Zhe Fu , Kanlun Wang , Wangjiaxuan Xin , Lina Zhou , Shi Chen , Yaorong Ge , Daniel Janies , Dongsong Zhang

Classification in the context of multi-label data streams represents a challenge that has attracted significant attention due to its high real-world applicability. However, this task faces problems inherent to dynamic environments, such as…

Machine Learning · Computer Science 2025-08-26 H. Freire-Oliveira , E. R. F. Paiva , J. Gama , L. Khan , R. Cerri

Misinformation propagation in online social networks has become an increasingly challenging problem. Although many studies exist to solve the problem computationally, a permanent and robust solution is yet to be discovered. In this study,…

Social and Information Networks · Computer Science 2023-03-21 Tolga Yilmaz , Özgür Ulusoy