English
Related papers

Related papers: Characterizing AI-Generated Misinformation on Soci…

200 papers

Much of the research and discourse on risks from artificial intelligence (AI) image generators, such as DALL-E and Midjourney, has centered around whether they could be used to inject false information into political discourse. We show that…

Computers and Society · Computer Science 2024-03-20 Renee DiResta , Josh A. Goldstein

Recent advancements in deep learning generative models have raised concerns as they can create highly convincing counterfeit images and videos. This poses a threat to people's integrity and can lead to social instability. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Leandro A. Passos , Danilo Jodas , Kelton A. P. da Costa , Luis A. Souza Júnior , Douglas Rodrigues , Javier Del Ser , David Camacho , João Paulo Papa

AI-enhanced scams now employ deepfake technology to produce convincing audio and visual impersonations of trusted family members, often grandchildren, in real time. These attacks fabricate urgent scenarios, such as legal or medical…

Computers and Society · Computer Science 2025-08-18 Karina LaRubbio , Alyssa Lanter , Seihyun Lee , Mahima Ramesh , Diana Freed

Despite widespread concerns about the risks of AI-generated content (AIGC) to the integrity of social media discourse, little is known about its scale and scope, the actors responsible for its dissemination online, and the user responses it…

Social and Information Networks · Computer Science 2025-05-15 Zhiyi Chen , Jinyi Ye , Beverlyn Tsai , Emilio Ferrara , Luca Luceri

Social media's unfettered access has made it an important venue for health discussion and a resource for patients and their loved ones. However, the quality of the information available, as well as the motivations of its posters, has been…

Computers and Society · Computer Science 2018-09-10 Amira Ghenai , Yelena Mejova

Misinformation spread through social media has become a fundamental challenge in modern society. Recent studies have evaluated various strategies for addressing this problem, such as by modifying social media platforms or educating people…

Human-Computer Interaction · Computer Science 2022-05-03 Jacqueline Urakami , Yeongdae Kim , Hiroki Oura , Katie Seaborn

Artificial intelligence (AI) comes with great opportunities but can also pose significant risks. Automatically generated explanations for decisions can increase transparency and foster trust, especially for systems based on automated…

Machine Learning · Computer Science 2021-12-03 Johannes Schneider , Christian Meske , Michalis Vlachos

Progress in generative modelling, especially generative adversarial networks, have made it possible to efficiently synthesize and alter media at scale. Malicious individuals now rely on these machine-generated media, or deepfakes, to…

Machine Learning · Computer Science 2021-03-05 Baiwu Zhang , Jin Peng Zhou , Ilia Shumailov , Nicolas Papernot

Research on misinformation has focused almost exclusively on supply, asking what falsehoods circulate, who produces them, and whether corrections work. A basic demand-side question remains unanswered. When ordinary people can fact-check…

Human-Computer Interaction · Computer Science 2026-02-12 Bijean Ghafouri , Dorsaf Sallami , Luca Luceri , Taylor Lynn Curtis , Jean-Francois Godbout , Emilio Ferrara , Reihaneh Rabbany

Infodemics and health misinformation have significant negative impact on individuals and society, exacerbating confusion and increasing hesitancy in adopting recommended health measures. Recent advancements in generative AI, capable of…

Computation and Language · Computer Science 2025-11-26 Zhihao Zhang , Yiran Zhang , Xiyue Zhou , Liting Huang , Imran Razzak , Preslav Nakov , Usman Naseem

This work examines the influence of misinformation and the role of AI agents, called bots, on social network platforms. To quantify the impact of misinformation, it proposes two new metrics based on attributes of tweet engagement and user…

Social and Information Networks · Computer Science 2025-05-08 Lynnette Hui Xian Ng , Wenqi Zhou , Kathleen M. Carley

A deepfake is a photo or video of a person whose image has been digitally altered or partially replaced with an image of someone else. Deepfakes have the potential to cause a variety of problems and are often used maliciously. A common…

Artificial Intelligence · Computer Science 2024-09-01 Natalie Krueger , Mounika Vanamala , Rushit Dave

Despite the influence that image-based communication has on online discourse, the role played by images in disinformation is still not well understood. In this paper, we present the first large-scale study of fauxtography, analyzing the use…

Online misinformation poses a global risk with harmful implications for society. Ordinary social media users are known to actively reply to misinformation posts with counter-misinformation messages, which is shown to be effective in…

Social and Information Networks · Computer Science 2024-03-11 Bing He , Yingchen Ma , Mustaque Ahamad , Srijan Kumar

Social media are pervaded by unsubstantiated or untruthful rumors, that contribute to the alarming phenomenon of misinformation. The widespread presence of a heterogeneous mass of information sources may affect the mechanisms behind the…

Social and Information Networks · Computer Science 2017-07-11 Fabiana Zollo , Walter Quattrociocchi

In 2019, outbreaks of vaccine-preventable diseases reached the highest number in the US since 1992. Medical misinformation, such as antivaccine content propagating through social media, is associated with increases in vaccine delay and…

Multimedia · Computer Science 2020-12-29 Zuhui Wang , Zhaozheng Yin , Young Anna Argyris

Generative Artificial Intelligence (GenAI) and Large Language Models (LLMs) are marvels of technology; celebrated for their prowess in natural language processing and multimodal content generation, they promise a transformative future. But…

Computers and Society · Computer Science 2024-02-23 Emilio Ferrara

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

With the advent of social media, an increasing number of netizens are sharing and reading posts and news online. However, the huge volumes of misinformation (e.g., fake news and rumors) that flood the internet can adversely affect people's…

Computation and Language · Computer Science 2024-02-15 Zhiwei Liu , Tianlin Zhang , Kailai Yang , Paul Thompson , Zeping Yu , Sophia Ananiadou

Recent advances in large language models (LLMs) have enabled the large-scale generation of highly fluent and deceptive news-like content. While prior work has often treated fake news detection as a binary classification problem, modern fake…

Computation and Language · Computer Science 2026-04-13 Xinyu Wang , Sai Koneru , Wenbo Zhang , Wenliang Zheng , Saksham Ranjan , Sarah Rajtmajer