English
Related papers

Related papers: Multimodal Graph Learning for Deepfake Detection

200 papers

Deepfake detection faces increasing challenges since the fast growth of generative models in developing massive and diverse Deepfake technologies. Recent advances rely on introducing heuristic features from spatial or frequency domains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zifeng Li , Wenzhong Tang , Shijun Gao , Shuai Wang , Yanxiang Wang

The widespread dissemination of Deepfakes demands effective approaches that can detect perceptually convincing forged images. In this paper, we aim to capture the subtle manipulation artifacts at different scales using transformer models.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Junke Wang , Zuxuan Wu , Wenhao Ouyang , Xintong Han , Jingjing Chen , Ser-Nam Lim , Yu-Gang Jiang

Generative models achieve remarkable results in multiple data domains, including images and texts, among other examples. Unfortunately, malicious users exploit synthetic media for spreading misinformation and disseminating deepfakes.…

Artificial Intelligence · Computer Science 2025-08-04 Tom Or , Omri Azencot

The rise of deepfake technology brings forth new questions about the authenticity of various forms of media found online today. Videos and images generated by artificial intelligence (AI) have become increasingly more difficult to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Benjamin Carter , Nathan Dilla , Micheal Callahan , Atuhaire Ambala

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…

Information Retrieval · Computer Science 2026-04-08 Sijun Dai , Qiang Huang , Xiaoxing You , Jun Yu

Multivariate time series forecasting is a challenging task because the data involves a mixture of long- and short-term patterns, with dynamic spatio-temporal dependencies among variables. Existing graph neural networks (GNN) typically model…

Machine Learning · Computer Science 2021-12-08 Zhuoling Li , Gaowei Zhang , Lingyu Xu , Jie Yu

Representation learning in dynamic graphs is a challenging problem because the topology of graph and node features vary at different time. This requires the model to be able to effectively capture both graph topology information and…

Machine Learning · Computer Science 2021-11-16 Xintao Xiang , Tiancheng Huang , Donglin Wang

Multimodal time series (MTS) anomaly detection is crucial for maintaining the safety and stability of working devices (e.g., water treatment system and spacecraft), whose data are characterized by multivariate time series with diverse…

Machine Learning · Computer Science 2023-10-18 Chaoyue Ding , Shiliang Sun , Jing Zhao

With the rising prevalence of deepfakes, there is a growing interest in developing generalizable detection methods for various types of deepfakes. While effective in their specific modalities, traditional detection methods fall short in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Cai Yu , Shan Jia , Xiaomeng Fu , Jin Liu , Jiahe Tian , Jiao Dai , Xi Wang , Siwei Lyu , Jizhong Han

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

The increasing difficulty in accurately detecting forged images generated by AIGC(Artificial Intelligence Generative Content) poses many risks, necessitating the development of effective methods to identify and further locate forged areas.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yang Liu , Xiaofei Li , Jun Zhang , Shengze Hu , Jun Lei

Deepfake detectors face growing challenges in generalization as new image synthesis techniques emerge. In particular, deepfakes generated by diffusion models are highly photorealistic and often evade detectors trained on GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Hongyuan Qi , Wenjin Hou , Hehe Fan , Jun Xiao

The rapid evolution of deepfake generation technologies poses critical challenges for detection systems, as non-continual learning methods demand frequent and expensive retraining. We reframe deepfake detection (DFD) as a Continual Learning…

Machine Learning · Computer Science 2025-09-11 Federico Fontana , Anxhelo Diko , Romeo Lanzino , Marco Raoul Marini , Bachir Kaddar , Gian Luca Foresti , Luigi Cinque

The escalating complexity of network threats and the inherent class imbalance in traffic data present formidable challenges for modern Intrusion Detection Systems (IDS). While Graph Neural Networks (GNNs) excel in modeling topological…

Machine Learning · Computer Science 2026-04-15 Tianxiang Xu , Zhichao Wen , Xinyu Zhao , Qi Hu , Yan Li , Chang Liu

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

The rapid progress in deep generative models has led to the creation of incredibly realistic synthetic images that are becoming increasingly difficult to distinguish from real-world data. The widespread use of Variational Models, Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Anant Mehta , Bryant McArthur , Nagarjuna Kolloju , Zhengzhong Tu

Recent advances in face forgery techniques produce nearly visually untraceable deepfake videos, which could be leveraged with malicious intentions. As a result, researchers have been devoted to deepfake detection. Previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Jiazhi Guan , Hang Zhou , Zhibin Hong , Errui Ding , Jingdong Wang , Chengbin Quan , Youjian Zhao

Graph learning (GL) can dynamically capture the distribution structure (graph structure) of data based on graph convolutional networks (GCN), and the learning quality of the graph structure directly influences GCN for semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Guangfeng Lin , Xiaobing Kang , Kaiyang Liao , Fan Zhao , Yajun Chen

Most deepfake detection methods focus on detecting spatial and/or spatio-temporal changes in facial attributes and are centered around the binary classification task of detecting whether a video is real or fake. This is because available…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhixi Cai , Shreya Ghosh , Abhinav Dhall , Tom Gedeon , Kalin Stefanov , Munawar Hayat

The ever-increasing use of synthetically generated content in different sectors of our everyday life, one for all media information, poses a strong need for deepfake detection tools in order to avoid the proliferation of altered messages.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Andrea Ciamarra , Roberto Caldelli , Federico Becattini , Lorenzo Seidenari , Alberto Del Bimbo