English
Related papers

Related papers: On Learning Multi-Modal Forgery Representation for…

200 papers

Over the past decade, there has been tremendous progress in creating synthetic media, mainly thanks to the development of powerful methods based on generative adversarial networks (GAN). Very recently, methods based on diffusion models (DM)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Riccardo Corvi , Davide Cozzolino , Giada Zingarini , Giovanni Poggi , Koki Nagano , Luisa Verdoliva

Rapid advances in Artificial Intelligence Generated Content (AIGC) have enabled increasingly sophisticated face forgeries, posing a significant threat to social security. However, current Deepfake detection methods are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Changtao Miao , Yi Zhang , Man Luo , Weiwei Feng , Kaiyuan Zheng , Qi Chu , Tao Gong , Jianshu Li , Yunfeng Diao , Wei Zhou , Joey Tianyi Zhou , Xiaoshuai Hao

Diffusion models (DMs) have revolutionized image generation, producing high-quality images with applications spanning various fields. However, their ability to create hyper-realistic images poses significant challenges in distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Santosh , Li Lin , Irene Amerini , Xin Wang , Shu Hu

With the continuous improvements of deepfake methods, forgery messages have transitioned from single-modality to multi-modal fusion, posing new challenges for existing forgery detection algorithms. In this paper, we propose AVT2-DWF, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Rui Wang , Dengpan Ye , Long Tang , Yunming Zhang , Jiacheng Deng

We introduce a novel approach for high-resolution talking head generation from a single image and audio input. Prior methods using explicit face models, like 3D morphable models (3DMM) and facial landmarks, often fall short in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Sejong Yang , Seoung Wug Oh , Yang Zhou , Seon Joo Kim

The rapid progress in generative models has given rise to the critical task of AI-Generated Content Stealth (AIGC-S), which aims to create AI-generated images that can evade both forensic detectors and human inspection. This task is crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Ziyin Zhou , Ke Sun , Zhongxi Chen , Huafeng Kuang , Xiaoshuai Sun , Rongrong Ji

This work introduces RGBX-DiffusionDet, an object detection framework extending the DiffusionDet model to fuse the heterogeneous 2D data (X) with RGB imagery via an adaptive multimodal encoder. To enable cross-modal interaction, we design…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Eliraz Orfaig , Inna Stainvas , Igal Bilik

In recent years, with the rapid development of face editing and generation, more and more fake videos are circulating on social media, which has caused extreme public concerns. Existing face forgery detection methods based on frequency…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Yukai Wang , Chunlei Peng , Decheng Liu , Nannan Wang , Xinbo Gao

Multimodal deepfakes involving audiovisual manipulations are a growing threat because they are difficult to detect with the naked eye or using unimodal deep learningbased forgery detection methods. Audiovisual forensic models, while more…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

The increasing realism and accessibility of deepfakes have raised critical concerns about media authenticity and information integrity. Despite recent advances, deepfake detection models often struggle to generalize beyond their training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Stelios Mylonas , Symeon Papadopoulos

Face-to-face communication is a common scenario including roles of speakers and listeners. Most existing research methods focus on producing speaker videos, while the generation of listener heads remains largely overlooked. Responsive…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Jin Liu , Xi Wang , Xiaomeng Fu , Yesheng Chai , Cai Yu , Jiao Dai , Jizhong Han

Face forgery detection plays an important role in personal privacy and social security. With the development of adversarial generative models, high-quality forgery images become more and more indistinguishable from real to humans. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Decheng Liu , Zeyang Zheng , Chunlei Peng , Yukai Wang , Nannan Wang , Xinbo Gao

In recent years, diffusion models have become one of the main methods for generating images. However, detecting images generated by these models remains a challenging task. This paper proposes a novel method for detecting images generated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Dmitry Vesnin , Dmitry Levshun , Andrey Chechulin

The rapid advancement of video generation models has enabled the creation of highly realistic synthetic media, raising significant societal concerns regarding the spread of misinformation. However, current detection methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Zhengcen Li , Chenyang Jiang , Hang Zhao , Shiyang Zhou , Yunyang Mo , Feng Gao , Fan Yang , Qiben Shan , Shaocong Wu , Jingyong Su

In recent years, the explosive advancement of deepfake technology has posed a critical and escalating threat to public security: diffusion-based digital human generation. Unlike traditional face manipulation methods, such models can…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Jiaxin Liu , Jia Wang , Saihui Hou , Min Ren , Huijia Wu , Long Ma , Renwang Pei , Zhaofeng He

With the rapid growth in deepfake video content, we require improved and generalizable methods to detect them. Most existing detection methods either use uni-modal cues or rely on supervised training to capture the dissonance between the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Trevine Oorloff , Surya Koppisetti , Nicolò Bonettini , Divyaraj Solanki , Ben Colman , Yaser Yacoob , Ali Shahriyari , Gaurav Bharaj

Diffusion models are known for generating high-quality images, causing serious security concerns. To combat this, most efforts rely on deep neural networks (e.g., CNNs and Transformers), while largely overlooking the potential of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Mengxin Fu , Yuezun Li

Multi-modality image fusion aims to combine different modalities to produce fused images that retain the complementary features of each modality, such as functional highlights and texture details. To leverage strong generative priors and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zixiang Zhao , Haowen Bai , Yuanzhi Zhu , Jiangshe Zhang , Shuang Xu , Yulun Zhang , Kai Zhang , Deyu Meng , Radu Timofte , Luc Van Gool

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

Recent advancements in "deepfake" techniques have paved the way for generating various media forgeries. In response to the potential hazards of these media forgeries, many researchers engage in exploring detection methods, increasing the…

Multimedia · Computer Science 2024-08-08 Junhao Xu , Jingjing Chen , Xue Song , Feng Han , Haijun Shan , Yugang Jiang