English
Related papers

Related papers: Unsupervised Multimodal Deepfake Detection Using I…

200 papers

Deepfake has recently raised a plethora of societal concerns over its possible security threats and dissemination of fake information. Much research on deepfake detection has been undertaken. However, detecting low quality as well as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Binh M. Le , Simon S. Woo

We propose detection of deepfake videos based on the dissimilarity between the audio and visual modalities, termed as the Modality Dissonance Score (MDS). We hypothesize that manipulation of either modality will lead to dis-harmony between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Komal Chugh , Parul Gupta , Abhinav Dhall , Ramanathan Subramanian

Online media data, in the forms of images and videos, are becoming mainstream communication channels. However, recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Junke Wang , Zhenxin Li , Chao Zhang , Jingjing Chen , Zuxuan Wu , Larry S. Davis , Yu-Gang Jiang

Social media is currently being used by many individuals online as a major source of information. However, not all information shared online is true, even photos and videos can be doctored. Deepfakes have recently risen with the rise of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Jacob mallet , Laura Pryor , Rushit Dave , Mounika Vanamala

The rapid advancement of deep learning models that can generate and synthesis hyper-realistic videos known as Deepfakes and their ease of access to the general public have raised concern from all concerned bodies to their possible malicious…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Deressa Wodajo , Solomon Atnafu

Generative models have enabled the creation of highly realistic facial-synthetic images, raising significant concerns due to their potential for misuse. Despite rapid advancements in the field of deepfake detection, developing efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yue-Hua Han , Tai-Ming Huang , Kai-Lung Hua , Jun-Cheng Chen

Deepfakes is a branch of malicious techniques that transplant a target face to the original one in videos, resulting in serious problems such as infringement of copyright, confusion of information, or even public panic. Previous efforts for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Zekun Sun , Yujie Han , Zeyu Hua , Na Ruan , Weijia Jia

Multi-face deepfake videos are becoming increasingly prevalent, often appearing in natural social settings that challenge existing detection methods. Most current approaches excel at single-face detection but struggle in multi-face…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Juan Hu , Shaojing Fan , Terence Sim

Existing methods on audio-visual deepfake detection mainly focus on high-level features for modeling inconsistencies between audio and visual data. As a result, these approaches usually overlook finer audio-visual artifacts, which are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Conspicuous progression in the field of machine learning and deep learning have led the jump of highly realistic fake media, these media oftentimes referred as deepfakes. Deepfakes are fabricated media which are generated by sophisticated…

Machine Learning · Computer Science 2023-04-05 Aniruddha Tiwari , Rushit Dave , Mounika Vanamala

We introduce FakeParts, a new class of deepfakes characterized by subtle, localized manipulations to specific spatial regions or temporal segments of otherwise authentic videos. Unlike fully synthetic content, these partial manipulations -…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Ziyi Liu , Firas Gabetni , Awais Hussain Sani , Xi Wang , Soobash Daiboo , Gaetan Brison , Gianni Franchi , Vicky Kalogeiton

Deepfake technology has given rise to a spectrum of novel and compelling applications. Unfortunately, the widespread proliferation of high-fidelity fake videos has led to pervasive confusion and deception, shattering our faith that seeing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongjie Ba , Qingyu Liu , Zhenguang Liu , Shuang Wu , Feng Lin , Li Lu , Kui Ren

Easy access to audio-visual content on social media, combined with the availability of modern tools such as Tensorflow or Keras, open-source trained models, and economical computing infrastructure, and the rapid evolution of deep-learning…

Cryptography and Security · Computer Science 2021-11-24 Momina Masood , Marriam Nawaz , Khalid Mahmood Malik , Ali Javed , Aun Irtaza

Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. In this paper, we propose a novel video transformer with incremental learning for detecting deepfake videos. To better align the input…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Sohail A. Khan , Hang Dai

The recent realistic creation and dissemination of so-called deepfakes poses a serious threat to social life, civil rest, and law. Celebrity defaming, election manipulation, and deepfakes as evidence in court of law are few potential…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Muhammad Umar Farooq , Ali Javed , Khalid Mahmood Malik , Muhammad Anas Raza

The detection of digital face manipulation in video has attracted extensive attention due to the increased risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Yuhang Lu , Touradj Ebrahimi

The combination of highly realistic voice cloning, along with visually compelling avatar, face-swap, or lip-sync deepfake video generation, makes it relatively easy to create a video of anyone saying anything. Today, such deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Justin D. Norman , Hany Farid

Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, which can result in…

Multimedia · Computer Science 2023-05-11 Juan Hu , Xin Liao , Difei Gao , Satoshi Tsutsui , Qian Wang , Zheng Qin , Mike Zheng Shou

Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, which can result in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Juan Hu , Xin Liao , Difei Gao , Satoshi Tsutsui , Qian Wang , Zheng Qin , Mike Zheng Shou

Applications of deep learning to synthetic media generation allow the creation of convincing forgeries, called DeepFakes, with limited technical expertise. DeepFake detection is an increasingly active research area. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Kevin Lutz , Robert Bassett