English
Related papers

Related papers: Integrating Audio-Visual Features for Multimodal D…

200 papers

Deepfakes, synthetic media created using advanced AI techniques, pose a growing threat to information integrity, particularly in politically sensitive contexts. This challenge is amplified by the increasing realism of modern generative…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Victor Livernoche , Akshatha Arodi , Andreea Musulan , Zachary Yang , Adam Salvail , Gaétan Marceau Caron , Jean-François Godbout , Reihaneh Rabbany

A lip-syncing deepfake is a digitally manipulated video in which a person's lip movements are created convincingly using AI models to match altered or entirely new audio. Lip-syncing deepfakes are a dangerous type of deepfakes as the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

Deep learning has enabled realistic face manipulation (i.e., deepfake), which poses significant concerns over the integrity of the media in circulation. Most existing deep learning techniques for deepfake detection can achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Bosheng Yan , Chang-Tsun Li , Xuequan Lu

Deep-learning-based technologies such as deepfakes ones have been attracting widespread attention in both society and academia, particularly ones used to synthesize forged face images. These automatic and professional-skill-free face…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 YuYang Sun , ZhiYong Zhang , Isao Echizen , Huy H. Nguyen , ChangZhen Qiu , Lu Sun

The misuse of deepfake technology by malicious actors poses a potential threat to nations, societies, and individuals. However, existing methods for detecting deepfakes primarily focus on uncompressed videos, such as noise characteristics,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zongmei Chen , Xin Liao , Xiaoshuai Wu , Yanxiang Chen

Current DeepFake detection scenarios are mostly binary, yet data manipulation can vary across audio, video, or both, whose variability is not captured in binary settings. Four-class audio-visual formulations address this by discriminating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sharayu Nilesh Deshmukh , Kailash A. Hambarde , Joana C. Costa , Hugo Proença , Tiago Roxo

A new algorithm for the detection of deepfakes in digital videos is presented. The I-frames were extracted in order to provide faster computation and analysis than approaches described in the literature. To identify the discriminating…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Luca Guarnera , Salvatore Manganello , Sebastiano Battiato

Face forgery by deepfake is widely spread over the internet and has raised severe societal concerns. Recently, how to detect such forgery contents has become a hot research topic and many deepfake detection methods have been proposed. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Hanqing Zhao , Wenbo Zhou , Dongdong Chen , Tianyi Wei , Weiming Zhang , Nenghai Yu

Recent advances in Generative AI (GenAI) have led to significant improvements in the quality of generated visual content. As AI-generated visual content becomes increasingly indistinguishable from real content, the challenge of detecting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Keerthi Veeramachaneni , Praveen Tirupattur , Amrit Singh Bedi , Mubarak Shah

The rapid proliferation of AI-generated visual media has created an urgent need for efficient, trustworthy deepfake detection systems. However, existing deep learning-based detection methods rely on computationally intensive and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Parnian Ghapandar Kashani , Shiqi Chen , Aydogan Ozcan

It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Pavel Korshunov , Sebastien Marcel

With the rise in manipulated media, deepfake detection has become an imperative task for preserving the authenticity of digital content. In this paper, we present a novel multi-modal audio-video framework designed to concurrently process…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Aaditya Kharel , Manas Paranjape , Aniket Bera

Online media data, in the forms of images and videos, are becoming mainstream communication channels. However, recent advances in deep learning, particularly deep generative models, open the doors for producing perceptually convincing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Junke Wang , Zhenxin Li , Chao Zhang , Jingjing Chen , Zuxuan Wu , Larry S. Davis , Yu-Gang Jiang

Recent advances in deepfake generating algorithms that produce manipulated media have had dangerous implications in privacy, security and mass communication. Efforts to combat this issue have risen in the form of competitions and funding…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Armaan Pishori , Brittany Rollins , Nicolas van Houten , Nisha Chatwani , Omar Uraimov

Recent multimodal deepfake detection methods designed for generalization conjecture that single-stage supervised training struggles to generalize across unseen manipulations and datasets. However, such approaches that target generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Ashutosh Anshul , Shreyas Gopal , Deepu Rajan , Eng Siong Chng

Deepfake is the manipulated video made with a generative deep learning technique such as Generative Adversarial Networks (GANs) or Auto Encoder that anyone can utilize. Recently, with the increase of Deepfake videos, some classifiers…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Young-Jin Heo , Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

Automated deception detection is crucial for assisting humans in accurately assessing truthfulness and identifying deceptive behavior. Conventional contact-based techniques, like polygraph devices, rely on physiological signals to determine…

While the technologies empowering malicious audio deepfakes have dramatically evolved in recent years due to generative AI advances, the same cannot be said of global research into spoofing (deepfake) countermeasures. This paper highlights…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-16 Héctor Delgado , Giorgio Ramondetti , Emanuele Dalmasso , Gennady Karvitsky , Daniele Colibro , Haydar Talib

We introduce FakeParts, a new class of deepfakes characterized by subtle, localized manipulations to specific spatial regions or temporal segments of otherwise authentic videos. Unlike fully synthetic content, these partial manipulations -…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Ziyi Liu , Firas Gabetni , Awais Hussain Sani , Xi Wang , Soobash Daiboo , Gaetan Brison , Gianni Franchi , Vicky Kalogeiton

Deepfake videos, produced through advanced artificial intelligence methods now a days, pose a new challenge to the truthfulness of the digital media. As Deepfake becomes more convincing day by day, detecting them requires advanced methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mahmudul Hasan , Sadia Ruhama , Sabrina Tajnim Sithi , Chowdhury Mohammad Mutamir Samit , Oindrila Saha