English
Related papers

Related papers: Not made for each other- Audio-Visual Dissonance-b…

200 papers

In recent years, DeepFake technology has achieved unprecedented success in high-quality video synthesis, but these methods also pose potential and severe security threats to humanity. DeepFake can be bifurcated into entertainment…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Weifeng Liu , Tianyi She , Jiawei Liu , Boheng Li , Dongyu Yao , Ziyou Liang , Run Wang

As computer-generated content and deepfakes make steady improvements, semantic approaches to multimedia forensics will become more important. In this paper, we introduce a novel classification architecture for identifying semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Scott McCrae , Kehan Wang , Avideh Zakhor

Significant advancements made in the generation of deepfakes have caused security and privacy issues. Attackers can easily impersonate a person's identity in an image by replacing his face with the target person's face. Moreover, a new…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Hasam Khalid , Minha Kim , Shahroz Tariq , Simon S. Woo

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

Sound · Computer Science 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of the most challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

We present a learning-based method for detecting real and fake deepfake multimedia content. To maximize information for learning, we extract and analyze the similarity between the two audio and visual modalities from within the same video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

In today's era of digital misinformation, we are increasingly faced with new threats posed by video falsification techniques. Such falsifications range from cheapfakes (e.g., lookalikes or audio dubbing) to deepfakes (e.g., sophisticated AI…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Shruti Agarwal , Liwen Hu , Evonne Ng , Trevor Darrell , Hao Li , Anna Rohrbach

Multimodal deepfakes can exhibit subtle visual artifacts and cross-modal inconsistencies, which remain challenging to detect, especially when detectors are trained primarily on curated synthetic forgeries. Such synthetic dependence can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sahibzada Adil Shahzad , Ammarah Hashmi , Junichi Yamagishi , Yusuke Yasuda , Yu Tsao , Chia-Wen Lin , Yan-Tsung Peng , Hsin-Min Wang

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

Multimodal manipulations (also known as audio-visual deepfakes) make it difficult for unimodal deepfake detectors to detect forgeries in multimedia content. To avoid the spread of false propaganda and fake news, timely detection is crucial.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Sahibzada Adil Shahzad , Ammarah Hashmi , Yan-Tsung Peng , Yu Tsao , Hsin-Min Wang

Deep-learning-based technologies such as deepfakes ones have been attracting widespread attention in both society and academia, particularly ones used to synthesize forged face images. These automatic and professional-skill-free face…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 YuYang Sun , ZhiYong Zhang , Isao Echizen , Huy H. Nguyen , ChangZhen Qiu , Lu Sun

Audio-Visual Segmentation (AVS) aims to identify, at the pixel level, the object in a visual scene that produces a given sound. Current AVS methods rely on costly fine-grained annotations of mask-audio pairs, making them impractical for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Swapnil Bhosale , Haosen Yang , Diptesh Kanojia , Jiangkang Deng , Xiatian Zhu

In this paper, we propose an enhanced audio-visual deep detection method. Recent methods in audio-visual deepfake detection mostly assess the synchronization between audio and visual features. Although they have shown promising results,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Recent studies have advocated the detection of fake videos as a one-class detection task, predicated on the hypothesis that the consistency between audio and visual modalities of genuine data is more significant than that of fake data. This…

Sound · Computer Science 2024-06-13 Xiaolou Li , Zehua Liu , Chen Chen , Lantian Li , Li Guo , Dong Wang

Although current deep learning-based face forgery detectors achieve impressive performance in constrained scenarios, they are vulnerable to samples created by unseen manipulation methods. Some recent works show improvements in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Alexandros Haliassos , Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

The success of vision-language models is primarily attributed to effective alignment across modalities such as vision and language. However, modality gaps persist in existing alignment algorithms and appear necessary for human perception as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hanqi Yan , Xiangxiang Cui , Lu Yin , Jindong Gu , Paul Pu Liang , Yulan He , Yifei Wang

Due to the development of facial manipulation techniques in recent years deepfake detection in video stream became an important problem for face biometrics, brand monitoring or online video conferencing solutions. In case of a biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Kirill Vyshegorodtsev , Dmitry Kudiyarov , Alexander Balashov , Alexander Kuzmin

The field of visual and audio generation is burgeoning with new state-of-the-art methods. This rapid proliferation of new techniques underscores the need for robust solutions for detecting synthetic content in videos. In particular, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nicholas Klein , Hemlata Tak , James Fullwood , Krishna Regmi , Leonidas Spinoulas , Ganesh Sivaraman , Tianxiang Chen , Elie Khoury

Deepfake videos, produced through advanced artificial intelligence methods now a days, pose a new challenge to the truthfulness of the digital media. As Deepfake becomes more convincing day by day, detecting them requires advanced methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mahmudul Hasan , Sadia Ruhama , Sabrina Tajnim Sithi , Chowdhury Mohammad Mutamir Samit , Oindrila Saha