中文
相关论文

相关论文: Not made for each other- Audio-Visual Dissonance-b…

200 篇论文

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based spatio-temporal…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhixi Cai , Kalin Stefanov , Abhinav Dhall , Munawar Hayat

Deepfake is the manipulated video made with a generative deep learning technique such as Generative Adversarial Networks (GANs) or Auto Encoder that anyone can utilize. Recently, with the increase of Deepfake videos, some classifiers…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Young-Jin Heo , Young-Ju Choi , Young-Woon Lee , Byung-Gyu Kim

The rapid advancement of Deepfake technologies and video manipulation tools poses a critical challenge to multimedia forensics, judicial evidence integrity, and information authenticity. Current detectors rely on single-modality signals,…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Hoda Osama Elkhodary , Sherin Mostafa Youssef , Marwa Elshenawy , Dalia Sobhy

Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, which can result in…

多媒体 · 计算机科学 2023-05-11 Juan Hu , Xin Liao , Difei Gao , Satoshi Tsutsui , Qian Wang , Zheng Qin , Mike Zheng Shou

Deepfake techniques have been widely used for malicious purposes, prompting extensive research interest in developing Deepfake detection methods. Deepfake manipulations typically involve tampering with facial parts, which can result in…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Juan Hu , Xin Liao , Difei Gao , Satoshi Tsutsui , Qian Wang , Zheng Qin , Mike Zheng Shou

Existing deepfake detection methods often exhibit bias, lack transparency, and fail to capture temporal information, leading to biased decisions and unreliable results across different demographic groups. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Akihito Yoshii , Ryosuke Sonoda , Ramya Srinivasan

Manipulated videos often contain subtle inconsistencies between their visual and audio signals. We propose a video forensics method, based on anomaly detection, that can identify these inconsistencies, and that can be trained solely using…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Chao Feng , Ziyang Chen , Andrew Owens

Due to the widespread use of smartphones with high-quality digital cameras and easy access to a wide range of software apps for recording, editing, and sharing videos and images, as well as the deep learning AI platforms, a new phenomenon…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Nikhil Sontakke , Sejal Utekar , Shivansh Rastogi , Shriraj Sonawane

Most existing speech disfluency detection techniques only rely upon acoustic data. In this work, we present a practical multimodal disfluency detection approach that leverages available video data together with audio. We curate an…

计算与语言 · 计算机科学 2024-06-12 Payal Mohapatra , Shamika Likhite , Subrata Biswas , Bashima Islam , Qi Zhu

This paper presents a new approach for the detection of fake videos, based on the analysis of style latent vectors and their abnormal behavior in temporal changes in the generated videos. We discovered that the generated facial videos…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Jongwook Choi , Taehoon Kim , Yonghyun Jeong , Seungryul Baek , Jongwon Choi

The combination of highly realistic voice cloning, along with visually compelling avatar, face-swap, or lip-sync deepfake video generation, makes it relatively easy to create a video of anyone saying anything. Today, such deepfake…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Justin D. Norman , Hany Farid

We present the first large-scale open-set benchmark for multilingual audio-video deepfake detection. Our dataset comprises over 250 hours of real and fake videos across eight languages, with 60% of data being generated. For each language,…

计算机视觉与模式识别 · 计算机科学 2025-05-19 Florinel-Alin Croitoru , Vlad Hondru , Marius Popescu , Radu Tudor Ionescu , Fahad Shahbaz Khan , Mubarak Shah

Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing,…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

With the rapid progress of deepfake techniques in recent years, facial video forgery can generate highly deceptive video contents and bring severe security threats. And detection of such forgery videos is much more urgent and challenging.…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Wei Lu , Lingyi Liu , Junwei Luo , Xianfeng Zhao , Yicong Zhou , Jiwu Huang

Current researches on Deepfake forensics often treat detection as a classification task or temporal forgery localization problem, which are usually restrictive, time-consuming, and challenging to scale for large datasets. To resolve these…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Wenbo Xu , Junyan Wu , Wei Lu , Xiangyang Luo , Qian Wang

Multi-modal stance detection (MSD) aims to determine an author's stance toward a given target using both textual and visual content. While recent methods leverage multi-modal fusion and prompt-based learning, most fail to distinguish…

多媒体 · 计算机科学 2026-01-30 Zhiyu Xie , Fuqiang Niu , Genan Dai , Qianlong Wang , Li Dong , Bowen Zhang , Hu Huang

Multi-modal embeddings form the foundation for vision-language models, such as CLIP embeddings, the most widely used text-image embeddings. However, these embeddings are vulnerable to subtle misalignment of cross-modal features, resulting…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Yilin Ye , Shishi Xiao , Xingchen Zeng , Wei Zeng

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

音频与语音处理 · 电气工程与系统科学 2025-08-12 Ivan Kukanov , Jun Wah Ng

With the rapid development of deep learning techniques, the generation and counterfeiting of multimedia material are becoming increasingly straightforward to perform. At the same time, sharing fake content on the web has become so simple…

多媒体 · 计算机科学 2022-09-19 Davide Salvi , Brian Hosler , Paolo Bestagini , Matthew C. Stamm , Stefano Tubaro

Multimedia data, particularly images and videos, is integral to various applications, including surveillance, visual interaction, biometrics, evidence gathering, and advertising. However, amateur or skilled counterfeiters can simulate them…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Kutub Uddin , Nusrat Tasnim , Byung Tae Oh