中文
相关论文

相关论文: Next-Frame Feature Prediction for Multimodal Deepf…

200 篇论文

Self-supervised learning of image representations by predicting future frames is a promising direction but still remains a challenge. This is because of the under-determined nature of frame prediction; multiple potential futures can arise…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Huiwon Jang , Dongyoung Kim , Junsu Kim , Jinwoo Shin , Pieter Abbeel , Younggyo Seo

Detecting video deepfakes has become increasingly urgent in recent years. Given the audio-visual information in videos, existing methods typically expose deepfakes by modeling cross-modal correspondence using specifically designed…

多媒体 · 计算机科学 2026-04-13 Zihe Wei , Yuezun Li

Deep Convolutional Neural Networks (DCNNs) and their variants have been widely used in large scale face recognition(FR) recently. Existing methods have achieved good performance on many FR benchmarks. However, most of them suffer from two…

计算机视觉与模式识别 · 计算机科学 2021-06-28 Jing Xu , Tszhang Guo , Yong Xu , Zenglin Xu , Kun Bai

Partially spoofed audio detection is a challenging task, lying in the need to accurately locate the authenticity of audio at the frame level. To address this issue, we propose a fine-grained partially spoofed audio detection method, namely…

声音 · 计算机科学 2023-11-22 Yuankun Xie , Haonan Cheng , Yutian Wang , Long Ye

Future frame prediction in videos is a challenging problem because videos include complicated movements and large appearance changes. Learning-based future frame prediction approaches have been proposed in kinds of literature. A common…

计算机视觉与模式识别 · 计算机科学 2020-11-17 Wonjik Kim , Masayuki Tanaka , Masatoshi Okutomi , Yoko Sasaki

Recent advances in deep generative models have made it easier to manipulate face videos, raising significant concerns about their potential misuse for fraud and misinformation. Existing detectors often perform well in in-domain scenarios…

计算机视觉与模式识别 · 计算机科学 2026-01-26 Yinqi Cai , Jichang Li , Zhaolun Li , Weikai Chen , Rushi Lan , Xi Xie , Xiaonan Luo , Guanbin Li

Detecting partial deepfake speech is essential due to its potential for subtle misinformation. However, existing methods depend on costly frame-level annotations during training, limiting real-world scalability. Also, they focus on…

声音 · 计算机科学 2025-07-28 Menglu Li , Xiao-Ping Zhang , Lian Zhao

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

信号处理 · 电气工程与系统科学 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Deepfake detection refers to detecting artificially generated or edited faces in images or videos, which plays an essential role in visual information security. Despite promising progress in recent years, Deepfake detection remains a…

计算机视觉与模式识别 · 计算机科学 2023-12-11 Chunlei Peng , Huiqing Guo , Decheng Liu , Nannan Wang , Ruimin Hu , Xinbo Gao

The spread of misinformation through synthetically generated yet realistic images and videos has become a significant problem, calling for robust manipulation detection methods. Despite the predominant effort of detecting face manipulation…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Ekraam Sabir , Jiaxin Cheng , Ayush Jaiswal , Wael AbdAlmageed , Iacopo Masi , Prem Natarajan

Synthetic facial videos have proliferated across social media faster than platform moderation can respond, raising the cost of disinformation and identity-based attacks. Frame-level deepfake detectors degrade sharply as generator quality…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Mohammadreza Rashidi , Raja Hashim Ali , Sami Ur Rahman

Video prediction is commonly referred to as forecasting future frames of a video sequence provided several past frames thereof. It remains a challenging domain as visual scenes evolve according to complex underlying dynamics, such as the…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Hafez Farazi , Jan Nogga , Sven Behnke

Deepfake has emerged for several years, yet efficient detection techniques could generalize over different manipulation methods require further research. While current image-level detection method fails to generalize to unseen domains,…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Beilin Chu , Xuan Xu , Weike You , Linna Zhou

The rapid advancement of Deepfake technologies and video manipulation tools poses a critical challenge to multimedia forensics, judicial evidence integrity, and information authenticity. Current detectors rely on single-modality signals,…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Hoda Osama Elkhodary , Sherin Mostafa Youssef , Marwa Elshenawy , Dalia Sobhy

Deep learning-based methods have achieved promising results on surgical instrument segmentation. However, the high computation cost may limit the application of deep models to time-sensitive tasks such as online surgical video analysis for…

计算机视觉与模式识别 · 计算机科学 2021-07-27 Shan Lin , Fangbo Qin , Haonan Peng , Randall A. Bly , Kris S. Moe , Blake Hannaford

The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing methods for detecting…

声音 · 计算机科学 2025-03-25 Emma Coletta , Davide Salvi , Viola Negroni , Daniele Ugo Leonzio , Paolo Bestagini

Transformer-based models have shown strong performance in speech deepfake detection, largely due to the effectiveness of the multi-head self-attention (MHSA) mechanism. MHSA provides frame-level attention scores, which are particularly…

声音 · 计算机科学 2026-02-05 Tuan Dat Phuong , Duc-Tuan Truong , Long-Vu Hoang , Trang Nguyen Thi Thu

Multimodal deepfakes can exhibit subtle visual artifacts and cross-modal inconsistencies, which remain challenging to detect, especially when detectors are trained primarily on curated synthetic forgeries. Such synthetic dependence can…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Sahibzada Adil Shahzad , Ammarah Hashmi , Junichi Yamagishi , Yusuke Yasuda , Yu Tsao , Chia-Wen Lin , Yan-Tsung Peng , Hsin-Min Wang

One of the most pressing challenges for the detection of face-manipulated videos is generalising to forgery methods not seen during training while remaining effective under common corruptions such as compression. In this paper, we examine…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Alexandros Haliassos , Rodrigo Mira , Stavros Petridis , Maja Pantic

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao