English
Related papers

Related papers: Localizing Audio-Visual Deepfakes via Hierarchical…

200 papers

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

With the rapid advancement of real-time deepfake generation techniques, forged content is becoming increasingly realistic and widespread across applications like video conferencing and social media. Although state-of-the-art detectors…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Libo Lv , Tianyi Wang , Mengxiao Huang , Ruixia Liu , Yinglong Wang

We present Hierarchical Memory Matching Network (HMMN) for semi-supervised video object segmentation. Based on a recent memory-based method [33], we propose two advanced memory read modules that enable us to perform memory reading in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Hongje Seong , Seoung Wug Oh , Joon-Young Lee , Seongwon Lee , Suhyeon Lee , Euntai Kim

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

In recent years, the task of weakly supervised audio-visual violence detection has gained considerable attention. The goal of this task is to identify violent segments within multimodal data based on video-level labels. Despite advances in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Xiaogang Peng , Hao Wen , Yikai Luo , Xiao Zhou , Keyang Yu , Ping Yang , Zizhao Wu

This paper proposes an audio-visual deepfake detection approach that aims to capture fine-grained temporal inconsistencies between audio and visual modalities. To achieve this, both architectural and data synthesis strategies are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

The detection and localization of highly realistic deepfake audio-visual content are challenging even for the most advanced state-of-the-art methods. While most of the research efforts in this domain are focused on detecting high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Zhixi Cai , Shreya Ghosh , Aman Pankaj Adatia , Munawar Hayat , Abhinav Dhall , Tom Gedeon , Kalin Stefanov

The task of partially spoofed audio localization aims to accurately determine audio authenticity at a frame level. Although some works have achieved encouraging results, utilizing boundary information within a single model remains an…

Sound · Computer Science 2024-08-20 Jiafeng Zhong , Bin Li , Jiangyan Yi

Remote sensing image scene classification remains a challenging task, primarily due to the complex spatial structures and multi-scale characteristics of ground objects. Although CNN-based methods excel at extracting local inductive biases,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Yuanhao Tang , Xuechao Zou , Zhengpei Hu , Junliang Xing , Chengkun Zhang , Jianqiang Huang

The proliferation of sophisticated AI-generated deepfakes poses critical challenges for digital media authentication and societal security. While existing detection methods perform well within specific generative domains, they exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

While the pursuit of higher accuracy in deepfake detection remains a central goal, there is an increasing demand for precise localization of manipulated regions. Despite the remarkable progress made in classification-based detection,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Chao Shuai , Gaojian Wang , Kun Pan , Tong Wu , Fanli Jin , Haohan Tan , Mengxiang Li , Zhenguang Liu , Feng Lin , Kui Ren

The field of visual and audio generation is burgeoning with new state-of-the-art methods. This rapid proliferation of new techniques underscores the need for robust solutions for detecting synthetic content in videos. In particular, when…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nicholas Klein , Hemlata Tak , James Fullwood , Krishna Regmi , Leonidas Spinoulas , Ganesh Sivaraman , Tianxiang Chen , Elie Khoury

Image deblurring aims to restore high-quality images from blurred ones. While existing deblurring methods have made significant progress, most overlook the fact that the degradation degree varies across different regions. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hu Gao , Depeng Dang

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

Deepfake videos are causing growing concerns among communities due to their ever-increasing realism. Naturally, automated detection of forged Deepfake videos is attracting a proportional amount of interest of researchers. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

Partially spoofed audio detection is a challenging task, lying in the need to accurately locate the authenticity of audio at the frame level. To address this issue, we propose a fine-grained partially spoofed audio detection method, namely…

Sound · Computer Science 2023-11-22 Yuankun Xie , Haonan Cheng , Yutian Wang , Long Ye

Localizing partial deepfake audio, where only segments of speech are manipulated, remains challenging due to the subtle and scattered nature of these modifications. Existing approaches typically rely on frame-level predictions to identify…

Sound · Computer Science 2026-01-30 Yuchen Mao , Wen Huang , Yanmin Qian

Audio deepfake detection (ADD) faces critical generalization challenges due to diverse real-world spoofing attacks and domain variations. However, existing methods primarily rely on Euclidean distances, failing to adequately capture the…

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng