中文
相关论文

相关论文: Localizing Audio-Visual Deepfakes via Hierarchical…

200 篇论文

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

多媒体 · 计算机科学 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

With the rapid advancement of real-time deepfake generation techniques, forged content is becoming increasingly realistic and widespread across applications like video conferencing and social media. Although state-of-the-art detectors…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Libo Lv , Tianyi Wang , Mengxiao Huang , Ruixia Liu , Yinglong Wang

We present Hierarchical Memory Matching Network (HMMN) for semi-supervised video object segmentation. Based on a recent memory-based method [33], we propose two advanced memory read modules that enable us to perform memory reading in…

计算机视觉与模式识别 · 计算机科学 2021-09-24 Hongje Seong , Seoung Wug Oh , Joon-Young Lee , Seongwon Lee , Suhyeon Lee , Euntai Kim

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

计算机视觉与模式识别 · 计算机科学 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

In recent years, the task of weakly supervised audio-visual violence detection has gained considerable attention. The goal of this task is to identify violent segments within multimodal data based on video-level labels. Despite advances in…

计算机视觉与模式识别 · 计算机科学 2024-02-14 Xiaogang Peng , Hao Wen , Yikai Luo , Xiao Zhou , Keyang Yu , Ping Yang , Zizhao Wu

This paper proposes an audio-visual deepfake detection approach that aims to capture fine-grained temporal inconsistencies between audio and visual modalities. To achieve this, both architectural and data synthesis strategies are…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

The detection and localization of highly realistic deepfake audio-visual content are challenging even for the most advanced state-of-the-art methods. While most of the research efforts in this domain are focused on detecting high-quality…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Zhixi Cai , Shreya Ghosh , Aman Pankaj Adatia , Munawar Hayat , Abhinav Dhall , Tom Gedeon , Kalin Stefanov

The task of partially spoofed audio localization aims to accurately determine audio authenticity at a frame level. Although some works have achieved encouraging results, utilizing boundary information within a single model remains an…

声音 · 计算机科学 2024-08-20 Jiafeng Zhong , Bin Li , Jiangyan Yi

Remote sensing image scene classification remains a challenging task, primarily due to the complex spatial structures and multi-scale characteristics of ground objects. Although CNN-based methods excel at extracting local inductive biases,…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Yuanhao Tang , Xuechao Zou , Zhengpei Hu , Junliang Xing , Chengkun Zhang , Jianqiang Huang

The proliferation of sophisticated AI-generated deepfakes poses critical challenges for digital media authentication and societal security. While existing detection methods perform well within specific generative domains, they exhibit…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Naseem Khan , Tuan Nguyen , Amine Bermak , Issa Khalil

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

While the pursuit of higher accuracy in deepfake detection remains a central goal, there is an increasing demand for precise localization of manipulated regions. Despite the remarkable progress made in classification-based detection,…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Chao Shuai , Gaojian Wang , Kun Pan , Tong Wu , Fanli Jin , Haohan Tan , Mengxiang Li , Zhenguang Liu , Feng Lin , Kui Ren

The field of visual and audio generation is burgeoning with new state-of-the-art methods. This rapid proliferation of new techniques underscores the need for robust solutions for detecting synthetic content in videos. In particular, when…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Nicholas Klein , Hemlata Tak , James Fullwood , Krishna Regmi , Leonidas Spinoulas , Ganesh Sivaraman , Tianxiang Chen , Elie Khoury

Image deblurring aims to restore high-quality images from blurred ones. While existing deblurring methods have made significant progress, most overlook the fact that the degradation degree varies across different regions. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Hu Gao , Depeng Dang

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

音频与语音处理 · 电气工程与系统科学 2025-08-12 Ivan Kukanov , Jun Wah Ng

Deepfake videos are causing growing concerns among communities due to their ever-increasing realism. Naturally, automated detection of forged Deepfake videos is attracting a proportional amount of interest of researchers. Current methods…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Yunzhuo Chen , Naveed Akhtar , Nur Al Hasan Haldar , Ajmal Mian

Partially spoofed audio detection is a challenging task, lying in the need to accurately locate the authenticity of audio at the frame level. To address this issue, we propose a fine-grained partially spoofed audio detection method, namely…

声音 · 计算机科学 2023-11-22 Yuankun Xie , Haonan Cheng , Yutian Wang , Long Ye

Localizing partial deepfake audio, where only segments of speech are manipulated, remains challenging due to the subtle and scattered nature of these modifications. Existing approaches typically rely on frame-level predictions to identify…

声音 · 计算机科学 2026-01-30 Yuchen Mao , Wen Huang , Yanmin Qian

Audio deepfake detection (ADD) faces critical generalization challenges due to diverse real-world spoofing attacks and domain variations. However, existing methods primarily rely on Euclidean distances, failing to adequately capture the…

Image classification models often demonstrate unstable performance in real-world applications due to variations in image information, driven by differing visual perspectives of subject objects and lighting discrepancies. To mitigate these…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Yuze Zheng , Zixuan Li , Xiangxian Li , Jinxing Liu , Yuqing Wang , Xiangxu Meng , Lei Meng