中文
相关论文

相关论文: Detecting Audio-Visual Deepfakes with Fine-Grained…

200 篇论文

Self-supervised representations excel at many vision and speech tasks, but their potential for audio-visual deepfake detection remains underexplored. Unlike prior work that uses these features in isolation or buried within complex…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Dragos-Alexandru Boldisor , Stefan Smeu , Dan Oneata , Elisabeta Oneata

The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing methods for detecting…

声音 · 计算机科学 2025-03-25 Emma Coletta , Davide Salvi , Viola Negroni , Daniele Ugo Leonzio , Paolo Bestagini

The development of technologies for easily and automatically falsifying video has raised practical questions about people's ability to detect false information online. How vulnerable are people to deepfake videos? What technologies can be…

人机交互 · 计算机科学 2023-04-11 Emilie Josephs , Camilo Fosco , Aude Oliva

Existing deepfake detection methods often exhibit bias, lack transparency, and fail to capture temporal information, leading to biased decisions and unreliable results across different demographic groups. In this paper, we propose a…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Akihito Yoshii , Ryosuke Sonoda , Ramya Srinivasan

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

Partially spoofed audio detection is a challenging task, lying in the need to accurately locate the authenticity of audio at the frame level. To address this issue, we propose a fine-grained partially spoofed audio detection method, namely…

声音 · 计算机科学 2023-11-22 Yuankun Xie , Haonan Cheng , Yutian Wang , Long Ye

Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the problem of which is far from being solved. Although there are…

声音 · 计算机科学 2023-08-30 Jiangyan Yi , Chenglong Wang , Jianhua Tao , Xiaohui Zhang , Chu Yuan Zhang , Yan Zhao

Despite encouraging progress in deepfake detection, generalization to unseen forgery types remains a significant challenge due to the limited forgery clues explored during training. In contrast, we notice a common phenomenon in deepfake:…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Jiazhi Guan , Hang Zhou , Mingming Gong , Errui Ding , Jingdong Wang , Youjian Zhao

Due to its high societal impact, deepfake detection is getting active attention in the computer vision community. Most deepfake detection methods rely on identity, facial attributes, and adversarial perturbation-based spatio-temporal…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhixi Cai , Kalin Stefanov , Abhinav Dhall , Munawar Hayat

This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score…

多媒体 · 计算机科学 2026-02-03 Qingcao Li , Miao He , Liang Yi , Qing Wen , Yitao Zhang , Hongshuo Jin , Peng Cheng , Zhongjie Ba , Li Lu , Kui Ren

Deepfake detection is a critical task in identifying manipulated multimedia content. In real-world scenarios, deepfake content can manifest across multiple modalities, including audio and video. To address this challenge, we present…

人工智能 · 计算机科学 2025-12-04 Xin Zhang , Jiaming Chu , Jian Zhao , Yuchu Jiang , Xu Yang , Lei Jin , Chi Zhang , Xuelong Li

Deep generative modeling has the potential to cause significant harm to society. Recognizing this threat, a magnitude of research into detecting so-called "Deepfakes" has emerged. This research most often focuses on the image domain, while…

机器学习 · 计算机科学 2021-11-05 Joel Frank , Lea Schönherr

Deepfake audio presents a growing threat to digital security, due to its potential for social engineering, fraud, and identity misuse. However, existing detection models suffer from poor generalization across datasets, due to implicit…

声音 · 计算机科学 2025-05-13 Yasaman Ahmadiadli , Xiao-Ping Zhang , Naimul Khan

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

声音 · 计算机科学 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

Audio-visual deepfakes have reached a level of realism that makes perceptual detection unreliable, threatening media integrity and biometric security. While multimodal detection has shown promise, most approaches are binary classification…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Wasim Ahmad , Wei Zhang , Xuerui Mao

Deep generative models can create remarkably photorealistic fake images while raising concerns about misinformation and copyright infringement, known as deepfake threats. Deepfake detection technique is developed to distinguish between real…

计算机视觉与模式识别 · 计算机科学 2024-08-22 You-Ming Chang , Chen Yeh , Wei-Chen Chiu , Ning Yu

As AI-generated content (AIGC) thrives, deepfakes have expanded from single-modality falsification to cross-modal fake content creation, where either audio or visual components can be manipulated. While using two unimodal detectors can…

多媒体 · 计算机科学 2024-10-28 Cai Yu , Peng Chen , Jiahe Tian , Jin Liu , Jiao Dai , Xi Wang , Yesheng Chai , Shan Jia , Siwei Lyu , Jizhong Han

For deepfake detection, video-level detectors have not been explored as extensively as image-level detectors, which do not exploit temporal data. In this paper, we empirically show that existing approaches on image and sequence classifiers…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Ipek Ganiyusufoglu , L. Minh Ngô , Nedko Savov , Sezer Karaoglu , Theo Gevers

Deepfakes have emerged as a significant threat to digital media authenticity, increasing the need for advanced detection techniques that can identify subtle and time-dependent manipulations. CNNs are effective at capturing spatial artifacts…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Aryan Thakre , Omkar Nagwekar , Vedang Talekar , Aparna Santra Biswas

With the rapid advancement of generative audio models, distinguishing between human-composed and generated music is becoming increasingly challenging. As a response, models for detecting fake music have been proposed. In this work, we…

声音 · 计算机科学 2025-07-15 Tomasz Sroka , Tomasz Wężowicz , Dominik Sidorczuk , Mateusz Modrzejewski