English
Related papers

Related papers: Statistics-aware Audio-visual Deepfake Detector

200 papers

Humans use context to assess the veracity of information. However, current audio deepfake detectors only analyze the audio file without considering either context or transcripts. We create and analyze a Journalist-provided Deepfake Dataset…

Speech synthesis technology has posed a serious threat to speaker verification systems. Currently, the most effective fake audio detection methods utilize pretrained models, and integrating features from various layers of pretrained model…

Deepfake poses a serious threat to the reliability of judicial evidence and intellectual property protection. In spite of an urgent need for Deepfake identification, existing pixel-level detection methods are increasingly unable to resist…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Maoyu Mao , Jun Yang

Automatic detection of speaker confidence is critical for adaptive computing but remains constrained by limited labelled data and the subjectivity of paralinguistic annotations. This paper proposes a semi-supervised hybrid framework that…

Sound · Computer Science 2026-05-13 Adam Wynn , Jingyun Wang

In this paper, we investigate how to learn rich and robust feature representations for audio classification from visual data and acoustic images, a novel audio data modality. Former models learn audio representations from raw signals or…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Andrés F. Pérez , Valentina Sanguineti , Pietro Morerio , Vittorio Murino

There have been emerging a number of benchmarks and techniques for the detection of deepfakes. However, very few works study the detection of incrementally appearing deepfakes in the real-world scenarios. To simulate the wild scenes, this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Chuqiao Li , Zhiwu Huang , Danda Pani Paudel , Yabin Wang , Mohamad Shahbazi , Xiaopeng Hong , Luc Van Gool

The creation of altered and manipulated faces has become more common due to the improvement of DeepFake generation methods. Simultaneously, we have seen detection models' development for differentiating between a manipulated and original…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Sowmen Das , Selim Seferbekov , Arup Datta , Md. Saiful Islam , Md. Ruhul Amin

The rapid development of technologies and artificial intelligence makes deepfakes an increasingly sophisticated and challenging-to-identify technique. To ensure the accuracy of information and control misinformation and mass manipulation,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Paloma Cantero-Arjona , Alfonso Sánchez-Macián

The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Pavel Korshunov , Haolin Chen , Philip N. Garner , Sebastien Marcel

In this paper, we propose a novel self-distillation method for fake speech detection (FSD), which can significantly improve the performance of FSD without increasing the model complexity. For FSD, some fine-grained information is very…

Sound · Computer Science 2023-03-03 Jun Xue , Cunhang Fan , Jiangyan Yi , Chenglong Wang , Zhengqi Wen , Dan Zhang , Zhao Lv

This paper describes our submitted systems to the ASVspoof 5 Challenge Track 1: Speech Deepfake Detection - Open Condition, which consists of a stand-alone speech deepfake (bonafide vs spoof) detection task. Recently, large-scale…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-25 Theophile Stourbe , Victor Miara , Theo Lepage , Reda Dehak

In this paper, we propose to utilize Automated Machine Learning to adaptively search a neural architecture for deepfake detection. This is the first time to employ automated machine learning for deepfake detection. Based on our explored…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ping Liu , Yuewei Lin , Yang He , Yunchao Wei , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh , Jingen Liu

Deep Learning based AI systems have shown great promise in various domains such as vision, audio, autonomous systems (vehicles, drones), etc. Recent research on neural networks has shown the susceptibility of deep networks to adversarial…

Machine Learning · Computer Science 2019-11-25 Sambuddha Saha , Aashish Kumar , Pratyush Sahay , George Jose , Srinivas Kruthiventi , Harikrishna Muralidhara

Fake content has grown at an incredible rate over the past few years. The spread of social media and online platforms makes their dissemination on a large scale increasingly accessible by malicious actors. In parallel, due to the growing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Luca Maiano , Lorenzo Papa , Ketbjano Vocaj , Irene Amerini

We study universal deepfake detection. Our goal is to detect synthetic images from a range of generative AI approaches, particularly from emerging ones which are unseen during training of the deepfake detector. Universal deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chandler Timm Doloriel , Ngai-Man Cheung

Existing deep learning (DL) based speech enhancement approaches are generally optimised to minimise the distance between clean and enhanced speech features. These often result in improved speech quality however they suffer from a lack of…

Sound · Computer Science 2021-11-19 Tassadaq Hussain , Mandar Gogate , Kia Dashtipour , Amir Hussain

Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Qihao Shen , Jiaxing Xuan , Zhenguang Liu , Sifan Wu , Yutong Xie , Zhaoyan Ming , Yingying Jiao , kui Ren

It becomes urgent to design effective anti-spoofing algorithms for vulnerable automatic speaker verification systems due to the advancement of high-quality playback devices. Current studies mainly treat anti-spoofing as a binary…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Yongqiang Dou , Haocheng Yang , Maolin Yang , Yanyan Xu , Dengfeng Ke

Deepfake is a deep learning-based technique that makes it easy to change or modify images and videos. In investigations and court, visual evidence is commonly employed, but these pieces of evidence may now be suspect due to technological…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Kundan Patil , Shrushti Kale , Jaivanti Dhokey , Abhishek Gulhane

The rapid proliferation of AI-manipulated or generated audio deepfakes poses serious challenges to media integrity and election security. Current AI-driven detection solutions lack explainability and underperform in real-world settings. In…

Machine Learning · Computer Science 2024-10-11 Georgia Channing , Juil Sock , Ronald Clark , Philip Torr , Christian Schroeder de Witt