English
Related papers

Related papers: PhonemeFake: Redefining Deepfake Realism with Lang…

200 papers

Speaker verification systems have been used in many production scenarios in recent years. Unfortunately, they are still highly prone to different kinds of spoofing attacks such as voice conversion and speech synthesis, etc. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Junxiao Xue , Hao Zhou , Yabo Wang

Advancements in artificial intelligence and machine learning have significantly improved synthetic speech generation. This paper explores diffusion models, a novel method for creating realistic synthetic speech. We create a diffusion…

Cryptography and Security · Computer Science 2025-01-15 Anton Firc , Kamil Malinka , Petr Hanáček

Recent advances in generative AI have made the creation of speech deepfakes widely accessible, posing serious challenges to digital trust. To counter this, various speech deepfake detection strategies have been proposed, including…

Sound · Computer Science 2025-07-14 Davide Salvi , Viola Negroni , Sara Mandelli , Paolo Bestagini , Stefano Tubaro

Current speech deepfake detection approaches perform satisfactorily against known adversaries; however, generalization to unseen attacks remains an open challenge. The proliferation of speech deepfakes on social media underscores the need…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-01 Ivan Kukanov , Janne Laakkonen , Tomi Kinnunen , Ville Hautamäki

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

With the rapid advancement of speech generation technologies, the threat posed by speech deepfakes in real-time communication (RTC) scenarios has intensified. However, existing detection studies mainly focus on offline simulations and…

Sound · Computer Science 2026-04-28 Jun Xue , Zhuolin Yi , Yihuan Huang , Yanzhen Ren , Yujie Chen , Cunhang Fan , Zicheng Su , Yonghong Zhang , Bo Cai

We introduce 2D-Malafide, a novel and lightweight adversarial attack designed to deceive face deepfake detection systems. Building upon the concept of 1D convolutional perturbations explored in the speech domain, our method leverages 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Chiara Galdi , Michele Panariello , Massimiliano Todisco , Nicholas Evans

With the spread of DeepFake techniques, this technology has become quite accessible and good enough that there is concern about its malicious use. Faced with this problem, detecting forged faces is of utmost importance to ensure security…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Gustavo Cunha Lacerda , Raimundo Claudio da Silva Vasconcelos

Deepfakes - manipulated or forged audio and video media - pose significant security risks to individuals, organizations, and society at large. To address these challenges, machine learning-based classifiers are commonly employed to detect…

Cryptography and Security · Computer Science 2026-05-14 Nicolas Müller , Piotr Kawa , Adriana Stan , Thien-Phuc Doan , Souhwan Jung , Wei Herng Choong , Philip Sperl , Konstantin Böttinger

Deepfake technologies empowered by deep learning are rapidly evolving, creating new security concerns for society. Existing multimodal detection methods usually capture audio-visual inconsistencies to expose Deepfake videos. More seriously,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Yu Chen , Yang Yu , Rongrong Ni , Yao Zhao , Haoliang Li

Media forensics has attracted a lot of attention in the last years in part due to the increasing concerns around DeepFakes. Since the initial DeepFake databases from the 1st generation such as UADFV and FaceForensics++ up to the latest…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Ruben Tolosana , Sergio Romero-Tapiador , Julian Fierrez , Ruben Vera-Rodriguez

Many datasets have been designed to further the development of fake audio detection, such as datasets of the ASVspoof and ADD challenges. However, these datasets do not consider a situation that the emotion of the audio has been changed…

Sound · Computer Science 2024-07-25 Yan Zhao , Jiangyan Yi , Jianhua Tao , Chenglong Wang , Xiaohui Zhang , Yongfeng Dong

The availability of highly convincing audio deepfake generators highlights the need for designing robust audio deepfake detectors. Existing works often rely solely on real and fake data available in the training set, which may lead to…

Sound · Computer Science 2024-07-11 Marcella Astrid , Enjie Ghorbel , Djamila Aouada

The rapid advancement of generative AI has made audio deepfakes increasingly indistinguishable from authentic human vocals, posing significant threats to persons-of-interest (POI) such as public figures. Current detection systems primarily…

Sound · Computer Science 2026-05-19 Jun Xue , Tong Zhang , Zhuolin Yi , Yihuan Huang , Yi Chai , Yiyang Zhang , Yanzhen Ren

Deepfakes offer great potential for innovation and creativity, but they also pose significant risks to privacy, trust, and security. With a vast Hindi-speaking population, India is particularly vulnerable to deepfake-driven misinformation…

Sound · Computer Science 2024-11-26 Sukhandeep Kaur , Mubashir Buhari , Naman Khandelwal , Priyansh Tyagi , Kiran Sharma

DeepFake based digital facial forgery is threatening the public media security, especially when lip manipulation has been used in talking face generation, the difficulty of fake video detection is further improved. By only changing lip…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Ganglai Wang , Peng Zhang , Lei Xie , Wei Huang , Yufei Zha , Yanning Zhang

Digital beautification through social media filters has become increasingly popular, raising concerns about the reliability of facial images and videos and the effectiveness of automated face analysis. This issue is particularly critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Sara Concas , Simone Maurizio La Cava , Andrea Panzino , Ester Masala , Giulia Orrù , Gian Luca Marcialis

The rapid advancement of generative artificial intelligence has enabled the creation of highly realistic fake facial images, posing serious threats to personal privacy and the integrity of online information. Existing deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Huanhuan Yuan , Yang Ping , Zhengqin Xu , Junyi Cao , Shuai Jia , Chao Ma

With rapid advancements in generative modeling, deepfake techniques are increasingly narrowing the gap between real and synthetic videos, raising serious privacy and security concerns. Beyond traditional face swapping and reenactment, an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tharun Anand , Siva Sankar Sajeev , Pravin Nair

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid