English
Related papers

Related papers: Detecting music deepfakes is easy but actually har…

200 papers

Advancements in artificial intelligence and machine learning have significantly improved synthetic speech generation. This paper explores diffusion models, a novel method for creating realistic synthetic speech. We create a diffusion…

Cryptography and Security · Computer Science 2025-01-15 Anton Firc , Kamil Malinka , Petr Hanáček

Deepfake detection automatically recognizes the manipulated medias through the analysis of the difference between manipulated and non-altered videos. It is natural to ask which are the top performers among the existing deepfake detection…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Chenhao Lin , Jingyi Deng , Pengbin Hu , Chao Shen , Qian Wang , Qi Li

Deepfake detection remains a pressing challenge, particularly in real-world settings where smartphone-captured media from digital screens often introduces Moir\'e artifacts that can distort detection outcomes. This study systematically…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Razaib Tariq , Minji Heo , Simon S. Woo , Shahroz Tariq

Deep Learning as a field has been successfully used to solve a plethora of complex problems, the likes of which we could not have imagined a few decades back. But as many benefits as it brings, there are still ways in which it can be used…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Samay Pashine , Sagar Mandiya , Praveen Gupta , Rashid Sheikh

How can we best address the dangerous impact that deep learning-generated fake audios, photographs, and videos (a.k.a. deepfakes) may have in personal and societal life? We foresee that the availability of cheap deepfake technology will…

Computers and Society · Computer Science 2022-04-05 Claudio S. Pinhanez , German H. Flores , Marisa A. Vasconcelos , Mu Qiao , Nick Linck , Rogério de Paula , Yuya J. Ong

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

Multi-step or hybrid deepfakes, created by sequentially applying different deepfake creation methods such as Face-Swapping, GAN-based generation, and Diffusion methods, can pose an emerging and unforseen technical challenge for detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Minji Heo , Simon S. Woo

Progress in generative modelling, especially generative adversarial networks, have made it possible to efficiently synthesize and alter media at scale. Malicious individuals now rely on these machine-generated media, or deepfakes, to…

Machine Learning · Computer Science 2021-03-05 Baiwu Zhang , Jin Peng Zhou , Ilia Shumailov , Nicolas Papernot

Recent progress in audio generation has made it increasingly easy to create highly realistic environmental soundscapes, which can be misused to produce deceptive content, such as fake alarms, gunshots, and crowd sounds, raising concerns for…

Sound · Computer Science 2026-03-10 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Qihao Shen , Jiaxing Xuan , Zhenguang Liu , Sifan Wu , Yutong Xie , Zhaoyan Ming , Yingying Jiao , kui Ren

We introduce Echoes, a new dataset for music deepfake detection designed for training and benchmarking detectors under realistic and provider-diverse conditions. Echoes comprises 3,577 tracks (110 hours of audio) spanning multiple genres…

Sound · Computer Science 2026-03-26 Octavian Pascu , Dan Oneata , Horia Cucu , Nicolas M. Muller

Recent progress in audio generation models has made it possible to create highly realistic and immersive soundscapes, which are now widely used in film and virtual-reality-related applications. However, these audio generators also raise…

Sound · Computer Science 2026-01-01 Han Yin , Yang Xiao , Rohan Kumar Das , Jisheng Bai , Ting Dang

This paper addresses the challenge of developing a robust audio-visual deepfake detection model. In practical use cases, new generation algorithms are continually emerging, and these algorithms are not encountered during the development of…

Sound · Computer Science 2024-08-20 Kyungbok Lee , You Zhang , Zhiyao Duan

The recent proliferation of fake portrait videos poses direct threats on society, law, and privacy. Believing the fake video of a politician, distributing fake pornographic content of celebrities, fabricating impersonated fake videos as…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Umur Aybars Ciftci , Ilke Demir

Social media is currently being used by many individuals online as a major source of information. However, not all information shared online is true, even photos and videos can be doctored. Deepfakes have recently risen with the rise of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Jacob mallet , Laura Pryor , Rushit Dave , Mounika Vanamala

With the arrival of several face-swapping applications such as FaceApp, SnapChat, MixBooth, FaceBlender and many more, the authenticity of digital media content is hanging on a very loose thread. On social media platforms, videos are widely…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Akash Kumar , Arnav Bhavsar

The present paper proposes a waveform boundary detection system for audio spoofing attacks containing partially manipulated segments. Partially spoofed/fake audio, where part of the utterance is replaced, either with synthetic or natural…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zexin Cai , Weiqing Wang , Ming Li

Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust. With the increasing accessibility of generative AI, tools for voice cloning, face-swapping, and synthetic media creation have advanced significantly,…

Computers and Society · Computer Science 2025-07-16 Claudiu Popa , Rex Pallath , Liam Cunningham , Hewad Tahiri , Abiram Kesavarajah , Tao Wu

Generalization is a main issue for current audio deepfake detectors, which struggle to provide reliable results on out-of-distribution data. Given the speed at which more and more accurate synthesis methods are developed, it is very…

Sound · Computer Science 2024-07-02 Alessandro Pianese , Davide Cozzolino , Giovanni Poggi , Luisa Verdoliva

Deepfake audio presents a growing threat to digital security, due to its potential for social engineering, fraud, and identity misuse. However, existing detection models suffer from poor generalization across datasets, due to implicit…

Sound · Computer Science 2025-05-13 Yasaman Ahmadiadli , Xiao-Ping Zhang , Naimul Khan