English
Related papers

Related papers: The DeepSpeak Dataset

200 papers

Deepfakes have become a universal and rapidly intensifying concern of generative AI across various media types such as images, audio, and videos. Among these, audio deepfakes have been of particular concern due to the ease of high-quality…

Cryptography and Security · Computer Science 2025-03-25 Xiang Li , Pin-Yu Chen , Wenqi Wei

With the recent advancements in generative modeling, the realism of deepfake content has been increasing at a steady pace, even reaching the point where people often fail to detect manipulated media content online, thus being deceived into…

Due to the widespread use of smartphones with high-quality digital cameras and easy access to a wide range of software apps for recording, editing, and sharing videos and images, as well as the deep learning AI platforms, a new phenomenon…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Nikhil Sontakke , Sejal Utekar , Shivansh Rastogi , Shriraj Sonawane

The task of deepfakes detection is far from being solved by speech or vision researchers. Several publicly available databases of fake synthetic video and speech were built to aid the development of detection methods. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Pavel Korshunov , Haolin Chen , Philip N. Garner , Sebastien Marcel

It is becoming increasingly easy to automatically replace a face of one person in a video with the face of another person by using a pre-trained generative adversarial network (GAN). Recent public scandals, e.g., the faces of celebrities…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Pavel Korshunov , Sebastien Marcel

Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yamini Sri Krubha , Aryana Hou , Braden Vester , Web Walker , Xin Wang , Li Lin , Shu Hu

The tremendous recent advances in generative artificial intelligence techniques have led to significant successes and promise in a wide range of different applications ranging from conversational agents and textual content generation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hossein Aboutalebi , Dayou Mao , Rongqi Fan , Carol Xu , Chris He , Alexander Wong

Recent advancements in AI, especially deep learning, have contributed to a significant increase in the creation of new realistic-looking synthetic media (video, image, and audio) and manipulation of existing media, which has led to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Enes Altuncu , Virginia N. L. Franqueira , Shujun Li

We present the first large-scale open-set benchmark for multilingual audio-video deepfake detection. Our dataset comprises over 250 hours of real and fake videos across eight languages, with 60% of data being generated. For each language,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Florinel-Alin Croitoru , Vlad Hondru , Marius Popescu , Radu Tudor Ionescu , Fahad Shahbaz Khan , Mubarak Shah

Speech deepfake detection is a well-established research field with different models, datasets, and training strategies. However, the lack of standardized implementations and evaluation protocols limits reproducibility, benchmarking, and…

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a…

Sound · Computer Science 2024-09-23 Yuang Li , Min Zhang , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Hao Yang

Speech synthesis systems can now produce highly realistic vocalisations that pose significant authenticity challenges. Despite substantial progress in deepfake detection models, their real-world effectiveness is often undermined by evolving…

Sound · Computer Science 2026-02-12 Qizhou Wang , Hanxun Huang , Guansong Pang , Sarah Erfani , Christopher Leckie

In the recent years, social media has grown to become a major source of information for many online users. This has given rise to the spread of misinformation through deepfakes. Deepfakes are videos or images that replace one persons face…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Jacob Mallet , Rushit Dave , Naeem Seliya , Mounika Vanamala

Generative AI (Gen-AI) deepfakes pose a rapidly evolving threat to biometric authentication, yet a significant gap exists between expert understanding of these risks and public perception. This disconnection creates critical vulnerabilities…

Human-Computer Interaction · Computer Science 2025-06-10 Shijing He , Yaxiong Lei , Zihan Zhang , Yuzhou Sun , Shujun Li , Chi Zhang , Juan Ye

AI-generated synthetic media, also called Deepfakes, have significantly influenced so many domains, from entertainment to cybersecurity. Generative Adversarial Networks (GANs) and Diffusion Models (DMs) are the main frameworks used to…

As audio deepfakes transition from research artifacts to widely available commercial tools, robust biometric authentication faces pressing security threats in high-stakes industries. This paper presents a systematic empirical evaluation of…

Sound · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Zeying Xie , Weiwei Zhao , Guan Wang , Chen Jason Zhang

There are growing implications surrounding generative AI in the speech domain that enable voice cloning and real-time voice conversion from one individual to another. This technology poses a significant ethical threat and could lead to…

Sound · Computer Science 2023-08-25 Jordan J. Bird , Ahmad Lotfi

AI-generated synthetic media are increasingly used in real-world scenarios, often with the purpose of spreading misinformation and propaganda through social media platforms, where compression and other processing can degrade fake detection…

Multimedia · Computer Science 2025-04-30 Stefano Dell'Anna , Andrea Montibeller , Giulia Boato

Deepfake attacks, malicious manipulation of media containing people, are a serious concern for society. Conventional deepfake detection methods train supervised classifiers to distinguish real media from previously encountered deepfakes.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Tal Reiss , Bar Cavia , Yedid Hoshen

The rise of deepfake images, especially of well-known personalities, poses a serious threat to the dissemination of authentic information. To tackle this, we present a thorough investigation into how deepfakes are produced and how they can…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Haixu Song , Shiyu Huang , Yinpeng Dong , Wei-Wei Tu