English
Related papers

Related papers: Codec-Based Deepfake Source Tracing via Neural Aud…

200 papers

The rapid development of audio-driven talking head generators and advanced Text-To-Speech (TTS) models has led to more sophisticated temporal deepfakes. These advances highlight the need for robust methods capable of detecting and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-12 Ivan Kukanov , Jun Wah Ng

While the significant advancements have made in the generation of deepfakes using deep learning technologies, its misuse is a well-known issue now. Deepfakes can cause severe security and privacy issues as they can be used to impersonate a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hasam Khalid , Shahroz Tariq , Minha Kim , Simon S. Woo

Significant advancements made in the generation of deepfakes have caused security and privacy issues. Attackers can easily impersonate a person's identity in an image by replacing his face with the target person's face. Moreover, a new…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Hasam Khalid , Minha Kim , Shahroz Tariq , Simon S. Woo

As audio deepfakes transition from research artifacts to widely available commercial tools, robust biometric authentication faces pressing security threats in high-stakes industries. This paper presents a systematic empirical evaluation of…

Sound · Computer Science 2026-01-07 Mengze Hong , Di Jiang , Zeying Xie , Weiwei Zhao , Guan Wang , Chen Jason Zhang

Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the problem of which is far from being solved. Although there are…

Sound · Computer Science 2023-08-30 Jiangyan Yi , Chenglong Wang , Jianhua Tao , Xiaohui Zhang , Chu Yuan Zhang , Yan Zhao

Many effective attempts have been made for fake audio detection. However, they can only provide detection results but no countermeasures to curb this harm. For many related practical applications, what model or algorithm generated the fake…

Sound · Computer Science 2022-08-23 Xinrui Yan , Jiangyan Yi , Jianhua Tao , Chenglong Wang , Haoxin Ma , Tao Wang , Shiming Wang , Ruibo Fu

With the rapid advancement of speech generation technologies, the threat posed by speech deepfakes in real-time communication (RTC) scenarios has intensified. However, existing detection studies mainly focus on offline simulations and…

Sound · Computer Science 2026-04-28 Jun Xue , Zhuolin Yi , Yihuan Huang , Yanzhen Ren , Yujie Chen , Cunhang Fan , Zicheng Su , Yonghong Zhang , Bo Cai

Advancements in AI-synthesized human voices have created a growing threat of impersonation and disinformation, making it crucial to develop methods to detect synthetic human voices. This study proposes a new approach to identifying…

Sound · Computer Science 2023-04-28 Chengzhe Sun , Shan Jia , Shuwei Hou , Siwei Lyu

Neural audio codecs (NACs) provide compact representations that can be leveraged in many downstream applications, in particular large language models. Yet most NACs encode mixtures of multiple sources in an entangled manner, which may…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-21 Ryo Aihara , Yoshiki Masuyama , Francesco Paissan , François G. Germain , Gordon Wichern , Jonathan Le Roux

With the rapid advancement of generative AI, multimodal deepfakes, which manipulate both audio and visual modalities, have drawn increasing public concern. Currently, deepfake detection has emerged as a crucial strategy in countering these…

Sound · Computer Science 2024-05-16 Yang Hou , Haitao Fu , Chuankai Chen , Zida Li , Haoyu Zhang , Jianjun Zhao

Deepfakes are synthetically generated media often devised with malicious intent. They have become increasingly more convincing with large training datasets advanced neural networks. These fakes are readily being misused for slander,…

Cryptography and Security · Computer Science 2022-03-30 Nicolas M. Müller , Franziska Dieckmann , Jennifer Williams

Neural audio codecs, used as speech tokenizers, have demonstrated remarkable potential in the field of speech generation. However, to ensure high-fidelity audio reconstruction, neural audio codecs typically encode audio into long sequences…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-02 Wenrui Liu , Qian Chen , Wen Wang , Yafeng Chen , Jin Xu , Zhifang Guo , Guanrou Yang , Weiqin Li , Xiaoda Yang , Tao Jin , Minghui Fang , Jialong Zuo , Bai Jionghao , Zemin Liu

The rapid advances in text-to-speech (TTS) technologies have made audio deepfakes increasingly realistic and accessible, raising significant security and trust concerns. While existing research has largely focused on detecting…

Sound · Computer Science 2026-02-03 Alabi Ahmed , Vandana Janeja , Sanjay Purushotham

Audio deepfake detection (ADD) is essential for preventing the misuse of synthetic voices that may infringe on personal rights and privacy. Recent zero-shot text-to-speech (TTS) models pose higher risks as they can clone voices with a…

Sound · Computer Science 2024-09-23 Yuang Li , Min Zhang , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Hao Yang

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

Neural audio codecs (NACs), which use neural networks to generate compact audio representations, have garnered interest for their applicability to many downstream tasks -- especially quantized codecs due to their compatibility with large…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-13 Ryo Aihara , Yoshiki Masuyama , Gordon Wichern , François G. Germain , Jonathan Le Roux

Learning how objects sound from video is challenging, since they often heavily overlap in a single audio channel. Current methods for visually-guided audio source separation sidestep the issue by training with artificially mixed video…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Ruohan Gao , Kristen Grauman

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

Deepfakes have become a universal and rapidly intensifying concern of generative AI across various media types such as images, audio, and videos. Among these, audio deepfakes have been of particular concern due to the ease of high-quality…

Cryptography and Security · Computer Science 2025-03-25 Xiang Li , Pin-Yu Chen , Wenqi Wei

Fake portrait video generation techniques have been posing a new threat to the society with photorealistic deep fakes for political propaganda, celebrity imitation, forged evidences, and other identity related manipulations. Following these…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Umur Aybars Ciftci , Ilke Demir , Lijun Yin