English
Related papers

Related papers: Phoneme-Level Feature Discrepancies: A Key to Dete…

200 papers

Approximately 1.2% of the world's population has impaired voice production. As a result, automatic dysphonic voice detection has attracted considerable academic and clinical interest. However, existing methods for automated voice assessment…

Sound · Computer Science 2023-01-27 Jianwei Zhang , Julie Liss , Suren Jayasuriya , Visar Berisha

Recent advancements in text-to-speech technologies enable generating high-fidelity synthetic speech nearly indistinguishable from real human voices. While recent studies show the efficacy of self-supervised learning-based speech encoders…

Sound · Computer Science 2026-03-24 Kyudan Jung , Jihwan Kim , Minwoo Lee , Soyoon Kim , Jeonghoon Kim , Jaegul Choo , Cheonbok Park

There are growing implications surrounding generative AI in the speech domain that enable voice cloning and real-time voice conversion from one individual to another. This technology poses a significant ethical threat and could lead to…

Sound · Computer Science 2023-08-25 Jordan J. Bird , Ahmad Lotfi

Speech synthesis technology has brought great convenience, while the widespread usage of realistic deepfake audio has triggered hazards. Malicious adversaries may unauthorizedly collect victims' speeches and clone a similar voice for…

Sound · Computer Science 2025-04-15 Zhisheng Zhang , Derui Wang , Qianyi Yang , Pengyang Huang , Junhan Pu , Yuxin Cao , Kai Ye , Jie Hao , Yixian Yang

In recent years, DeepFake technology has achieved unprecedented success in high-quality video synthesis, but these methods also pose potential and severe security threats to humanity. DeepFake can be bifurcated into entertainment…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Weifeng Liu , Tianyi She , Jiawei Liu , Boheng Li , Dongyu Yao , Ziyou Liang , Run Wang

The recent emergence of deepfakes has brought manipulated and generated content to the forefront of machine learning research. Automatic detection of deepfakes has seen many new machine learning techniques, however, human detection…

Human-Computer Interaction · Computer Science 2024-08-28 Nicolas M. Müller , Karla Pizzi , Jennifer Williams

Partial deepfake speech detection requires identifying manipulated regions that may occur within short temporal portions of an otherwise bona fide utterance, making the task particularly challenging for conventional utterance-level…

Sound · Computer Science 2026-04-06 Inbal Rimon , Oren Gal , Haim Permuter

Speech enhancement and speech separation are two related tasks, whose purpose is to extract either one or more target speech signals, respectively, from a mixture of sounds generated by several sources. Traditionally, these tasks have been…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-16 Daniel Michelsanti , Zheng-Hua Tan , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu , Jesper Jensen

Deepfakes are AI-generated media in which the original content is digitally altered to create convincing but manipulated images, videos, or audio. Among the various types of deepfakes, lip-syncing deepfakes are one of the most challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Soumyya Kanti Datta , Shan Jia , Siwei Lyu

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

The growing prevalence of neurological disorders associated with dysarthria motivates the need for automated intelligibility assessment methods that are applicalbe across languages. However, most existing approaches are either limited to a…

Computation and Language · Computer Science 2026-02-12 Eunjung Yeo , Julie M. Liss , Visar Berisha , David R. Mortensen

Advanced deepfake technologies are blurring the lines between real and fake, presenting both revolutionary opportunities and alarming threats. While it unlocks novel applications in fields like entertainment and education, its malicious use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Qihao Shen , Jiaxing Xuan , Zhenguang Liu , Sifan Wu , Yutong Xie , Zhaoyan Ming , Yingying Jiao , kui Ren

This paper presents a novel approach for detecting mispronunciations by analyzing deviations between a user's original speech and their voice-cloned counterpart with corrected pronunciation. We hypothesize that regions with maximal acoustic…

Sound · Computer Science 2025-07-16 Andrew Valdivia , Yueming Zhang , Hailu Xu , Amir Ghasemkhani , Xin Qin

Solutions for defending against deepfake speech fall into two categories: proactive watermarking models and passive conventional deepfake detectors. While both address common threats, their differences in training, optimization, and…

Sound · Computer Science 2025-06-18 Chia-Hua Wu , Wanying Ge , Xin Wang , Junichi Yamagishi , Yu Tsao , Hsin-Min Wang

Deepfake is a generative deep learning algorithm that creates or changes facial features in a very realistic way making it hard to differentiate the real from the fake features It can be used to make movies look better as well as to spread…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Nadeem Jabbar CH , Aqib Saghir , Ayaz Ahmad Meer , Salman Ahmad Sahi , Bilal Hassan , Siddiqui Muhammad Yasir

Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody, linguistic content or channel noise of original audio.…

Conventional spoofing detection systems have heavily relied on the use of handcrafted features derived from speech data. However, a notable shift has recently emerged towards the direct utilization of raw speech waveforms, as demonstrated…

Deepfake technology has given rise to a spectrum of novel and compelling applications. Unfortunately, the widespread proliferation of high-fidelity fake videos has led to pervasive confusion and deception, shattering our faith that seeing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongjie Ba , Qingyu Liu , Zhenguang Liu , Shuang Wu , Feng Lin , Li Lu , Kui Ren

Deepfakes are a form of synthetic image generation used to generate fake videos of individuals for malicious purposes. The resulting videos may be used to spread misinformation, reduce trust in media, or as a form of blackmail. These…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Will Rowan , Nick Pears

Paralinguistic properties of speech are essential in analyzing and choosing optimal treatment options for patients with speech disorders. However, automatic modeling of these characteristics is difficult due to the lack of labeled speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Jenthe Thienpondt , Geoffroy Vanderreydt , Abdessalem Hammami , Kris Demuynck