English
Related papers

Related papers: SCDF: A Speaker Characteristics DeepFake Speech Da…

200 papers

Talking face generation (TFG) allows for producing lifelike talking videos of any character using only facial images and accompanying text. Abuse of this technology could pose significant risks to society, creating the urgent need for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xiaocan Chen , Qilin Yin , Jiarui Liu , Wei Lu , Xiangyang Luo , Jiantao Zhou

In hours-long meeting scenarios, real-time speech stream often struggles with achieving accurate speaker diarization, commonly leading to speaker identification and speaker count errors. To address this challenge, we propose SCDiar, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-29 Naijun Zheng , Xucheng Wan , Kai Liu , Zhou Huan

The SAFE Challenge evaluates synthetic speech detection across three tasks: unmodified audio, processed audio with compression artifacts, and laundered audio designed to evade detection. We systematically explore self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Hashim Ali , Surya Subramani , Lekha Bollinani , Nithin Sai Adupa , Sali El-Loh , Hafiz Malik

Speech deepfake detection (SDD) is essential for maintaining trust in voice-driven technologies and digital media. Although recent SDD systems increasingly rely on self-supervised learning (SSL) representations that capture rich contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-05 Cemal Hanilçi , Md Sahidullah , Tomi Kinnunen

Achieving robust generalization in speech deepfake detection (SDD) remains a primary challenge, as models often fail to detect unseen forgery methods. While research has focused on model-centric and algorithm-centric solutions, the impact…

Sound · Computer Science 2025-12-30 Wen Huang , Yuchen Mao , Yanmin Qian

Many datasets have been designed to further the development of fake audio detection. However, fake utterances in previous datasets are mostly generated by altering timbre, prosody, linguistic content or channel noise of original audio.…

This paper introduces a novel dataset to help researchers evaluate their computer vision and audio models for accuracy across a diverse set of age, genders, apparent skin tones and ambient lighting conditions. Our dataset is composed of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Caner Hazirbas , Joanna Bitton , Brian Dolhansky , Jacqueline Pan , Albert Gordo , Cristian Canton Ferrer

Automated speaker recognition uses data processing to identify speakers by their voice. Today, automated speaker recognition is deployed on billions of smart devices and in services such as call centres. Despite their wide-scale deployment…

Sound · Computer Science 2022-06-22 Wiebke Toussaint Hutiri , Aaron Ding

Despite the growing reliance on fairness benchmarks to evaluate language models, the datasets that underpin these benchmarks remain critically underexamined. This survey addresses that overlooked foundation by offering a comprehensive…

Computation and Language · Computer Science 2025-09-23 Jiale Zhang , Zichong Wang , Avash Palikhe , Zhipeng Yin , Wenbin Zhang

Many commercial and forensic applications of speech demand the extraction of information about the speaker characteristics, which falls into the broad category of speaker profiling. The speaker characteristics needed for profiling include…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-14 Shareef Babu Kalluri , Deepu Vijayasenan , Sriram Ganapathy , Ragesh Rajan M , Prashant Krishnan

With the rapid advancement of speech generation technologies, the threat posed by speech deepfakes in real-time communication (RTC) scenarios has intensified. However, existing detection studies mainly focus on offline simulations and…

Sound · Computer Science 2026-04-28 Jun Xue , Zhuolin Yi , Yihuan Huang , Yanzhen Ren , Yujie Chen , Cunhang Fan , Zicheng Su , Yonghong Zhang , Bo Cai

Audio deepfake detection is an emerging active topic. A growing number of literatures have aimed to study deepfake detection algorithms and achieved effective performance, the problem of which is far from being solved. Although there are…

Sound · Computer Science 2023-08-30 Jiangyan Yi , Chenglong Wang , Jianhua Tao , Xiaohui Zhang , Chu Yuan Zhang , Yan Zhao

Diffusion-based speech generators are ubiquitous. These methods can generate very high quality synthetic speech and several recent incidents report their malicious use. To counter such misuse, synthetic speech detectors have been developed.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Kratika Bhagtani , Amit Kumar Singh Yadav , Paolo Bestagini , Edward J. Delp

Recent studies have demonstrated that deep learning models can discriminate based on protected classes like race and gender. In this work, we evaluate bias present in deepfake datasets and detection models across protected subgroups. Using…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Loc Trinh , Yan Liu

Speech deepfakes pose a significant threat to personal security and content authenticity. Several detectors have been proposed in the literature, and one of the primary challenges these systems have to face is the generalization over unseen…

Sound · Computer Science 2024-09-25 Viola Negroni , Davide Salvi , Alessandro Ilic Mezza , Paolo Bestagini , Stefano Tubaro

This paper presents a novel framework for multi-talker automatic speech recognition without the need for auxiliary information. Serialized Output Training (SOT), a widely used approach, suffers from recognition errors due to speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Asahi Sakuma , Hiroaki Sato , Ryuga Sugano , Tadashi Kumano , Yoshihiko Kawai , Tetsuji Ogawa

Audio deepfake model attribution aims to mitigate the misuse of synthetic speech by identifying the source model responsible for generating a given audio sample, enabling accountability and informing vendors. The task is challenging, but…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Gabriel Pîrlogeanu , Adriana Stan , Horia Cucu

Speaker recognition is a widely used voice-based biometric technology with applications in various industries, including banking, education, recruitment, immigration, law enforcement, healthcare, and well-being. However, while dataset…

Computers and Society · Computer Science 2023-08-21 Casandra Rusti , Anna Leschanowsky , Carolyn Quinlan , Michaela Pnacek , Lauriane Gorce , Wiebke Hutiri

Text-to-Speech (TTS) and Voice Conversion (VC) models have exhibited remarkable performance in generating realistic and natural audio. However, their dark side, audio deepfake poses a significant threat to both society and individuals.…

Cryptography and Security · Computer Science 2024-09-17 Xinfeng Li , Kai Li , Yifan Zheng , Chen Yan , Xiaoyu Ji , Wenyuan Xu

Recent advances in speech deepfake detection (SDD) have significantly improved artifacts-based detection in spoofed speech. However, most models overlook speech naturalness, a crucial cue for distinguishing bona fide speech from spoofed…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Taewoo Kim , Guisik Kim , Choongsang Cho , Young Han Lee