English
Related papers

Related papers: VoxMorph: Scalable Zero-shot Voice Identity Morphi…

200 papers

This study investigates the use of the unsupervised deep learning framework VoxelMorph for deformable registration of longitudinal abdominopelvic CT images acquired in patients with bone metastases from breast cancer. The CT images were…

Human voices can be used to authenticate the identity of the speaker, but the automatic speaker verification (ASV) systems are vulnerable to voice spoofing attacks, such as impersonation, replay, text-to-speech, and voice conversion.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-09 You Zhang , Fei Jiang , Zhiyao Duan

The goal of voice conversion is to transform the speech of a source speaker to sound like that of a reference speaker while preserving the original content. A key challenge is to extract disentangled linguistic content from the source and…

Sound · Computer Science 2025-01-15 Jaehun Kim , Ji-Hoon Kim , Yeunju Choi , Tan Dat Nguyen , Seongkyu Mun , Joon Son Chung

Advancing face morphing attack techniques is crucial to anticipate evolving threats and develop robust defensive mechanisms for identity verification systems. This work introduces DCMorph, a dual-stream diffusion-based morphing framework…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Tahar Chettaoui , Eduarda Caldeira , Guray Ozgur , Raghavendra Ramachandra , Fadi Boutros , Naser Damer

We propose a flexible framework that deals with both singer conversion and singers vocal technique conversion. The proposed model is trained on non-parallel corpora, accommodates many-to-many conversion, and leverages recent advances of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Yin-Jyun Luo , Chin-Chen Hsu , Kat Agres , Dorien Herremans

This paper describes our proposed integration system for the spoofing-aware speaker verification challenge. It consists of a robust spoofing-aware verification system that use the speaker verification and antispoofing embeddings extracted…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-05 Juan M. Martín-Doñas , Iván G. Torre , Aitor Álvarez , Joaquin Arellano

Artificially generated speech is increasingly embedded in everyday life. Voice cloning in particular enables applications where identity preservation is important, such as completing a recording, dubbing in a new language, or preserving the…

Sound · Computer Science 2026-05-28 Kaitlyn Zhou , Federico Bianchi , Martijn Bartelds , Anna Pot , Yongchan Kwon , James Zou

Morphing attacks is a threat to biometric systems where the biometric reference in an identity document can be altered. This form of attack presents an important issue in applications relying on identity documents such as border security or…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Eklavya Sarkar , Pavel Korshunov , Laurent Colbois , Sébastien Marcel

Recent advances in zero-shot text-to-speech (TTS), driven by language models, diffusion models and masked generation, have achieved impressive naturalness in speech synthesis. Nevertheless, stability and fidelity remain key challenges,…

Sound · Computer Science 2025-10-24 Hualei Wang , Na Li , Chuke Wang , Shu Wu , Zhifeng Li , Dong Yu

Component-level audio Spoofing (Comp-Spoof) targets a new form of audio manipulation where only specific components of a signal, such as speech or environmental sound, are forged or substituted while other components remain genuine.…

Sound · Computer Science 2026-02-02 Xueping Zhang , Yechen Wang , Linxi Li , Liwei Jin , Ming Li

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter

Combining face swapping with lip synchronization technology offers a cost-effective solution for customized talking face generation. However, directly cascading existing models together tends to introduce significant interference between…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zeren Zhang , Haibo Qin , Jiayu Huang , Yixin Li , Hui Lin , Yitao Duan , Jinwen Ma

Audio fingerprinting converts audio to much lower-dimensional representations, allowing distorted recordings to still be recognized as their originals through similar fingerprints. Existing deep learning approaches rigidly fingerprint…

Sound · Computer Science 2026-03-26 Hongjie Chen , Hanyu Meng , Huimin Zeng , Ryan A. Rossi , Lie Lu , Josh Kimball

In this paper, we introduce a zero-shot Voice Transfer (VT) module that can be seamlessly integrated into a multi-lingual Text-to-speech (TTS) system to transfer an individual's voice across languages. Our proposed VT module comprises a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-24 Fadi Biadsy , Youzheng Chen , Isaac Elias , Kyle Kastner , Gary Wang , Andrew Rosenberg , Bhuvana Ramabhadran

Although diffusion models in text-to-speech have become a popular choice due to their strong generative ability, the intrinsic complexity of sampling from diffusion models harms their efficiency. Alternatively, we propose VoiceFlow, an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-04 Yiwei Guo , Chenpeng Du , Ziyang Ma , Xie Chen , Kai Yu

Most of the existing video face super-resolution (VFSR) methods are trained and evaluated on VoxCeleb1, which is designed specifically for speaker identification and the frames in this dataset are of low quality. As a consequence, the VFSR…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Liangbin Xie. Xintao Wang , Honglun Zhang , Chao Dong , Ying Shan

Generated speech achieves human-level naturalness but escalates security risks of misuse. However, existing watermarking methods fail to reconcile fidelity with robustness, as they rely either on simple superposition in the noise space or…

Cryptography and Security · Computer Science 2026-02-02 Weizhi Liu , Yue Li , Zhaoxia Yin

Although speaker verification has conventionally been an audio-only task, some practical applications provide both audio and visual streams of input. In these cases, the visual stream provides complementary information and can often be…

Sound · Computer Science 2021-02-15 Leda Sarı , Kritika Singh , Jiatong Zhou , Lorenzo Torresani , Nayan Singhal , Yatharth Saraf

As the use of biometrics becomes more wide-spread, the privacy concerns that stem from the use of biometrics are becoming more apparent. As the usage of mobile devices grows, so does the desire to implement biometric identification into…

Cryptography and Security · Computer Science 2015-06-12 R. C. Johnson , Walter J. Scheirer , Terrance E. Boult

Disentangling content and speaking style information is essential for zero-shot non-parallel voice conversion (VC). Our previous study investigated a novel framework with disentangled sequential variational autoencoder (DSVAE) as the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-22 Jiachen Lian , Chunlei Zhang , Gopala Krishna Anumanchipalli , Dong Yu