English
Related papers

Related papers: Voice Mimicry Attacks Assisted by Automatic Speake…

200 papers

Voice conversion (VC) aims at conversion of speaker characteristic without altering content. Due to training data limitations and modeling imperfections, it is difficult to achieve believable speaker mimicry without introducing processing…

Audio and Speech Processing · Electrical Eng. & Systems 2018-09-05 Tomi Kinnunen , Jaime Lorenzo-Trueba , Junichi Yamagishi , Tomoki Toda , Daisuke Saito , Fernando Villavicencio , Zhenhua Ling

Transformer has achieved extraordinary performance in Natural Language Processing and Computer Vision tasks thanks to its powerful self-attention mechanism, and its variant Conformer has become a state-of-the-art architecture in the field…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-18 Dexin Liao , Tao Jiang , Feng Wang , Lin Li , Qingyang Hong

The Automatic Speaker Verification systems have potential in biometrics applications for logical control access and authentication. A lot of things happen to be at stake if the ASV system is compromised. The preliminary work presents a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Rohit Arora

The Automatic Speaker Verification Spoofing and Countermeasures Challenges motivate research in protecting speech biometric systems against a variety of different access attacks. The 2017 edition focused on replay spoofing attacks, and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-16 Bhusan Chettri , Emmanouil Benetos , Bob L. T. Sturm

Conventional spoofing detection systems have heavily relied on the use of handcrafted features derived from speech data. However, a notable shift has recently emerged towards the direct utilization of raw speech waveforms, as demonstrated…

Model inversion (MI) attacks allow to reconstruct average per-class representations of a machine learning (ML) model's training data. It has been shown that in scenarios where each class corresponds to a different individual, such as face…

Sound · Computer Science 2023-01-10 Karla Pizzi , Franziska Boenisch , Ugur Sahin , Konstantin Böttinger

Automatic speaker verification systems are increasingly used as the primary means to authenticate costumers. Recently, it has been proposed to train speaker verification systems using end-to-end deep neural models. In this paper, we show…

Machine Learning · Computer Science 2018-02-19 Felix Kreuk , Yossi Adi , Moustapha Cisse , Joseph Keshet

We introduce a new automatic evaluation method for speaker similarity assessment, that is consistent with human perceptual scores. Modern neural text-to-speech models require a vast amount of clean training data, which is why many solutions…

Sound · Computer Science 2022-07-04 Deja Kamil , Sanchez Ariadna , Roth Julian , Cotescu Marius

Masked speech modeling (MSM) methods such as wav2vec2 or w2v-BERT learn representations over speech frames which are randomly masked within an utterance. While these methods improve performance of Automatic Speech Recognition (ASR) systems,…

Due to the widespread deployment of fingerprint/face/speaker recognition systems, attacking deep learning based biometric systems has drawn more and more attention. Previous research mainly studied the attack to the vision-based system,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Jiguo Li , Xinfeng Zhang , Jizheng Xu , Li Zhang , Yue Wang , Siwei Ma , Wen Gao

Text-to-speech and voice conversion studies are constantly improving to the extent where they can produce synthetic speech almost indistinguishable from bona fide human speech. In this regard, the importance of countermeasures (CM) against…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Jin Woo Lee , Eungbeom Kim , Junghyun Koo , Kyogu Lee

Audio deepfake detection is crucial to combat the malicious use of AI-synthesized speech. Among many efforts undertaken by the community, the ASVspoof challenge has become one of the benchmarks to evaluate the generalizability and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-11 Yi Zhu , Chirag Goel , Surya Koppisetti , Trang Tran , Ankur Kumar , Gaurav Bharaj

Spoofing-robust automatic speaker verification (SASV) seeks to build automatic speaker verification systems that are robust against both zero-effort impostor attacks and sophisticated spoofing techniques such as voice conversion (VC) and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-17 Amro Asali , Yehuda Ben-Shimol , Itshak Lapidot

Although speaker verification has conventionally been an audio-only task, some practical applications provide both audio and visual streams of input. In these cases, the visual stream provides complementary information and can often be…

Sound · Computer Science 2021-02-15 Leda Sarı , Kritika Singh , Jiatong Zhou , Lorenzo Torresani , Nayan Singhal , Yatharth Saraf

We address speaker comparison by listening in a game-like environment, hypothesized to make the task more motivating for naive listeners. We present the same 30 trials selected with the help of an x-vector speaker recognition system from…

Sound · Computer Science 2022-05-11 Sandip Ghimire , Tomi Kinnunen , Rosa Gonzalez Hautamäki

Biometric systems are nowadays employed across a broad range of applications. They provide high security and efficiency and, in many cases, are user friendly. Despite these and other advantages, biometric systems in general and Automatic…

Automatic Speaker Verification (ASV), increasingly used in security-critical applications, faces vulnerabilities from rising adversarial attacks, with few effective defenses available. In this paper, we propose a neural codec-based…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-10 Xuanjun Chen , Jiawei Du , Haibin Wu , Jyh-Shing Roger Jang , Hung-yi Lee

This paper discusses the task of face-based speech synthesis, a kind of personalized speech synthesis where the synthesized voices are constrained to perceptually match with a reference face image. Due to the lack of TTS-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-07 Yao Shi , Yunfei Xu , Hongbin Suo , Yulong Wan , Haifeng Liu

In this paper, we propose a replay attack spoofing detection system for automatic speaker verification using multitask learning of noise classes. We define the noise that is caused by the replay attack as replay noise. We explore the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-26 Hye-Jin Shim , Jee-weon Jung , Hee-Soo Heo , Sunghyun Yoon , Ha-Jin Yu

Despite remarkable progress, automatic speaker verification (ASV) systems typically lack the transparency required for high-accountability applications. Motivated by how human experts perform forensic speaker comparison (FSC), we propose a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Yi Ma , Shuai Wang , Tianchi Liu , Haizhou Li