English
Related papers

Related papers: End-to-End Attention based Text-Dependent Speaker …

200 papers

This paper focuses on the problem of query by example spoken term detection (QbE-STD) in zero-resource scenario. State-of-the-art approaches primarily rely on dynamic time warping (DTW) based template matching techniques using phone…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-20 Dhananjay Ram , Lesly Miculicich , Hervé Bourlard

In this work, we present a hybrid CTC/Attention model based on a ResNet-18 and Convolution-augmented transformer (Conformer), that can be trained in an end-to-end manner. In particular, the audio and visual encoders learn to extract…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Pingchuan Ma , Stavros Petridis , Maja Pantic

Deep learning approaches are still not very common in the speaker verification field. We investigate the possibility of using deep residual convolutional neural network with spectrograms as an input features in the text-dependent speaker…

Sound · Computer Science 2017-05-31 Egor Malykh , Sergey Novoselov , Oleg Kudashev

This paper presents an improved deep embedding learning method based on convolutional neural network (CNN) for text-independent speaker verification. Two improvements are proposed for x-vector embedding learning: (1) Multi-scale convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-15 Bin Gu , Wu Guo

Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-01 Jingyu Li , Yusheng Tian , Tan Lee

In recent years, using raw waveforms as input for deep networks has been widely explored for the speaker verification system. For example, RawNet and RawNet2 extracted speaker's feature embeddings from waveforms automatically for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Jin Li , Nan Yan , Lan Wang

Recently, x-vector has been a successful and popular approach for speaker verification, which employs a time delay neural network (TDNN) and statistics pooling to extract speaker characterizing embedding from variable-length utterances.…

Sound · Computer Science 2022-01-02 Wentao Zhu , Tianlong Kong , Shun Lu , Jixiang Li , Dawei Zhang , Feng Deng , Xiaorui Wang , Sen Yang , Ji Liu

The classical i-vectors and the latest end-to-end deep speaker embeddings are the two representative categories of utterance-level representations in automatic speaker verification systems. Traditionally, once i-vectors or deep speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-12 Weicheng Cai , Jinkun Chen , Ming Li

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

Sound · Computer Science 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

Recent advances in the Active Speaker Detection (ASD) problem build upon a two-stage process: feature extraction and spatio-temporal context aggregation. In this paper, we propose an end-to-end ASD workflow where feature learning and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Juan Leon Alcazar , Moritz Cordes , Chen Zhao , Bernard Ghanem

Modern automatic speaker verification relies largely on deep neural networks (DNNs) trained on mel-frequency cepstral coefficient (MFCC) features. While there are alternative feature extraction methods based on phase, prosody and long-term…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-31 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

Most state-of-the-art Deep Learning systems for speaker verification are based on speaker embedding extractors. These architectures are commonly composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-12 Miquel India , Pooyan Safari , Javier Hernando

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

Recently, there has been an increasing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. One approach is the attention-based encoder-decoder framework that learns a mapping…

Computation and Language · Computer Science 2017-02-02 Suyoun Kim , Takaaki Hori , Shinji Watanabe

In this paper, we present an end-to-end language identification framework, the attention-based Convolutional Neural Network-Bidirectional Long-short Term Memory (CNN-BLSTM). The model is performed on the utterance level, which means the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-21 Weicheng Cai , Danwei Cai , Shen Huang , Ming Li

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

In this letter, we propose a vocal tract length (VTL) perturbation method for text-dependent speaker verification (TD-SV), in which a set of TD-SV systems are trained, one for each VTL factor, and score-level fusion is applied to make a…

Sound · Computer Science 2021-03-29 Achintya kr. Sarkar , Zheng-Hua Tan

Albeit recent progress in speaker verification generates powerful models, malicious attacks in the form of spoofed speech, are generally not coped with. Recent results in ASVSpoof2015 and BTAS2016 challenges indicate that spoof-aware…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-28 Heinrich Dinkel , Nanxin Chen , Yanmin Qian , Kai Yu

In this paper, we present a time-contrastive learning (TCL) based bottleneck (BN)feature extraction method for speech signals with an application to text-dependent (TD) speaker verification (SV). It is well-known that speech signals exhibit…

Sound · Computer Science 2019-05-14 Achintya Kr. Sarkar , Zheng-Hua Tan

Voice activity detection (VAD) is an essential pre-processing step for tasks such as automatic speech recognition (ASR) and speaker recognition. A basic goal is to remove silent segments within an audio, while a more general VAD system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Yefei Chen , Shuai Wang , Yanmin Qian , Kai Yu