中文
相关论文

相关论文: MFA: TDNN with Multi-scale Frequency-channel Atten…

200 篇论文

In this paper, Whisper, a large-scale pre-trained model for automatic speech recognition, is proposed to apply to speaker verification. A partial multi-scale feature aggregation (PMFA) approach is proposed based on a subset of Whisper…

声音 · 计算机科学 2024-08-29 Yiyang Zhao , Shuai Wang , Guangzhi Sun , Zehua Chen , Chao Zhang , Mingxing Xu , Thomas Fang Zheng

In this work, we extend our previously proposed offline SpatialNet for long-term streaming multichannel speech enhancement in both static and moving speaker scenarios. SpatialNet exploits spatial information, such as the spatial/steering…

声音 · 计算机科学 2024-06-21 Changsheng Quan , Xiaofei Li

State-of-the-art speaker verification frameworks have typically focused on developing models with increasingly deeper (more layers) and wider (number of channels) models to improve their verification performance. Instead, this paper…

声音 · 计算机科学 2023-02-28 Anna Ollerenshaw , Md Asif Jalal , Thomas Hain

In this paper, we exploit the effective way to leverage contextual information to improve the speech dereverberation performance in real-world reverberant environments. We propose a temporal-contextual attention approach on the deep neural…

音频与语音处理 · 电气工程与系统科学 2021-08-27 Helin Wang , Bo Wu , Lianwu Chen , Meng Yu , Jianwei Yu , Yong Xu , Shi-Xiong Zhang , Chao Weng , Dan Su , Dong Yu

Speech separation has been extensively studied to deal with the cocktail party problem in recent years. All related approaches can be divided into two categories: time-frequency domain methods and time domain methods. In addition, some…

音频与语音处理 · 电气工程与系统科学 2022-03-31 Fan-Lin Wang , Yu-Huai Peng , Hung-Shin Lee , Hsin-Min Wang

Attention mechanisms have emerged as important tools that boost the performance of deep models by allowing them to focus on key parts of learned embeddings. However, current attention mechanisms used in speaker recognition tasks fail to…

声音 · 计算机科学 2022-07-21 Amirhossein Hajavi , Ali Etemad

We introduce a time-domain framework for efficient multichannel speech enhancement, emphasizing low latency and computational efficiency. This framework incorporates two compact deep neural networks (DNNs) surrounding a multichannel neural…

声音 · 计算机科学 2024-01-17 Tsun-An Hsieh , Jacob Donley , Daniel Wong , Buye Xu , Ashutosh Pandey

In recent studies, it has shown that speaker patterns can be learned from very short speech segments (e.g., 0.3 seconds) by a carefully designed convolutional & time-delay deep neural network (CT-DNN) model. By enforcing the model to…

声音 · 计算机科学 2018-02-28 Lantian Li , Zhiyuan Tang , Dong Wang , Thomas Fang Zheng

Transformer-based architectures for speaker verification typically require more training data than ECAPA-TDNN. Therefore, recent work has generally been trained on VoxCeleb1&2. We propose a backbone network based on self-attention, which…

声音 · 计算机科学 2024-05-31 Nian Li , Jianguo Wei

Speaker-independent speech separation has achieved remarkable performance in recent years with the development of deep neural network (DNN). Various network architectures, from traditional convolutional neural network (CNN) and recurrent…

音频与语音处理 · 电气工程与系统科学 2022-06-17 Xue Yang , Changchun Bao

We present an efficient speech separation neural network, ARFDCN, which combines dilated convolutions, multi-scale fusion (MSF), and channel attention to overcome the limited receptive field of convolution-based networks and the high…

音频与语音处理 · 电气工程与系统科学 2023-06-12 Junyu Wang

Employing deep neural networks (DNNs) to directly learn filters for multi-channel speech enhancement has potentially two key advantages over a traditional approach combining a linear spatial filter with an independent tempo-spectral…

音频与语音处理 · 电气工程与系统科学 2022-06-23 Kristina Tesch , Nils-Hendrik Mohrmann , Timo Gerkmann

This paper presents a novel design of attention model for text-independent speaker verification. The model takes a pair of input utterances and generates an utterance-level embedding to represent speaker-specific characteristics in each…

音频与语音处理 · 电气工程与系统科学 2020-09-14 Jingyu Li , Tan Lee

The convolutional neural network (CNN) based approaches have shown great success for speaker verification (SV) tasks, where modeling long temporal context and reducing information loss of speaker characteristics are two important challenges…

声音 · 计算机科学 2021-08-31 Yanfeng Wu , Chenkai Guo , Junan Zhao , Xiao Jin , Jing Xu

Recent research shows that deep neural networks (DNNs) can be used to extract deep speaker vectors (d-vectors) that preserve speaker characteristics and can be used in speaker verification. This new method has been tested on text-dependent…

计算与语言 · 计算机科学 2015-05-26 Lantian Li , Dong Wang , Zhiyong Zhang , Thomas Fang Zheng

Modern automatic speaker verification relies largely on deep neural networks (DNNs) trained on mel-frequency cepstral coefficient (MFCC) features. While there are alternative feature extraction methods based on phase, prosody and long-term…

音频与语音处理 · 电气工程与系统科学 2020-07-31 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

In this paper, adaptive mechanisms are applied in deep neural network (DNN) training for x-vector-based text-independent speaker verification. First, adaptive convolutional neural networks (ACNNs) are employed in frame-level embedding…

音频与语音处理 · 电气工程与系统科学 2025-12-18 Bin Gu , Wu Guo , Lirong Dai , Jun Du

Time Delay Neural Networks (TDNNs) are widely used in both DNN-HMM based hybrid speech recognition systems and recent end-to-end systems. Nevertheless, the receptive fields of TDNNs are limited and fixed, which is not desirable for tasks…

音频与语音处理 · 电气工程与系统科学 2021-05-03 Keyu An , Yi Zhang , Zhijian Ou

Recently, the source separation performance was greatly improved by time-domain audio source separation based on dual-path recurrent neural network (DPRNN). DPRNN is a simple but effective model for a long sequential data. While DPRNN is…

音频与语音处理 · 电气工程与系统科学 2020-06-25 Keisuke Kinoshita , Thilo von Neumann , Marc Delcroix , Tomohiro Nakatani , Reinhold Haeb-Umbach

Speech enhancement models should meet very low latency requirements typically smaller than 5 ms for hearing assistive devices. While various low-latency techniques have been proposed, comparing these methods in a controlled setup using DNNs…

音频与语音处理 · 电气工程与系统科学 2024-09-17 Haibin Wu , Sebastian Braun