English
Related papers

Related papers: Fine-grained Early Frequency Attention for Deep Sp…

200 papers

Deep learning techniques have considerably improved speech processing in recent years. Speaker representations extracted by deep learning models are being used in a wide range of tasks such as speaker recognition and speech emotion…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-25 Amirhossein Hajavi , Ali Etemad

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

Sound · Computer Science 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

Transformer-based models have shown strong performance in speech deepfake detection, largely due to the effectiveness of the multi-head self-attention (MHSA) mechanism. MHSA provides frame-level attention scores, which are particularly…

Sound · Computer Science 2026-02-05 Tuan Dat Phuong , Duc-Tuan Truong , Long-Vu Hoang , Trang Nguyen Thi Thu

Attention has become one of the most commonly used mechanisms in deep learning approaches. The attention mechanism can help the system focus more on the feature space's critical regions. For example, high amplitude regions can play an…

Sound · Computer Science 2022-08-24 Junghun Kim , Yoojin An , Jihie Kim

The joint training of speech enhancement and speaker embedding networks for speaker recognition is widely adopted under noisy acoustic environments. While effective, this paradigm often fails to leverage the generalization and robustness…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-29 Chong-Xin Gan , Peter Bell , Man-Wai Mak , Zhe Li , Zezhong Jin , Zilong Huang , Kong Aik Lee

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

Several speech processing systems have demonstrated considerable performance improvements when deep complex neural networks (DCNN) are coupled with self-attention (SA) networks. However, the majority of DCNN-based studies on speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-24 Vinay Kothapally , John H. L. Hansen

The state-of-the-art speech enhancement has limited performance in speech estimation accuracy. Recently, in deep learning, the Transformer shows the potential to exploit the long-range dependency in speech by self-attention. Therefore, it…

Sound · Computer Science 2023-05-10 Yi Li , Yang Sun , Syed Mohsen Naqvi

Although recent advances in deep learning accelerated an improvement in a weakly supervised object localization (WSOL) task, there are still challenges to identify the entire body of an object, rather than only discriminative parts. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Junghyo Sohn , Eunjin Jeon , Wonsik Jung , Eunsong Kang , Heung-Il Suk

We introduce a novel speaker model \textsc{Kefa} for navigation instruction generation. The existing speaker models in Vision-and-Language Navigation suffer from the large domain gap of vision features between different environments and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 Haitian Zeng , Xiaohan Wang , Wenguan Wang , Yi Yang

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

In this work we propose a novel attention-based neural network model for the task of fine-grained entity type classification that unlike previously proposed models recursively composes representations of entity mention contexts. Our model…

Computation and Language · Computer Science 2016-04-20 Sonse Shimaoka , Pontus Stenetorp , Kentaro Inui , Sebastian Riedel

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

The recent rapid development of auditory attention decoding (AAD) offers the possibility of using electroencephalography (EEG) as auxiliary information for target speaker extraction. However, effectively modeling long sequences of speech…

Sound · Computer Science 2025-01-06 Cunhang Fan , Youdian Gao , Zexu Pan , Jingjing Zhang , Hongyu Zhang , Jie Zhang , Zhao Lv

The wide deployment of speech-based biometric systems usually demands high-performance speaker recognition algorithms. However, most of the prior works for speaker recognition either process the speech in the frequency domain or time…

Sound · Computer Science 2023-03-08 Jiguo Li , Tianzi Zhang , Xiaobin Liu , Lirong Zheng

Speaker recognition performance has been greatly improved with the emergence of deep learning. Deep neural networks show the capacity to effectively deal with impacts of noise and reverberation, making them attractive to far-field speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Wenda Chen , Jonathan Huang , Tobias Bocklet

In this paper, Whisper, a large-scale pre-trained model for automatic speech recognition, is proposed to apply to speaker verification. A partial multi-scale feature aggregation (PMFA) approach is proposed based on a subset of Whisper…

Sound · Computer Science 2024-08-29 Yiyang Zhao , Shuai Wang , Guangzhi Sun , Zehua Chen , Chao Zhang , Mingxing Xu , Thomas Fang Zheng

Transformer-based architectures for speaker verification typically require more training data than ECAPA-TDNN. Therefore, recent work has generally been trained on VoxCeleb1&2. We propose a backbone network based on self-attention, which…

Sound · Computer Science 2024-05-31 Nian Li , Jianguo Wei

The time delay neural network (TDNN) represents one of the state-of-the-art of neural solutions to text-independent speaker verification. However, they require a large number of filters to capture the speaker characteristics at any local…

Sound · Computer Science 2022-02-16 Tianchi Liu , Rohan Kumar Das , Kong Aik Lee , Haizhou Li

This paper introduces a lightweight deep learning model for real-time speech enhancement, designed to operate efficiently on resource-constrained devices. The proposed model leverages a compact architecture that facilitates rapid inference…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-23 Shuubham Ojha , Felix Gervits , Carol Espy-Wilson
‹ Prev 1 2 3 10 Next ›