English
Related papers

Related papers: P-vectors: A Parallel-Coupled TDNN/Transformer Net…

200 papers

Temporal models based on recurrent neural networks have proven to be quite powerful in a wide variety of applications. However, training these models often relies on back-propagation through time, which entails unfolding the network over…

Neural and Evolutionary Computing · Computer Science 2019-08-13 Alexander Ororbia , Ankur Mali , C. Lee Giles , Daniel Kifer

Temporal Graph Neural Networks (TGNNs) are powerful models to capture temporal, structural, and contextual information on temporal graphs. The generated temporal node embeddings outperform other methods in many downstream tasks. Real-world…

Hardware Architecture · Computer Science 2022-03-11 Hongkuan Zhou , Bingyi Zhang , Rajgopal Kannan , Viktor Prasanna , Carl Busart

Speaker verification systems usually suffer from the mismatch problem between training and evaluation data, such as speaker population mismatch, the channel and environment variations. In order to address this issue, it requires the system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Xu Li , Jinghua Zhong , Jianwei Yu , Shoukang Hu , Xixin Wu , Xunying Liu , Helen Meng

Deep neural networks (DNNs) have shown promising results for acoustic echo cancellation (AEC). But the DNN-based AEC models let through all near-end speakers including the interfering speech. In light of recent studies on personalized…

Sound · Computer Science 2022-07-01 Shimin Zhang , Ziteng Wang , Yukai Ju , Yihui Fu , Yueyue Na , Qiang Fu , Lei Xie

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

In this paper, we introduce a simple but quite effective recognition framework dubbed D-PCN, aiming at enhancing feature extracting ability of CNN. The framework consists of two parallel CNNs, a discriminator and an extra classifier which…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Shiqi Yang , Gang Peng

The dominant speech separation models are based on complex recurrent or convolution neural network that model speech sequences indirectly conditioning on context, such as passing information through many intermediate states in recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Jingjing Chen , Qirong Mao , Dong Liu

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

The performance of Neural Network (NN)-based language models is steadily improving due to the emergence of new architectures, which are able to learn different natural language characteristics. This paper presents a novel framework, which…

Computation and Language · Computer Science 2017-08-24 Youssef Oualil , Dietrich Klakow

The classical i-vectors and the latest end-to-end deep speaker embeddings are the two representative categories of utterance-level representations in automatic speaker verification systems. Traditionally, once i-vectors or deep speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-12 Weicheng Cai , Jinkun Chen , Ming Li

Creating Speaker Verification (SV) systems for classroom settings that are robust to classroom noises such as babble noise is crucial for the development of AI tools that assist educational environments. In this work, we study the efficacy…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Saba Tabatabaee , Jing Liu , Carol Espy-Wilson

We explore options to use Transformer networks in neural transducer for end-to-end speech recognition. Transformer networks use self-attention for sequence modeling and comes with advantages in parallel computation and capturing contexts.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Ching-Feng Yeh , Jay Mahadeokar , Kaustubh Kalgaonkar , Yongqiang Wang , Duc Le , Mahaveer Jain , Kjell Schubert , Christian Fuegen , Michael L. Seltzer

Speaker embedding is an important front-end module to explore discriminative speaker features for many speech applications where speaker information is needed. Current SOTA backbone networks for speaker embedding are designed to aggregate…

Sound · Computer Science 2022-03-18 Ruiteng Zhang , Jianguo Wei , Xugang Lu , Wenhuan Lu , Di Jin , Junhai Xu , Lin Zhang , Yantao Ji , Jianwu Dang

Performance degradation caused by language mismatch is a common problem when applying a speaker verification system on speech data in different languages. This paper proposes a domain transfer network, named EDITnet, to alleviate the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Jingyu Li , Wei Liu , Tan Lee

The explosion of available speech data and new speaker modeling methods based on deep neural networks (DNN) have given the ability to develop more robust speaker recognition systems. Among DNN speaker modelling techniques, x-vector system…

Sound · Computer Science 2020-06-30 Mohammad Mohammadamini , Driss Matrouf

In this work, we investigate the use of embeddings for speaker-adaptive training of DNNs (DNN-SAT) focusing on a small amount of adaptation data per speaker. DNN-SAT can be viewed as learning a mapping from each embedding to transformation…

Computation and Language · Computer Science 2019-10-01 Joanna Rownicka , Peter Bell , Steve Renals

In this paper, a new speech feature fusion method is proposed for speaker recognition on the basis of the cross gate parallel convolutional neural network (CG-PCNN). The Mel filter bank features (MFBFs) of different frequency resolutions…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-28 Jiacheng Zhang , Wenyi Yan , Ye Zhang

In this paper, in order to further deal with the performance degradation caused by ignoring the phase information in conventional speech enhancement systems, we proposed a temporal dilated convolutional generative adversarial network…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-01 Shuaishuai Ye , Xinhui Hu , Xinkang Xu

Representations from pre-trained speech foundation models (SFMs) have shown impressive performance in many downstream tasks. However, the potential benefits of incorporating pre-trained SFM representations into speaker voice similarity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Chun Yin , Tai-Shih Chi , Yu Tsao , Hsin-Min Wang

Effective fusion of multi-scale features is crucial for improving speaker verification performance. While most existing methods aggregate multi-scale features in a layer-wise manner via simple operations, such as summation or concatenation.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-04 Yafeng Chen , Siqi Zheng , Hui Wang , Luyao Cheng , Qian Chen , Jiajun Qi