English
Related papers

Related papers: Comparison of SVD and factorized TDNN approaches f…

200 papers

This work explores the use of a monolingual Deep Neural Network (DNN) model as an universal background model (UBM) to address the problem of Language Recognition (LR) in I-vector framework. A Time Delay Deep Neural Network (TDDNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-16 Mousmita Sarma , Kandarpa Kumar Sarma , Nagendra Kumar Goel

Speech separation algorithms are often used to separate the target speech from other interfering sources. However, purely neural network based speech separation systems often cause nonlinear distortion that is harmful for automatic speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-10 Zhuohuang Zhang , Yong Xu , Meng Yu , Shi-Xiong Zhang , Lianwu Chen , Dong Yu

To analyze the abundance of multidimensional data, tensor-based frameworks have been developed. Traditionally, the matrix singular value decomposition (SVD) is used to extract the most dominant features from a matrix containing the…

Machine Learning · Computer Science 2021-11-02 Katherine Keegan , Tanvi Vishwanath , Yihua Xu

We propose a data-driven sparse recovery framework for hybrid spherical linear microphone arrays using singular value decomposition (SVD) of the transfer operator. The SVD yields orthogonal microphone and field modes, reducing to spherical…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-04 Shunxi Xu , Thushara Abhayapala , Craig T. Jin

Traditional Time Delay Neural Networks (TDNN) have achieved state-of-the-art performance at the cost of high computational complexity and slower inference speed, making them difficult to implement in an industrial environment. The Densely…

Computation and Language · Computer Science 2024-02-13 Di Cao , Xianchen Wang , Junfeng Zhou , Jiakai Zhang , Yanjing Lei , Wenpeng Chen

This work focuses on designing low complexity hybrid tensor networks by considering trade-offs between the model complexity and practical performance. Firstly, we exploit a low-rank tensor-train deep neural network (TT-DNN) to build an…

Machine Learning · Computer Science 2022-03-14 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Javier Tejedor

The paper presents a strategy to construct an incremental Singular Value Decomposition (SVD) for time-evolving, spatially 3D discrete data sets. A low memory access procedure for reducing and deploying the snapshot data is presented.…

Mathematical Software · Computer Science 2023-02-21 Niklas Kühl , Hendrik Fischer , Michael Hinze , Thomas Rung

With the enactment of privacy-preserving regulations, e.g., GDPR, federated SVD is proposed to enable SVD-based applications over different data sources without revealing the original data. However, many SVD-based applications cannot be…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-05 Di Chai , Leye Wang , Junxue Zhang , Liu Yang , Shuowei Cai , Kai Chen , Qiang Yang

Achieving efficient and robust multi-channel data learning is a challenging task in data science. By exploiting low-rankness in the transformed domain, i.e., transformed low-rankness, tensor Singular Value Decomposition (t-SVD) has achieved…

Machine Learning · Computer Science 2023-12-21 Andong Wang , Chao Li , Mingyuan Bai , Zhong Jin , Guoxu Zhou , Qibin Zhao

We propose an end-to-end speech enhancement method with trainable time-frequency~(T-F) transform based on invertible deep neural network~(DNN). The resent development of speech enhancement is brought by using DNN. The ordinary DNN-based…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-17 Daiki Takeuchi , Kohei Yatabe , Yuma Koizumi , Yasuhiro Oikawa , Noboru Harada

Adapting End-to-End ASR models to out-of-domain datasets with text data is challenging. Factorized neural Transducer (FNT) aims to address this issue by introducing a separate vocabulary decoder to predict the vocabulary. Nonetheless, this…

Computation and Language · Computer Science 2024-06-07 Junzhe Liu , Jianwei Yu , Xie Chen

Neural transducer is now the most popular end-to-end model for speech recognition, due to its naturally streaming ability. However, it is challenging to adapt it with text-only data. Factorized neural transducer (FNT) model was proposed to…

Computation and Language · Computer Science 2023-02-24 Rui Zhao , Jian Xue , Partha Parthasarathy , Veljko Miljanic , Jinyu Li

This article studies the problem of decentralized Singular Value Decomposition (d-SVD), which is fundamental in various signal processing applications. Two scenarios are considered depending on the availability of the data matrix under…

Signal Processing · Electrical Eng. & Systems 2025-01-10 Yufan Fan , Marius Pesavento

Deep neural networks (DNNs) have found applications in diverse signal processing (SP) problems. Most efforts either directly adopt the DNN as a black-box approach to perform certain SP tasks without taking into account of any known…

Signal Processing · Electrical Eng. & Systems 2022-04-27 Zhe Zhang , Xiang Chen , Zhi Tian

In this paper, we study robust tensor completion by using transformed tensor singular value decomposition (SVD), which employs unitary transform matrices instead of discrete Fourier transform matrix that is used in the traditional tensor…

Machine Learning · Computer Science 2019-07-03 Guangjing Song , Michael K. Ng , Xiongjun Zhang

Vanishing and exploding gradients are two of the main obstacles in training deep neural networks, especially in capturing long range dependencies in recurrent neural networks~(RNNs). In this paper, we present an efficient parametrization of…

Machine Learning · Computer Science 2018-03-28 Jiong Zhang , Qi Lei , Inderjit S. Dhillon

Learned feature representations and sub-phoneme posteriors from Deep Neural Networks (DNNs) have been used separately to produce significant performance gains for speaker and language recognition tasks. In this work we show how these gains…

Computation and Language · Computer Science 2015-04-06 Fred Richardson , Douglas Reynolds , Najim Dehak

Tensor network (TN) representation is a powerful technique for computer vision and machine learning. TN structure search (TN-SS) aims to search for a customized structure to achieve a compact representation, which is a challenging NP-hard…

Machine Learning · Computer Science 2024-04-15 Yu-Bang Zheng , Xi-Le Zhao , Junhua Zeng , Chao Li , Qibin Zhao , Heng-Chao Li , Ting-Zhu Huang

In this paper, the existing Scheduling Dimension Reduction (SDR) methods for Linear Parameter-Varying (LPV) models are reviewed and a Deep Neural Network (DNN) approach is developed that achieves higher model accuracy under scheduling…

Systems and Control · Electrical Eng. & Systems 2020-12-10 P. J. W. Koelewijn , R. Tóth

The tensor Singular Value Decomposition (t-SVD) for third order tensors that was proposed by Kilmer and Martin~\cite{2011kilmer} has been applied successfully in many fields, such as computed tomography, facial recognition, and video…

Numerical Analysis · Mathematics 2016-09-23 Jiani Zhang , Arvind K. Saibaba , Misha Kilmer , Shuchin Aeron