English
Related papers

Related papers: TristouNet: Triplet Loss for Speaker Turn Embeddin…

200 papers

Current natural language understanding (NLU) models have been continuously scaling up, both in terms of model size and input context, introducing more hidden and input neurons. While this generally improves performance on average, the extra…

Computation and Language · Computer Science 2024-03-12 Yunchang Zhu , Liang Pang , Kangxi Wu , Yanyan Lan , Huawei Shen , Xueqi Cheng

Spoken language understanding (SLU) is a key component of task-oriented dialogue systems. SLU parses natural language user utterances into semantic frames. Previous work has shown that incorporating context information significantly…

Computation and Language · Computer Science 2020-03-04 Qian Chen , Zhu Zhuo , Wen Wang , Qiuyun Xu

This paper introduces a real-time time-domain packet loss concealment (PLC) neural-network (tPLCnet). It efficiently predicts lost frames from a short context buffer in a sequence-to-one (seq2one) fashion. Because of its seq2one structure,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-05 Nils L. Westhausen , Bernd T. Meyer

Speaker extraction is to extract a target speaker's voice from multi-talker speech. It simulates humans' cocktail party effect or the selective listening ability. The prior work mostly performs speaker extraction in frequency domain, then…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Chenglin Xu , Wei Rao , Eng Siong Chng , Haizhou Li

When designing fully-convolutional neural network, there is a trade-off between receptive field size, number of parameters and spatial resolution of features in deeper layers of the network. In this work we present a novel network design…

Machine Learning · Computer Science 2018-11-19 Tomasz Grzywalski , Szymon Drgas

Long Short-Term Memory (LSTM) is the primary recurrent neural networks architecture for acoustic modeling in automatic speech recognition systems. Residual learning is an efficient method to help neural networks converge easier and faster.…

Computation and Language · Computer Science 2017-08-21 Lu Huang , Jiasong Sun , Ji Xu , Yi Yang

This paper proposes a deep neural network model for joint modeling Natural Language Understanding (NLU) and Dialogue Management (DM) in goal-driven dialogue systems. There are three parts in this model. A Long Short-Term Memory (LSTM) at…

Computation and Language · Computer Science 2019-11-01 Yue Ma , Xiaojie Wang , Zhenjiang Dong , Hong Chen

Zero-shot multi-speaker Text-to-Speech (TTS) generates target speaker voices given an input text and the corresponding speaker embedding. In this work, we investigate the effectiveness of the TTS reconstruction objective to improve…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Jaejin Cho , Piotr Zelasko , Jesus Villalba , Shinji Watanabe , Najim Dehak

Neural network applications generally benefit from larger-sized models, but for current speech enhancement models, larger scale networks often suffer from decreased robustness to the variety of real-world use cases beyond what is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Umut Isik , Ritwik Giri , Neerad Phansalkar , Jean-Marc Valin , Karim Helwani , Arvindh Krishnaswamy

Self-supervised learning (SSL) models confront challenges of abrupt informational collapse or slow dimensional collapse. We propose TriNet, which introduces a novel triple-branch architecture for preventing collapse and stabilizing the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Lixin Cao , Jun Wang , Ben Yang , Dan Su , Dong Yu

Recently, Convolutional Neural Network (CNN) and Long short-term memory (LSTM) based models have been introduced to deep learning-based target speaker separation. In this paper, we propose an Attention-based neural network (Atss-Net) in the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Tingle Li , Qingjian Lin , Yuanyuan Bao , Ming Li

Spoken language understanding is typically based on pipeline architectures including speech recognition and natural language understanding steps. These components are optimized independently to allow usage of available data, but the overall…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Pavel Denisov , Ngoc Thang Vu

Semantic segmentation for medical 3D image stacks enables accurate volumetric reconstructions, computer-aided diagnostics and follow up treatment planning. In this work, we present a novel variant of the Unet model called the NUMSnet that…

Image and Video Processing · Electrical Eng. & Systems 2023-04-07 Sohini Roychowdhury

Deep representation learning using triplet network for classification suffers from a lack of theoretical foundation and difficulty in tuning both the network and classifiers for performance. To address the problem, local-margin triplet loss…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Phawis Thammasorn , Daniel Hippe , Wanpracha Chaovalitwongse , Matthew Spraker , Landon Wootton , Matthew Nyflot , Stephanie Combs , Jan Peeken , Eric Ford

The recent advances in deep learning are mostly driven by availability of large amount of training data. However, availability of such data is not always possible for specific tasks such as speaker recognition where collection of large…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-19 Prashant Anand , Ajeet Kumar Singh , Siddharth Srivastava , Brejesh Lall

While existing predictive frameworks are able to handle Euclidean structured data (i.e, brain images), they might fail to generalize to geometric non-Euclidean data such as brain networks. Besides, these are rooted the sample selection step…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Ahmet Serkan Goktas , Alaa Bessadok , Islem Rekik

Entrainment is a known adaptation mechanism that causes interaction participants to adapt or synchronize their acoustic characteristics. Understanding how interlocutors tend to adapt to each other's speaking style through entrainment…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-15 Md Nasir , Brian Baucom , Shrikanth Narayanan , Panayiotis Georgiou

Metric learning has become an attractive field for research on the latest years. Loss functions like contrastive loss, triplet loss or multi-class N-pair loss have made possible generating models capable of tackling complex scenarios with…

Machine Learning · Computer Science 2019-05-28 Alfonso Medela , Artzai Picon

We present a TTS neural network that is able to produce speech in multiple languages. The proposed network is able to transfer a voice, which was presented as a sample in a source language, into one of several target languages. Training is…

Machine Learning · Computer Science 2019-02-07 Eliya Nachmani , Lior Wolf

Time Delay Neural Network (TDNN) is a well-performing structure for DNN-based speaker recognition systems. In this paper we introduce a novel structure Crossed-Time Delay Neural Network (CTDNN) to enhance the performance of current TDNN.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-08 Liang Chen , Yanchun Liang , Xiaohu Shi , You Zhou , Chunguo Wu