English
Related papers

Related papers: Multi-task Recurrent Model for Speech and Speaker …

200 papers

Recent work on speech representation models jointly pre-trained with text has demonstrated the potential of improving speech representations by encoding speech and text in a shared space. In this paper, we leverage such shared…

Computation and Language · Computer Science 2023-10-10 Chung-Ming Chien , Mingjiamei Zhang , Ju-Chieh Chou , Karen Livescu

We propose an end-to-end speaker-attributed automatic speech recognition model that unifies speaker counting, speech recognition, and speaker identification on monaural overlapped speech. Our model is built on serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Naoyuki Kanda , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Tianyan Zhou , Takuya Yoshioka

Deep learning yields great results across many fields, from speech recognition, image classification, to translation. But for each problem, getting a deep model to work well involves research into the architecture and a long period of…

Machine Learning · Computer Science 2017-06-19 Lukasz Kaiser , Aidan N. Gomez , Noam Shazeer , Ashish Vaswani , Niki Parmar , Llion Jones , Jakob Uszkoreit

In practical applications, computer vision tasks often need to be addressed simultaneously. Multitask learning typically achieves this by jointly training a single deep neural network to learn shared representations, providing efficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Konstantinos Spathis , Nikolaos Kardaris , Petros Maragos

Audio-visual automatic speech recognition is a promising approach to robust ASR under noisy conditions. However, up until recently it had been traditionally studied in isolation assuming the video of a single speaking face matches the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-13 Otavio Braga , Olivier Siohan

Distributed representation plays an important role in deep learning based natural language processing. However, the representation of a sentence often varies in different tasks, which is usually learned from scratch and suffers from the…

Computation and Language · Computer Science 2018-04-24 Renjie Zheng , Junkun Chen , Xipeng Qiu

State-of-the-art studies have demonstrated the superiority of joint modelling over pipeline implementation for medical named entity recognition and normalization due to the mutual benefits between the two processes. To exploit these…

Computation and Language · Computer Science 2018-12-17 Sendong Zhao , Ting Liu , Sicheng Zhao , Fei Wang

This study employs deep learning techniques to explore four speaker profiling tasks on the TIMIT dataset, namely gender classification, accent classification, age estimation, and speaker identification, highlighting the potential and…

Sound · Computer Science 2024-04-19 Rong Wang , Kun Sun

Target speaker extraction is to extract the target speaker, specified by enrollment utterance, in an environment with other competing speakers. Therefore, the task needs to solve two problems, speaker identification and separation, at the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Pengjie Shen , Shulin He , Xueliang Zhang

In this paper, we present a novel modeling method for single-channel multi-talker overlapped automatic speech recognition (ASR) systems. Fully neural network based end-to-end models have dramatically improved the performance of multi-taker…

Computation and Language · Computer Science 2021-07-06 Ryo Masumura , Daiki Okamura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi

This paper explores the task of answer-aware questions generation. Based on the attention-based pointer generator model, we propose to incorporate an auxiliary task of language modeling to help question generation in a hierarchical…

Computation and Language · Computer Science 2019-09-02 Wenjie Zhou , Minghua Zhang , Yunfang Wu

Learning distributed sentence representations is one of the key challenges in natural language processing. Previous work demonstrated that a recurrent neural network (RNNs) based sentence encoder trained on a large collection of annotated…

Computation and Language · Computer Science 2018-08-20 Wasi Uddin Ahmad , Xueying Bai , Zhechao Huang , Chao Jiang , Nanyun Peng , Kai-Wei Chang

In this work, we propose an overlapped speech detection system trained as a three-class classifier. Unlike conventional systems that perform binary classification as to whether or not a frame contains overlapped speech, the proposed…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-08 Jee-weon Jung , Hee-Soo Heo , Youngki Kwon , Joon Son Chung , Bong-Jin Lee

Learned feature representations and sub-phoneme posteriors from Deep Neural Networks (DNNs) have been used separately to produce significant performance gains for speaker and language recognition tasks. In this work we show how these gains…

Computation and Language · Computer Science 2015-04-06 Fred Richardson , Douglas Reynolds , Najim Dehak

Current state-of-the-art speech recognition models are trained to map acoustic signals into sub-lexical units. While these models demonstrate superior performance, they remain vulnerable to out-of-distribution conditions such as background…

Sound · Computer Science 2024-10-10 Sagarika Alavilli , Annesya Banerjee , Gasser Elbanna , Annika Magaro

Speaker recognition is a task of identifying persons from their voices. Recently, deep learning has dramatically revolutionized speaker recognition. However, there is lack of comprehensive reviews on the exciting progress. In this paper, we…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Zhongxin Bai , Xiao-Lei Zhang

Pronunciation assessment models designed for open response scenarios enable users to practice language skills in a manner similar to real-life communication. However, previous open-response pronunciation assessment models have predominantly…

Computation and Language · Computer Science 2024-06-06 Yu-Wen Chen , Zhou Yu , Julia Hirschberg

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

Most human interactions occur in the form of spoken conversations where the semantic meaning of a given utterance depends on the context. Each utterance in spoken conversation can be represented by many semantic and speaker attributes, and…

Computation and Language · Computer Science 2023-05-02 Siddhant Arora , Hayato Futami , Emiru Tsunoo , Brian Yan , Shinji Watanabe

This article provides a unifying Bayesian network view on various approaches for acoustic model adaptation, missing feature, and uncertainty decoding that are well-known in the literature of robust automatic speech recognition. The…

Machine Learning · Computer Science 2014-09-23 Roland Maas , Christian Huemmer , Armin Sehr , Walter Kellermann