English
Related papers

Related papers: End-to-End Neural Transformer Based Spoken Languag…

200 papers

End-to-end (E2E) spoken language understanding (SLU) systems avoid an intermediate textual representation by mapping speech directly into intents with slot values. This approach requires considerable domain-specific training data. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Pu Wang , Bagher BabaAli , Hugo Van hamme

End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, these systems model sequence labeling as a sequence prediction…

Computation and Language · Computer Science 2022-10-31 Siddhant Arora , Siddharth Dalmia , Brian Yan , Florian Metze , Alan W Black , Shinji Watanabe

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

In spoken language understanding (SLU), what the user says is converted to his/her intent. Recent work on end-to-end SLU has shown that accuracy can be improved via pre-training approaches. We revisit ideas presented by Lugosch et al. using…

Computation and Language · Computer Science 2022-04-08 Nick J. C. Wang , Lu Wang , Yandan Sun , Haimei Kang , Dejun Zhang

End-to-end spoken language understanding (SLU) has recently attracted increasing interest. Compared to the conventional tandem-based approach that combines speech recognition and language understanding as separate modules, the new approach…

Computation and Language · Computer Science 2021-07-20 Nihal Potdar , Anderson R. Avila , Chao Xing , Dong Wang , Yiran Cao , Xiao Chen

Human-computer interaction (HCI) is significantly impacted by delayed responses from a spoken dialogue system. Hence, end-to-end (e2e) spoken language understanding (SLU) solutions have recently been proposed to decrease latency. Such…

Computation and Language · Computer Science 2021-06-10 Yiran Cao , Nihal Potdar , Anderson R. Avila

Spoken Language Understanding (SLU), a core component of the task-oriented dialogue system, expects a shorter inference latency due to the impatience of humans. Non-autoregressive SLU models clearly increase the inference speed but suffer…

Computation and Language · Computer Science 2021-08-17 Lizhi Cheng , Weijia Jia , Wenmian Yang

Spoken Language Understanding (SLU) is a key component of goal oriented dialogue systems that would parse user utterances into semantic frame representations. Traditionally SLU does not utilize the dialogue history beyond the previous…

Computation and Language · Computer Science 2017-07-11 Ankur Bapna , Gokhan Tur , Dilek Hakkani-Tur , Larry Heck

We present a comprehensive study on building and adapting RNN transducer (RNN-T) models for spoken language understanding(SLU). These end-to-end (E2E) models are constructed in three practical settings: a case where verbatim transcripts are…

Computation and Language · Computer Science 2021-04-09 Samuel Thomas , Hong-Kwang J. Kuo , George Saon , Zoltán Tüske , Brian Kingsbury , Gakuto Kurata , Zvi Kons , Ron Hoory

End-to-end spoken language understanding (SLU) models are a class of model architectures that predict semantics directly from speech. Because of their input and output types, we refer to them as speech-to-interpretation (STI) models.…

Computation and Language · Computer Science 2020-08-10 Joseph P. McKenna , Samridhi Choudhary , Michael Saxon , Grant P. Strimel , Athanasios Mouchtaris

Conventional spoken language understanding (SLU) consist of two stages, the first stage maps speech to text by automatic speech recognition (ASR), and the second stage maps text to intent by natural language understanding (NLU). End-to-end…

Multimedia · Computer Science 2021-12-14 Haoran Wei , Fei Tao , Runze Su , Sen Yang , Ji Liu

End-to-end spoken language understanding (SLU) predicts intent directly from audio using a single model. It promises to improve the performance of assistant systems by leveraging acoustic information lost in the intermediate textual…

End-to-end spoken language understanding (SLU) systems that process human-human or human-computer interactions are often context independent and process each turn of a conversation independently. Spoken conversations on the other hand, are…

Computation and Language · Computer Science 2021-08-20 Jatin Ganhotra , Samuel Thomas , Hong-Kwang J. Kuo , Sachindra Joshi , George Saon , Zoltán Tüske , Brian Kingsbury

Spoken Language Understanding (SLU) aims to extract the semantics frame of user queries, which is a core component in a task-oriented dialog system. With the burst of deep neural networks and the evolution of pre-trained language models,…

Computation and Language · Computer Science 2021-05-11 Libo Qin , Tianbao Xie , Wanxiang Che , Ting Liu

Spoken Language Understanding (SLU) is composed of two subtasks: intent detection (ID) and slot filling (SF). There are two lines of research on SLU. One jointly tackles these two subtasks to improve their prediction accuracy, and the other…

Computation and Language · Computer Science 2021-07-27 Linhao Zhang , Yu Shi , Linjun Shou , Ming Gong , Houfeng Wang , Michael Zeng

End-to-end Spoken Language Understanding (E2E SLU) has attracted increasing interest due to its advantages of joint optimization and low latency when compared to traditionally cascaded pipelines. Existing E2E SLU models usually follow a…

Computation and Language · Computer Science 2022-04-04 Xuandi Fu , Feng-Ju Chang , Martin Radfar , Kai Wei , Jing Liu , Grant P. Strimel , Kanthashree Mysore Sathyendra

Much recent work on Spoken Language Understanding (SLU) falls short in at least one of three ways: models were trained on oracle text input and neglected the Automatics Speech Recognition (ASR) outputs, models were trained to predict only…

Computation and Language · Computer Science 2020-11-13 Cheng-I Lai , Jin Cao , Sravan Bodapati , Shang-Wen Li

End-to-end spoken language understanding (SLU) systems benefit from pretraining on large corpora, followed by fine-tuning on application-specific data. The resulting models are too large for on-edge applications. For instance, BERT-based…

Computation and Language · Computer Science 2022-06-30 Pu Wang , Hugo Van hamme

We present an end-to-end approach to extract semantic concepts directly from the speech audio signal. To overcome the lack of data available for this spoken language understanding approach, we investigate the use of a transfer learning…

Computation and Language · Computer Science 2019-06-19 Antoine Caubrière , Natalia Tomashenko , Antoine Laurent , Emmanuel Morin , Nathalie Camelin , Yannick Estève

Understanding spoken language is a highly complex problem, which can be decomposed into several simpler tasks. In this paper, we focus on Spoken Language Understanding (SLU), the module of spoken dialog systems responsible for extracting a…

Computation and Language · Computer Science 2017-06-22 Marco Dinarelli , Yoann Dupont , Isabelle Tellier