English
Related papers

Related papers: Recent Advances in End-to-End Spoken Language Unde…

200 papers

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

It is challenging to extract semantic meanings directly from audio signals in spoken language understanding (SLU), due to the lack of textual information. Popular end-to-end (E2E) SLU models utilize sequence-to-sequence automatic speech…

Computation and Language · Computer Science 2023-06-05 Jixuan Wang , Martin Radfar , Kai Wei , Clement Chung

Spoken Language Understanding (SLU) is a core task in most human-machine interaction systems. With the emergence of smart homes, smart phones and smart speakers, SLU has become a key technology for the industry. In a classical SLU approach,…

Computation and Language · Computer Science 2022-07-19 Thierry Desot , François Portet , Michel Vacher

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

Named entity recognition (NER) is among SLU tasks that usually extract semantic information from textual documents. Until now, NER from speech is made through a pipeline process that consists in processing first an automatic speech…

Computation and Language · Computer Science 2018-05-31 Sahar Ghannay , Antoine Caubrière , Yannick Estève , Antoine Laurent , Emmanuel Morin

Spoken Language Understanding (SLU) is a key component of goal oriented dialogue systems that would parse user utterances into semantic frame representations. Traditionally SLU does not utilize the dialogue history beyond the previous…

Computation and Language · Computer Science 2017-07-11 Ankur Bapna , Gokhan Tur , Dilek Hakkani-Tur , Larry Heck

In contrast to conventional pipeline Spoken Language Understanding (SLU) which consists of automatic speech recognition (ASR) and natural language understanding (NLU), end-to-end SLU infers the semantic meaning directly from speech and…

Computation and Language · Computer Science 2021-05-12 Pengwei Wang , Xin Ye , Xiaohuan Zhou , Jinghui Xie , Hao Wang

Conventional spoken language understanding (SLU) consist of two stages, the first stage maps speech to text by automatic speech recognition (ASR), and the second stage maps text to intent by natural language understanding (NLU). End-to-end…

Multimedia · Computer Science 2021-12-14 Haoran Wei , Fei Tao , Runze Su , Sen Yang , Ji Liu

End-to-end (E2E) spoken language understanding (SLU) can infer semantics directly from speech signal without cascading an automatic speech recognizer (ASR) with a natural language understanding (NLU) module. However, paired utterance…

Computation and Language · Computer Science 2021-02-15 Yao Qian , Ximo Bian , Yu Shi , Naoyuki Kanda , Leo Shen , Zhen Xiao , Michael Zeng

Spoken Language Understanding (SLU) is composed of two subtasks: intent detection (ID) and slot filling (SF). There are two lines of research on SLU. One jointly tackles these two subtasks to improve their prediction accuracy, and the other…

Computation and Language · Computer Science 2021-07-27 Linhao Zhang , Yu Shi , Linjun Shou , Ming Gong , Houfeng Wang , Michael Zeng

In Spoken Language Understanding (SLU) the task is to extract important information from audio commands, like the intent of what a user wants the system to do and special entities like locations or numbers. This paper presents a simple…

Computation and Language · Computer Science 2022-06-30 Daniel Bermuth , Alexander Poeppel , Wolfgang Reif

We present an end-to-end approach to extract semantic concepts directly from the speech audio signal. To overcome the lack of data available for this spoken language understanding approach, we investigate the use of a transfer learning…

Computation and Language · Computer Science 2019-06-19 Antoine Caubrière , Natalia Tomashenko , Antoine Laurent , Emmanuel Morin , Nathalie Camelin , Yannick Estève

In task-oriented dialogue systems, spoken language understanding, or SLU, refers to the task of parsing natural language user utterances into semantic frames. Making use of context from prior dialogue history holds the key to more effective…

Computation and Language · Computer Science 2018-07-03 Raghav Gupta , Abhinav Rastogi , Dilek Hakkani-Tur

Human-computer interaction (HCI) is significantly impacted by delayed responses from a spoken dialogue system. Hence, end-to-end (e2e) spoken language understanding (SLU) solutions have recently been proposed to decrease latency. Such…

Computation and Language · Computer Science 2021-06-10 Yiran Cao , Nihal Potdar , Anderson R. Avila

In this paper we examine the use of semantically-aligned speech representations for end-to-end spoken language understanding (SLU). We employ the recently-introduced SAMU-XLSR model, which is designed to generate a single embedding that…

Computation and Language · Computer Science 2022-10-12 Gaëlle Laperrière , Valentin Pelloin , Mickaël Rouvier , Themos Stafylakis , Yannick Estève

Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not…

Computation and Language · Computer Science 2023-06-19 Suwon Shon , Siddhant Arora , Chyi-Jiunn Lin , Ankita Pasad , Felix Wu , Roshan Sharma , Wei-Lun Wu , Hung-Yi Lee , Karen Livescu , Shinji Watanabe

Spoken language understanding (SLU) is a structure prediction task in the field of speech. Recently, many works on SLU that treat it as a sequence-to-sequence task have achieved great success. However, This method is not suitable for…

Sound · Computer Science 2025-01-20 Jiliang Hu , Zuchao Li , Mengjia Shen , Haojun Ai , Sheng Li , Jun Zhang

Spoken Language Understanding (SLU) is a task that aims to extract semantic information from spoken utterances. Previous research has made progress in end-to-end SLU by using paired speech-text data, such as pre-trained Automatic Speech…

Computation and Language · Computer Science 2023-07-11 Guan-Wei Wu , Guan-Ting Lin , Shang-Wen Li , Hung-yi Lee

Collecting sufficient labeled data for spoken language understanding (SLU) is expensive and time-consuming. Recent studies achieved promising results by using pre-trained models in low-resource scenarios. Inspired by this, we aim to ask:…

Computation and Language · Computer Science 2022-11-17 Yifan Peng , Siddhant Arora , Yosuke Higuchi , Yushi Ueda , Sujay Kumar , Karthik Ganesan , Siddharth Dalmia , Xuankai Chang , Shinji Watanabe

Transformer networks and self-supervised pre-training have consistently delivered state-of-art results in the field of natural language processing (NLP); however, their merits in the field of spoken language understanding (SLU) still need…

Computation and Language · Computer Science 2020-11-18 Edmilson Morais , Hong-Kwang J. Kuo , Samuel Thomas , Zoltan Tuske , Brian Kingsbury