English
Related papers

Related papers: Understanding Semantics from Speech Through Pre-tr…

200 papers

We present an end-to-end approach to extract semantic concepts directly from the speech audio signal. To overcome the lack of data available for this spoken language understanding approach, we investigate the use of a transfer learning…

Computation and Language · Computer Science 2019-06-19 Antoine Caubrière , Natalia Tomashenko , Antoine Laurent , Emmanuel Morin , Nathalie Camelin , Yannick Estève

The lack of speech data annotated with labels required for spoken language understanding (SLU) is often a major hurdle in building end-to-end (E2E) systems that can directly process speech inputs. In contrast, large amounts of text data…

Computation and Language · Computer Science 2022-03-02 Samuel Thomas , Hong-Kwang J. Kuo , Brian Kingsbury , George Saon

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

End-to-end models have achieved impressive results on the task of automatic speech recognition (ASR). For low-resource ASR tasks, however, labeled data can hardly satisfy the demand of end-to-end models. Self-supervised acoustic…

Computation and Language · Computer Science 2021-05-12 Cheng Yi , Shiyu Zhou , Bo Xu

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

Computation and Language · Computer Science 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

It is challenging to extract semantic meanings directly from audio signals in spoken language understanding (SLU), due to the lack of textual information. Popular end-to-end (E2E) SLU models utilize sequence-to-sequence automatic speech…

Computation and Language · Computer Science 2023-06-05 Jixuan Wang , Martin Radfar , Kai Wei , Clement Chung

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

Computation and Language · Computer Science 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

This paper addresses the question as to what degree a BERT-based multilingual Spoken Language Understanding (SLU) model can transfer knowledge across languages. Through experiments we will show that, although it works substantially well…

Computation and Language · Computer Science 2020-11-11 Quynh Do , Judith Gaspers , Tobias Roding , Melanie Bradford

Conventional spoken language understanding (SLU) consist of two stages, the first stage maps speech to text by automatic speech recognition (ASR), and the second stage maps text to intent by natural language understanding (NLU). End-to-end…

Multimedia · Computer Science 2021-12-14 Haoran Wei , Fei Tao , Runze Su , Sen Yang , Ji Liu

Spoken language understanding (SLU) systems extract transcriptions, as well as semantics of intent or named entities from speech, and are essential components of voice activated systems. SLU models, which either directly extract semantics…

Computation and Language · Computer Science 2021-02-16 Milind Rao , Pranav Dheram , Gautam Tiwari , Anirudh Raju , Jasha Droppo , Ariya Rastrow , Andreas Stolcke

Recent voice assistants are usually based on the cascade spoken language understanding (SLU) solution, which consists of an automatic speech recognition (ASR) engine and a natural language understanding (NLU) system. Because such approach…

Computation and Language · Computer Science 2023-06-14 Anderson R. Avila , Mehdi Rezagholizadeh , Chao Xing

Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior…

Computation and Language · Computer Science 2020-08-11 Won Ik Cho , Donghyun Kwak , Ji Won Yoon , Nam Soo Kim

Spoken language understanding (SLU) tasks involve mapping from speech audio signals to semantic labels. Given the complexity of such tasks, good performance might be expected to require large labeled datasets, which are difficult to collect…

Computation and Language · Computer Science 2022-07-12 Ankita Pasad , Felix Wu , Suwon Shon , Karen Livescu , Kyu J. Han

Spoken language understanding is typically based on pipeline architectures including speech recognition and natural language understanding steps. These components are optimized independently to allow usage of available data, but the overall…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Pavel Denisov , Ngoc Thang Vu

Pre-trained Language Model (PLM) has become a representative foundation model in the natural language processing field. Most PLMs are trained with linguistic-agnostic pre-training tasks on the surface form of the text, such as the masked…

Computation and Language · Computer Science 2022-11-11 Yiming Cui , Wanxiang Che , Shijin Wang , Ting Liu

Spoken language understanding (SLU) is a structure prediction task in the field of speech. Recently, many works on SLU that treat it as a sequence-to-sequence task have achieved great success. However, This method is not suitable for…

Sound · Computer Science 2025-01-20 Jiliang Hu , Zuchao Li , Mengjia Shen , Haojun Ai , Sheng Li , Jun Zhang

Spoken Language Understanding (SLU) is a core task in most human-machine interaction systems. With the emergence of smart homes, smart phones and smart speakers, SLU has become a key technology for the industry. In a classical SLU approach,…

Computation and Language · Computer Science 2022-07-19 Thierry Desot , François Portet , Michel Vacher

The goal of spoken language understanding (SLU) systems is to determine the meaning of the input speech signal, unlike speech recognition which aims to produce verbatim transcripts. Advances in end-to-end (E2E) speech modeling have made it…

Computation and Language · Computer Science 2022-01-31 Hong-Kwang J. Kuo , Zoltan Tuske , Samuel Thomas , Brian Kingsbury , George Saon

End-to-end Spoken Language Understanding (SLU) models are made increasingly large and complex to achieve the state-ofthe-art accuracy. However, the increased complexity of a model can also introduce high risk of over-fitting, which is a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Xueli Jia , Jianzong Wang , Zhiyong Zhang , Ning Cheng , Jing Xiao

Spoken Language Understanding (SLU) converts hypotheses from automatic speech recognizer (ASR) into structured semantic representations. ASR recognition errors can severely degenerate the performance of the subsequent SLU module. To address…

Computation and Language · Computer Science 2020-09-09 Chen Liu , Su Zhu , Zijian Zhao , Ruisheng Cao , Lu Chen , Kai Yu