English
Related papers

Related papers: Improving End-to-End Models for Set Prediction in …

200 papers

An essential component of spoken language understanding (SLU) is slot filling: representing the meaning of a spoken utterance using semantic entity labels. In this paper, we develop end-to-end (E2E) spoken language understanding systems…

End-to-end (E2E) spoken language understanding (SLU) systems predict utterance semantics directly from speech using a single model. Previous work in this area has focused on targeted tasks in fixed domains, where the output semantic…

Computation and Language · Computer Science 2021-10-08 Michael Saxon , Samridhi Choudhary , Joseph P. McKenna , Athanasios Mouchtaris

This work investigates spoken language understanding (SLU) systems in the scenario when the semantic information is extracted directly from the speech signal by means of a single end-to-end neural network model. Two SLU tasks are…

Computation and Language · Computer Science 2019-10-29 Natalia Tomashenko , Antoine Caubriere , Yannick Esteve , Antoine Laurent , Emmanuel Morin

End-to-end (E2E) spoken language understanding (SLU) can infer semantics directly from speech signal without cascading an automatic speech recognizer (ASR) with a natural language understanding (NLU) module. However, paired utterance…

Computation and Language · Computer Science 2021-02-15 Yao Qian , Ximo Bian , Yu Shi , Naoyuki Kanda , Leo Shen , Zhen Xiao , Michael Zeng

We present a comprehensive study on building and adapting RNN transducer (RNN-T) models for spoken language understanding(SLU). These end-to-end (E2E) models are constructed in three practical settings: a case where verbatim transcripts are…

Computation and Language · Computer Science 2021-04-09 Samuel Thomas , Hong-Kwang J. Kuo , George Saon , Zoltán Tüske , Brian Kingsbury , Gakuto Kurata , Zvi Kons , Ron Hoory

Spoken language understanding (SLU) refers to the process of inferring the semantic information from audio signals. While the neural transformers consistently deliver the best performance among the state-of-the-art neural architectures in…

Computation and Language · Computer Science 2020-08-26 Martin Radfar , Athanasios Mouchtaris , Siegfried Kunzmann

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

In this paper, we propose to improve end-to-end (E2E) spoken language understand (SLU) in an RNN transducer model (RNN-T) by incorporating a joint self-conditioned CTC automatic speech recognition (ASR) objective. Our proposed model is akin…

Machine Learning · Computer Science 2025-01-06 Vishal Sunder , Eric Fosler-Lussier

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

End-to-end (E2E) spoken language understanding (SLU) systems that generate a semantic parse from speech have become more promising recently. This approach uses a single model that utilizes audio and text representations from pre-trained…

Computation and Language · Computer Science 2023-07-25 Suyoun Kim , Akshat Shrivastava , Duc Le , Ju Lin , Ozlem Kalinli , Michael L. Seltzer

End-to-end (E2E) spoken language understanding (SLU) systems avoid an intermediate textual representation by mapping speech directly into intents with slot values. This approach requires considerable domain-specific training data. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Pu Wang , Bagher BabaAli , Hugo Van hamme

End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, these systems model sequence labeling as a sequence prediction…

Computation and Language · Computer Science 2022-10-31 Siddhant Arora , Siddharth Dalmia , Brian Yan , Florian Metze , Alan W Black , Shinji Watanabe

Spoken Language Understanding (SLU) is a core task in most human-machine interaction systems. With the emergence of smart homes, smart phones and smart speakers, SLU has become a key technology for the industry. In a classical SLU approach,…

Computation and Language · Computer Science 2022-07-19 Thierry Desot , François Portet , Michel Vacher

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

Computation and Language · Computer Science 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language…

Computation and Language · Computer Science 2022-09-08 Duc Le , Akshat Shrivastava , Paden Tomasello , Suyoun Kim , Aleksandr Livshits , Ozlem Kalinli , Michael L. Seltzer

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

Recent advances in End-to-End (E2E) Spoken Language Understanding (SLU) have been primarily due to effective pretraining of speech representations. One such pretraining paradigm is the distillation of semantic knowledge from…

Computation and Language · Computer Science 2022-07-04 Vishal Sunder , Eric Fosler-Lussier , Samuel Thomas , Hong-Kwang J. Kuo , Brian Kingsbury

Human-computer interaction (HCI) is significantly impacted by delayed responses from a spoken dialogue system. Hence, end-to-end (e2e) spoken language understanding (SLU) solutions have recently been proposed to decrease latency. Such…

Computation and Language · Computer Science 2021-06-10 Yiran Cao , Nihal Potdar , Anderson R. Avila

Spoken Language Understanding (SLU) is the problem of extracting the meaning from speech utterances. It is typically addressed as a two-step problem, where an Automatic Speech Recognition (ASR) model is employed to convert speech into text,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Elisavet Palogiannidi , Ioannis Gkinis , George Mastrapas , Petr Mizera , Themos Stafylakis
‹ Prev 1 2 3 10 Next ›