English
Related papers

Related papers: Large-scale Transfer Learning for Low-resource Spo…

200 papers

Spoken language understanding (SLU) is a key component of task-oriented dialogue systems. SLU parses natural language user utterances into semantic frames. Previous work has shown that incorporating context information significantly…

Computation and Language · Computer Science 2020-03-04 Qian Chen , Zhu Zhuo , Wen Wang , Qiuyun Xu

End-to-end spoken language understanding (SLU) systems benefit from pretraining on large corpora, followed by fine-tuning on application-specific data. The resulting models are too large for on-edge applications. For instance, BERT-based…

Computation and Language · Computer Science 2022-06-30 Pu Wang , Hugo Van hamme

Neural models have yielded state-of-the-art results in deciphering spoken language understanding (SLU) problems; however, these models require a significant amount of domain-specific labeled examples for training, which is prohibitively…

Computation and Language · Computer Science 2020-10-12 Jin Cao , Jun Wang , Wael Hamza , Kelly Vanee , Shang-Wen Li

Nowadays, training end-to-end neural models for spoken language translation (SLT) still has to confront with extreme data scarcity conditions. The existing SLT parallel corpora are indeed orders of magnitude smaller than those available for…

Computation and Language · Computer Science 2019-10-09 Mattia Antonino Di Gangi , Matteo Negri , Marco Turchi

Natural language understanding (NLU) is the task of semantic decoding of human languages by machines. NLU models rely heavily on large training data to ensure good performance. However, substantial languages and domains have very few data…

Computation and Language · Computer Science 2022-08-22 Zihan Liu

Spoken language understanding (SLU) refers to the process of inferring the semantic information from audio signals. While the neural transformers consistently deliver the best performance among the state-of-the-art neural architectures in…

Computation and Language · Computer Science 2020-08-26 Martin Radfar , Athanasios Mouchtaris , Siegfried Kunzmann

SLU combines ASR and NLU capabilities to accomplish speech-to-intent understanding. In this paper, we compare different ways to combine ASR and NLU, in particular using a single Conformer model with different ways to use its components, to…

Computation and Language · Computer Science 2022-04-11 Nick J. C. Wang , Shaojun Wang , Jing Xiao

Typically, spoken language understanding (SLU) models are trained on annotated data which are costly to gather. Aiming to reduce data needs for bootstrapping a SLU system for a new language, we present a simple but effective weight transfer…

Computation and Language · Computer Science 2019-04-04 Quynh Ngoc Thi Do , Judith Gaspers

The goal of spoken language understanding (SLU) systems is to determine the meaning of the input speech signal, unlike speech recognition which aims to produce verbatim transcripts. Advances in end-to-end (E2E) speech modeling have made it…

Computation and Language · Computer Science 2022-01-31 Hong-Kwang J. Kuo , Zoltan Tuske , Samuel Thomas , Brian Kingsbury , George Saon

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

Self-Supervised Learning is vastly used to efficiently represent speech for Spoken Language Understanding, gradually replacing conventional approaches. Meanwhile, textual SSL models are proposed to encode language-agnostic semantics.…

Computation and Language · Computer Science 2024-06-19 Gaëlle Laperrière , Sahar Ghannay , Bassam Jabaian , Yannick Estève

End-to-end spoken language understanding (SLU) remains elusive even with current large pretrained language models on text and speech, especially in multilingual cases. Machine translation has been established as a powerful pretraining…

Computation and Language · Computer Science 2023-10-18 Mutian He , Philip N. Garner

Despite the fact that data imbalance is becoming more and more common in real-world Spoken Language Understanding (SLU) applications, it has not been studied extensively in the literature. To the best of our knowledge, this paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Judith Gaspers , Quynh Do , Fabian Triefenbach

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

Spoken language understanding (SLU) systems can make life more agreeable, safer (e.g. in a car) or can increase the independence of physically challenged users. However, due to the many sources of variation in speech, a well-trained system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Pu Wang , Hugo Van hamme

This work investigates spoken language understanding (SLU) systems in the scenario when the semantic information is extracted directly from the speech signal by means of a single end-to-end neural network model. Two SLU tasks are…

Computation and Language · Computer Science 2019-10-29 Natalia Tomashenko , Antoine Caubriere , Yannick Esteve , Antoine Laurent , Emmanuel Morin

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

Computation and Language · Computer Science 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

Spoken Language Understanding (SLU) models are a core component of voice assistants (VA), such as Alexa, Bixby, and Google Assistant. In this paper, we introduce a pipeline designed to extend SLU systems to new languages, utilizing Large…

Computation and Language · Computer Science 2024-04-04 Jakub Hoscilowicz , Pawel Pawlowski , Marcin Skorupa , Marcin Sowański , Artur Janicki

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Spoken Language Understanding (SLU) is the problem of extracting the meaning from speech utterances. It is typically addressed as a two-step problem, where an Automatic Speech Recognition (ASR) model is employed to convert speech into text,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Elisavet Palogiannidi , Ioannis Gkinis , George Mastrapas , Petr Mizera , Themos Stafylakis
‹ Prev 1 2 3 10 Next ›