English
Related papers

Related papers: FANS: Fusing ASR and NLU for on-device SLU

200 papers

In contrast to conventional pipeline Spoken Language Understanding (SLU) which consists of automatic speech recognition (ASR) and natural language understanding (NLU), end-to-end SLU infers the semantic meaning directly from speech and…

Computation and Language · Computer Science 2021-05-12 Pengwei Wang , Xin Ye , Xiaohuan Zhou , Jinghui Xie , Hao Wang

Conventional spoken language understanding (SLU) consist of two stages, the first stage maps speech to text by automatic speech recognition (ASR), and the second stage maps text to intent by natural language understanding (NLU). End-to-end…

Multimedia · Computer Science 2021-12-14 Haoran Wei , Fei Tao , Runze Su , Sen Yang , Ji Liu

Spoken Language Understanding (SLU) is a core task in most human-machine interaction systems. With the emergence of smart homes, smart phones and smart speakers, SLU has become a key technology for the industry. In a classical SLU approach,…

Computation and Language · Computer Science 2022-07-19 Thierry Desot , François Portet , Michel Vacher

There has been an increased interest in the integration of pretrained speech recognition (ASR) and language models (LM) into the SLU framework. However, prior methods often struggle with a vocabulary mismatch between pretrained models, and…

Computation and Language · Computer Science 2023-07-21 Siddhant Arora , Hayato Futami , Yosuke Kashiwagi , Emiru Tsunoo , Brian Yan , Shinji Watanabe

Conventional conversation assistants extract text transcripts from the speech signal using automatic speech recognition (ASR) and then predict intent from the transcriptions. Using end-to-end spoken language understanding (SLU), the intents…

Computation and Language · Computer Science 2022-12-27 Shangeth Rajaa , Swaraj Dalmia , Kumarmanas Nethil

Accurate prediction of the user intent to interact with a voice assistant (VA) on a device (e.g. on the phone) is critical for achieving naturalistic, engaging, and privacy-centric interactions with the VA. To this end, we present a novel…

Computation and Language · Computer Science 2022-10-24 Pranay Dighe , Prateeth Nayak , Oggi Rudovic , Erik Marchi , Xiaochuan Niu , Ahmed Tewfik

The goal of spoken language understanding (SLU) systems is to determine the meaning of the input speech signal, unlike speech recognition which aims to produce verbatim transcripts. Advances in end-to-end (E2E) speech modeling have made it…

Computation and Language · Computer Science 2022-01-31 Hong-Kwang J. Kuo , Zoltan Tuske , Samuel Thomas , Brian Kingsbury , George Saon

Much recent work on Spoken Language Understanding (SLU) falls short in at least one of three ways: models were trained on oracle text input and neglected the Automatics Speech Recognition (ASR) outputs, models were trained to predict only…

Computation and Language · Computer Science 2020-11-13 Cheng-I Lai , Jin Cao , Sravan Bodapati , Shang-Wen Li

Spoken language understanding (SLU) is a structure prediction task in the field of speech. Recently, many works on SLU that treat it as a sequence-to-sequence task have achieved great success. However, This method is not suitable for…

Sound · Computer Science 2025-01-20 Jiliang Hu , Zuchao Li , Mengjia Shen , Haojun Ai , Sheng Li , Jun Zhang

Recent voice assistants are usually based on the cascade spoken language understanding (SLU) solution, which consists of an automatic speech recognition (ASR) engine and a natural language understanding (NLU) system. Because such approach…

Computation and Language · Computer Science 2023-06-14 Anderson R. Avila , Mehdi Rezagholizadeh , Chao Xing

Spoken language understanding (SLU) systems extract transcriptions, as well as semantics of intent or named entities from speech, and are essential components of voice activated systems. SLU models, which either directly extract semantics…

Computation and Language · Computer Science 2021-02-16 Milind Rao , Pranav Dheram , Gautam Tiwari , Anirudh Raju , Jasha Droppo , Ariya Rastrow , Andreas Stolcke

End-to-end spoken language understanding (SLU) remains elusive even with current large pretrained language models on text and speech, especially in multilingual cases. Machine translation has been established as a powerful pretraining…

Computation and Language · Computer Science 2023-10-18 Mutian He , Philip N. Garner

Spoken Language Understanding (SLU) consists of two sub-tasks: intent detection (ID) and slot filling (SF). Given its broad range of real-world applications, enhancing SLU for practical deployment is increasingly critical. Profile-based SLU…

Artificial Intelligence · Computer Science 2025-11-25 Di Wu , Liting Jiang , Ruiyu Fang , Bianjing , Hongyan Xie , Haoxiang Su , Hao Huang , Zhongjiang He , Shuangyong Song , Xuelong Li

Building Spoken Language Understanding (SLU) robust to Automatic Speech Recognition (ASR) errors is an essential issue for various voice-enabled virtual assistants. Considering that most ASR errors are caused by phonetic confusion between…

Computation and Language · Computer Science 2022-03-24 Zexun Wang , Yuquan Le , Yi Zhu , Yuming Zhao , Mingchao Feng , Meng Chen , Xiaodong He

Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based model. Recent advances in self-supervised representation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-01 Lasse Borgholt , Jakob Drachmann Havtorn , Mostafa Abdou , Joakim Edin , Lars Maaløe , Anders Søgaard , Christian Igel

This paper addresses the problem of automatic speech recognition (ASR) error detection and their use for improving spoken language understanding (SLU) systems. In this study, the SLU task consists in automatically extracting, from ASR…

Computation and Language · Computer Science 2017-05-29 Edwin Simonnet , Sahar Ghannay , Nathalie Camelin , Yannick Estève , Renato De Mori

Joint intent detection and slot filling, which is also termed as joint NLU (Natural Language Understanding) is invaluable for smart voice assistants. Recent advancements in this area have been heavily focusing on improving accuracy using…

Machine Learning · Computer Science 2023-09-27 Kalpa Gunaratna , Vijay Srinivasan , Hongxia Jin

In spoken language understanding (SLU), what the user says is converted to his/her intent. Recent work on end-to-end SLU has shown that accuracy can be improved via pre-training approaches. We revisit ideas presented by Lugosch et al. using…

Computation and Language · Computer Science 2022-04-08 Nick J. C. Wang , Lu Wang , Yandan Sun , Haimei Kang , Dejun Zhang

We propose a novel Transformer encoder-based architecture with syntactical knowledge encoded for intent detection and slot filling. Specifically, we encode syntactic knowledge into the Transformer encoder by jointly training it to predict…

Artificial Intelligence · Computer Science 2020-12-23 Jixuan Wang , Kai Wei , Martin Radfar , Weiwei Zhang , Clement Chung

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

Computation and Language · Computer Science 2022-05-26 Akshat Gupta