中文
相关论文

相关论文: FANS: Fusing ASR and NLU for on-device SLU

200 篇论文

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

计算与语言 · 计算机科学 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language…

计算与语言 · 计算机科学 2022-09-08 Duc Le , Akshat Shrivastava , Paden Tomasello , Suyoun Kim , Aleksandr Livshits , Ozlem Kalinli , Michael L. Seltzer

End-to-end spoken language understanding (SLU) has recently attracted increasing interest. Compared to the conventional tandem-based approach that combines speech recognition and language understanding as separate modules, the new approach…

计算与语言 · 计算机科学 2021-07-20 Nihal Potdar , Anderson R. Avila , Chao Xing , Dong Wang , Yiran Cao , Xiao Chen

Spoken language understanding (SLU) systems are widely used in handling of customer-care calls.A traditional SLU system consists of an acoustic model (AM) and a language model (LM) that areused to decode the utterance and a natural language…

计算与语言 · 计算机科学 2018-10-02 Shahab Jalalvand , Andrej Ljolje , Srinivas Bangalore

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

计算与语言 · 计算机科学 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

Spoken language understanding (SLU) systems extract both text transcripts and semantics associated with intents and slots from input speech utterances. SLU systems usually consist of (1) an automatic speech recognition (ASR) module, (2) an…

计算与语言 · 计算机科学 2022-07-27 Anirudh Raju , Milind Rao , Gautam Tiwari , Pranav Dheram , Bryan Anderson , Zhe Zhang , Chul Lee , Bach Bui , Ariya Rastrow

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Spoken language understanding (SLU), one of the key enabling technologies for human-computer interaction in IoT devices, provides an easy-to-use user interface. Human speech can contain a lot of user-sensitive information, such as gender,…

密码学与安全 · 计算机科学 2024-03-26 Yinggui Wang , Wei Huang , Le Yang

Spoken Language Understanding (SLU) aims to extract structured semantic representations (e.g., slot-value pairs) from speech recognized texts, which suffers from errors of Automatic Speech Recognition (ASR). To alleviate the problem caused…

计算与语言 · 计算机科学 2020-09-08 Chen Liu , Su Zhu , Lu Chen , Kai Yu

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots).…

计算与语言 · 计算机科学 2022-01-13 Xiao Xu , Libo Qin , Kaiji Chen , Guoxing Wu , Linlin Li , Wanxiang Che

Spoken Language Understanding (SLU), a core component of the task-oriented dialogue system, expects a shorter inference latency due to the impatience of humans. Non-autoregressive SLU models clearly increase the inference speed but suffer…

计算与语言 · 计算机科学 2021-08-17 Lizhi Cheng , Weijia Jia , Wenmian Yang

Decoding speaker's intent is a crucial part of spoken language understanding (SLU). The presence of noise or errors in the text transcriptions, in real life scenarios make the task more challenging. In this paper, we address the spoken…

计算与语言 · 计算机科学 2019-10-24 Prashanth Gurunath Shivakumar , Mu Yang , Panayiotis Georgiou

Intent detection and slot filling are two main tasks for building a spoken language understanding(SLU) system. Multiple deep learning based models have demonstrated good results on these tasks . The most effective algorithms are based on…

计算与语言 · 计算机科学 2018-12-27 Yu Wang , Yilin Shen , Hongxia Jin

End-to-end Spoken Language Understanding (SLU) is proposed to infer the semantic meaning directly from audio features without intermediate text representation. Although the acoustic model component of an end-to-end SLU system can be…

音频与语音处理 · 电气工程与系统科学 2019-09-25 Pengwei Wang , Liangchen Wei , Yong Cao , Jinghui Xie , Yuji Cao , Zaiqing Nie

In recent years, developing a speech understanding system that classifies a waveform to structured data, such as intents and slots, without first transcribing the speech to text has emerged as an interesting research problem. This work…

计算机视觉与模式识别 · 计算机科学 2020-11-11 Mohamed Mhiri , Samuel Myer , Vikrant Singh Tomar

We study speech intent classification and slot filling (SICSF) by proposing to use an encoder pretrained on speech recognition (ASR) to initialize an end-to-end (E2E) Conformer-Transformer model, which achieves the new state-of-the-art…

计算与语言 · 计算机科学 2023-07-17 He Huang , Jagadeesh Balam , Boris Ginsburg

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

音频与语音处理 · 电气工程与系统科学 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

In a modern spoken language understanding (SLU) system, the natural language understanding (NLU) module takes interpretations of a speech from the automatic speech recognition (ASR) module as the input. The NLU module usually uses the first…

计算与语言 · 计算机科学 2020-01-16 Mingda Li , Weitong Ruan , Xinyue Liu , Luca Soldaini , Wael Hamza , Chengwei Su

Spoken Language Understanding (SLU) is a task that aims to extract semantic information from spoken utterances. Previous research has made progress in end-to-end SLU by using paired speech-text data, such as pre-trained Automatic Speech…

计算与语言 · 计算机科学 2023-07-11 Guan-Wei Wu , Guan-Ting Lin , Shang-Wen Li , Hung-yi Lee

We present a comprehensive study on building and adapting RNN transducer (RNN-T) models for spoken language understanding(SLU). These end-to-end (E2E) models are constructed in three practical settings: a case where verbatim transcripts are…

计算与语言 · 计算机科学 2021-04-09 Samuel Thomas , Hong-Kwang J. Kuo , George Saon , Zoltán Tüske , Brian Kingsbury , Gakuto Kurata , Zvi Kons , Ron Hoory