中文
相关论文

相关论文: FANS: Fusing ASR and NLU for on-device SLU

200 篇论文

End-to-end (E2E) spoken language understanding (SLU) systems that generate a semantic parse from speech have become more promising recently. This approach uses a single model that utilizes audio and text representations from pre-trained…

计算与语言 · 计算机科学 2023-07-25 Suyoun Kim , Akshat Shrivastava , Duc Le , Ju Lin , Ozlem Kalinli , Michael L. Seltzer

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

计算与语言 · 计算机科学 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

End-to-end (E2E) spoken language understanding (SLU) systems predict utterance semantics directly from speech using a single model. Previous work in this area has focused on targeted tasks in fixed domains, where the output semantic…

计算与语言 · 计算机科学 2021-10-08 Michael Saxon , Samridhi Choudhary , Joseph P. McKenna , Athanasios Mouchtaris

End-to-end (E2E) spoken language understanding (SLU) systems avoid an intermediate textual representation by mapping speech directly into intents with slot values. This approach requires considerable domain-specific training data. In…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Pu Wang , Bagher BabaAli , Hugo Van hamme

Spoken language understanding (SLU) is a task aiming to extract high-level semantics from spoken utterances. Previous works have investigated the use of speech self-supervised models and textual pre-trained models, which have shown…

计算与语言 · 计算机科学 2022-11-08 Jiatong Shi , Chan-Jan Hsu , Holam Chung , Dongji Gao , Paola Garcia , Shinji Watanabe , Ann Lee , Hung-yi Lee

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

Spoken dialogue systems such as Siri and Alexa provide great convenience to people's everyday life. However, current spoken language understanding (SLU) pipelines largely depend on automatic speech recognition (ASR) modules, which require a…

计算与语言 · 计算机科学 2021-07-02 Zhiyuan Guo , Yuexin Li , Guo Chen , Xingyu Chen , Akshat Gupta

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

计算与语言 · 计算机科学 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

Multi-intent spoken language understanding (SLU) involves two tasks: multiple intent detection and slot filling, which jointly handle utterances containing more than one intent. Owing to this characteristic, which closely reflects…

Intent and Slot Identification are two important tasks in Spoken Language Understanding (SLU). For a natural language utterance, there is a high correlation between these two tasks. A lot of work has been done on each of these using…

计算与语言 · 计算机科学 2020-03-23 Anmol Bhasin , Bharatram Natarajan , Gaurav Mathur , Himanshu Mangla

In this paper, we propose to improve end-to-end (E2E) spoken language understand (SLU) in an RNN transducer model (RNN-T) by incorporating a joint self-conditioned CTC automatic speech recognition (ASR) objective. Our proposed model is akin…

机器学习 · 计算机科学 2025-01-06 Vishal Sunder , Eric Fosler-Lussier

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

计算与语言 · 计算机科学 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior…

计算与语言 · 计算机科学 2020-08-11 Won Ik Cho , Donghyun Kwak , Ji Won Yoon , Nam Soo Kim

Spoken language understanding (SLU) is indispensable for half of all living languages that lack a formal writing system. Unlike for high-resource languages, for these languages, we cannot offload semantic understanding of speech to the…

计算与语言 · 计算机科学 2025-08-15 Fabian David Schmidt , Ivan Vulić , Goran Glavaš , David Ifeoluwa Adelani

Speaker intent detection and semantic slot filling are two critical tasks in spoken language understanding (SLU) for dialogue systems. In this paper, we describe a recurrent neural network (RNN) model that jointly performs intent detection,…

计算与语言 · 计算机科学 2016-09-07 Bing Liu , Ian Lane

Spoken Language Understanding (SLU) converts hypotheses from automatic speech recognizer (ASR) into structured semantic representations. ASR recognition errors can severely degenerate the performance of the subsequent SLU module. To address…

计算与语言 · 计算机科学 2020-09-09 Chen Liu , Su Zhu , Zijian Zhao , Ruisheng Cao , Lu Chen , Kai Yu

Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic…

计算与语言 · 计算机科学 2022-10-12 Sahar Ghannay , Antoine Caubrière , Salima Mdhaffar , Gaëlle Laperrière , Bassam Jabaian , Yannick Estève

Deep learning is at the core of recent spoken language understanding (SLU) related tasks. More precisely, deep neural networks (DNNs) drastically increased the performances of SLU systems, and numerous architectures have been proposed. In…

计算与语言 · 计算机科学 2019-05-07 Titouan Parcollet , Mohamed Morchid , Xavier Bost , Georges Linarès

A spoken language understanding (SLU) system includes two main tasks, slot filling (SF) and intent detection (ID). The joint model for the two tasks is becoming a tendency in SLU. But the bi-directional interrelated connections between the…

计算与语言 · 计算机科学 2019-07-02 Haihong E , Peiqing Niu , Zhongfu Chen , Meina Song

Natural Language Understanding (NLU) is important in today's technology as it enables machines to comprehend and process human language, leading to improved human-computer interactions and advancements in fields such as virtual assistants,…