English
Related papers

Related papers: A Streaming End-to-End Framework For Spoken Langua…

200 papers

SLU combines ASR and NLU capabilities to accomplish speech-to-intent understanding. In this paper, we compare different ways to combine ASR and NLU, in particular using a single Conformer model with different ways to use its components, to…

Computation and Language · Computer Science 2022-04-11 Nick J. C. Wang , Shaojun Wang , Jing Xiao

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots).…

Computation and Language · Computer Science 2022-01-13 Xiao Xu , Libo Qin , Kaiji Chen , Guoxing Wu , Linlin Li , Wanxiang Che

We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language…

Computation and Language · Computer Science 2022-09-08 Duc Le , Akshat Shrivastava , Paden Tomasello , Suyoun Kim , Aleksandr Livshits , Ozlem Kalinli , Michael L. Seltzer

Spoken Language Understanding (SLU) is a task that aims to extract semantic information from spoken utterances. Previous research has made progress in end-to-end SLU by using paired speech-text data, such as pre-trained Automatic Speech…

Computation and Language · Computer Science 2023-07-11 Guan-Wei Wu , Guan-Ting Lin , Shang-Wen Li , Hung-yi Lee

Improving the effectiveness of human-robot interaction requires social robots to accurately infer human goals through robust intention understanding. This challenge is particularly critical in multimodal settings, where agents must…

Human-Computer Interaction · Computer Science 2026-04-28 Hamed Rahimi , Clemence Grislain , Adrien Jacquet Cretides , Olivier Sigaud , Mohamed Chetouani

Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior…

Computation and Language · Computer Science 2020-08-11 Won Ik Cho , Donghyun Kwak , Ji Won Yoon , Nam Soo Kim

Intent Recognition and Slot Identification are crucial components in spoken language understanding (SLU) systems. In this paper, we present a novel approach towards both these tasks in the context of low resourced and unwritten languages.…

Computation and Language · Computer Science 2021-09-29 Akshat Gupta , Olivia Deng , Akruti Kushwaha , Saloni Mittal , William Zeng , Sai Krishna Rallabandi , Alan W Black

Spoken Language Understanding (SLU) is a core task in most human-machine interaction systems. With the emergence of smart homes, smart phones and smart speakers, SLU has become a key technology for the industry. In a classical SLU approach,…

Computation and Language · Computer Science 2022-07-19 Thierry Desot , François Portet , Michel Vacher

An essential component of spoken language understanding (SLU) is slot filling: representing the meaning of a spoken utterance using semantic entity labels. In this paper, we develop end-to-end (E2E) spoken language understanding systems…

In this paper, we perform an exhaustive evaluation of different representations to address the intent classification problem in a Spoken Language Understanding (SLU) setup. We benchmark three types of systems to perform the SLU intent…

Natural language understanding and dialogue policy learning are both essential in conversational systems that predict the next system actions in response to a current user utterance. Conventional approaches aggregate separate models of…

Computation and Language · Computer Science 2017-10-03 Xuesong Yang , Yun-Nung Chen , Dilek Hakkani-Tur , Paul Crook , Xiujun Li , Jianfeng Gao , Li Deng

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

Spoken language understanding (SLU), one of the key enabling technologies for human-computer interaction in IoT devices, provides an easy-to-use user interface. Human speech can contain a lot of user-sensitive information, such as gender,…

Cryptography and Security · Computer Science 2024-03-26 Yinggui Wang , Wei Huang , Le Yang

Streaming end-to-end multi-talker speech recognition aims at transcribing the overlapped speech from conversations or meetings with an all-neural model in a streaming fashion, which is fundamentally different from a modular-based approach…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-26 Liang Lu , Jinyu Li , Yifan Gong

Spoken Language Understanding (SLU), which aims to extract user semantics to execute downstream tasks, is a crucial component of task-oriented dialog systems. Existing SLU datasets generally lack sufficient diversity and complexity, and…

Computation and Language · Computer Science 2025-12-02 Yuezhang Peng , Chonghao Cai , Ziang Liu , Shuai Fan , Sheng Jiang , Hua Xu , Yuxin Liu , Qiguang Chen , Kele Xu , Yao Li , Sheng Wang , Libo Qin , Xie Chen

Comprehending the overall intent of an utterance helps a listener recognize the individual words spoken. Inspired by this fact, we perform a novel study of the impact of explicitly incorporating intent representations as additional…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-22 Swayambhu Nath Ray , Minhua Wu , Anirudh Raju , Pegah Ghahremani , Raghavendra Bilgi , Milind Rao , Harish Arsikere , Ariya Rastrow , Andreas Stolcke , Jasha Droppo

Any organization needs to improve their products, services, and processes. In this context, engaging with customers and understanding their journey is essential. Organizations have leveraged various techniques and technologies to support…

Computation and Language · Computer Science 2022-12-08 Sahar Moradizeyveh

Spoken language understanding (SLU), which is a core component of the task-oriented dialogue system, has made substantial progress in the research of single-turn dialogue. However, the performance in multi-turn dialogue is still not…

Computation and Language · Computer Science 2021-03-11 Lizhi Cheng , Weijia Jia , Wenmian Yang

End-to-end multi-talker speech recognition is an emerging research trend in the speech community due to its vast potential in applications such as conversation and meeting transcriptions. To the best of our knowledge, all existing research…

Sound · Computer Science 2021-05-12 Liang Lu , Naoyuki Kanda , Jinyu Li , Yifan Gong

In the constant updates of the product dialogue systems, we need to retrain the natural language understanding (NLU) model as new data from the real users would be merged into the existent data accumulated in the last updates. Within the…

Computation and Language · Computer Science 2023-05-25 Zefan Cai , Xin Zheng , Tianyu Liu , Xu Wang , Haoran Meng , Jiaqi Han , Gang Yuan , Binghuai Lin , Baobao Chang , Yunbo Cao