English
Related papers

Related papers: End-to-End Neural Transformer Based Spoken Languag…

200 papers

SLU combines ASR and NLU capabilities to accomplish speech-to-intent understanding. In this paper, we compare different ways to combine ASR and NLU, in particular using a single Conformer model with different ways to use its components, to…

Computation and Language · Computer Science 2022-04-11 Nick J. C. Wang , Shaojun Wang , Jing Xiao

A number of methods have been proposed for End-to-End Spoken Language Understanding (E2E-SLU) using pretrained models, however their evaluation often lacks multilingual setup and tasks that require prediction of lexical fillers, such as…

Computation and Language · Computer Science 2023-10-11 Pavel Denisov , Ngoc Thang Vu

In this paper, we propose to improve end-to-end (E2E) spoken language understand (SLU) in an RNN transducer model (RNN-T) by incorporating a joint self-conditioned CTC automatic speech recognition (ASR) objective. Our proposed model is akin…

Machine Learning · Computer Science 2025-01-06 Vishal Sunder , Eric Fosler-Lussier

Spoken language understanding, which extracts intents and/or semantic concepts in utterances, is conventionally formulated as a post-processing of automatic speech recognition. It is usually trained with oracle transcripts, but needs to…

Sound · Computer Science 2020-07-30 Viet-Trung Dang , Tianyu Zhao , Sei Ueno , Hirofumi Inaguma , Tatsuya Kawahara

When a human communicates with a machine using natural language on the web and online, how can it understand the human's intention and semantic context of their talk? This is an important AI task as it enables the machine to construct a…

Computation and Language · Computer Science 2022-12-22 Soyeon Caren Han , Siqu Long , Henry Weld , Josiah Poon

Multi-intent spoken language understanding (SLU) involves two tasks: multiple intent detection and slot filling, which jointly handle utterances containing more than one intent. Owing to this characteristic, which closely reflects…

Computation and Language · Computer Science 2025-12-15 Di Wu , Ruiyu Fang , Liting Jiang , Shuangyong Song , Xiaomeng Huang , Shiquan Wang , Zhongqiu Li , Lingling Shi , Mengjiao Bao , Yongxiang Li , Hao Huang

This work investigates the embeddings for representing dialog history in spoken language understanding (SLU) systems. We focus on the scenario when the semantic information is extracted directly from the speech signal by means of a single…

Computation and Language · Computer Science 2020-05-04 Natalia Tomashenko , Christian Raymond , Antoine Caubriere , Renato De Mori , Yannick Esteve

Natural language understanding (NLU) in the context of goal-oriented dialog systems typically includes intent classification and slot labeling tasks. Existing methods to expand an NLU system to new languages use machine translation with…

Computation and Language · Computer Science 2020-10-09 Weijia Xu , Batool Haider , Saab Mansour

Zero-shot spoken language understanding (SLU) enables systems to comprehend user utterances in new domains without prior exposure to training data. Recent studies often rely on large language models (LLMs), leading to excessive footprints…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Mohan Li , Simon Keizer , Rama Doddipatla

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

Computation and Language · Computer Science 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

Spoken language understanding (SLU) is a core task in task-oriented dialogue systems, which aims at understanding the user's current goal through constructing semantic frames. SLU usually consists of two subtasks, including intent detection…

Computation and Language · Computer Science 2024-06-03 Xuxin Cheng , Wanshi Xu , Zhihong Zhu , Hongxiang Li , Yuexian Zou

We explore options to use Transformer networks in neural transducer for end-to-end speech recognition. Transformer networks use self-attention for sequence modeling and comes with advantages in parallel computation and capturing contexts.…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-30 Ching-Feng Yeh , Jay Mahadeokar , Kaustubh Kalgaonkar , Yongqiang Wang , Duc Le , Mahaveer Jain , Kjell Schubert , Christian Fuegen , Michael L. Seltzer

Spoken Language Understanding (SLU) is a core component of conversational systems, enabling machines to interpret user utterances. Despite its importance, developing effective SLU systems remains challenging due to the scarcity of labeled…

Computation and Language · Computer Science 2026-02-12 Yan Xie , Yibo Cui , Liang Xie , Erwei Yin

In a modern spoken language understanding (SLU) system, the natural language understanding (NLU) module takes interpretations of a speech from the automatic speech recognition (ASR) module as the input. The NLU module usually uses the first…

Computation and Language · Computer Science 2020-01-16 Mingda Li , Weitong Ruan , Xinyue Liu , Luca Soldaini , Wael Hamza , Chengwei Su

Joint intent detection and slot filling, which is also termed as joint NLU (Natural Language Understanding) is invaluable for smart voice assistants. Recent advancements in this area have been heavily focusing on improving accuracy using…

Machine Learning · Computer Science 2023-09-27 Kalpa Gunaratna , Vijay Srinivasan , Hongxia Jin

Multi-Intent Spoken Language Understanding (SLU), a novel and more complex scenario of SLU, is attracting increasing attention. Unlike traditional SLU, each intent in this scenario has its specific scope. Semantic information outside the…

Computation and Language · Computer Science 2022-11-23 Lizhi Cheng , Wenmian Yang , Weijia Jia

Learning intents and slot labels from user utterances is a fundamental step in all spoken language understanding (SLU) and dialog systems. State-of-the-art neural network based methods, after deployment, often suffer from performance…

Computation and Language · Computer Science 2018-09-19 Avik Ray , Yilin Shen , Hongxia Jin

Spoken Language Understanding (SLU) is one of the core components of a task-oriented dialogue system, which aims to extract the semantic meaning of user queries (e.g., intents and slots). In this work, we introduce OpenSLU, an open-source…

Computation and Language · Computer Science 2023-05-18 Libo Qin , Qiguang Chen , Xiao Xu , Yunlong Feng , Wanxiang Che

Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, recurrent neural networks (RNNs) based methods achieved the…

Computation and Language · Computer Science 2020-09-29 Peilin Zhou , Zhiqi Huang , Fenglin Liu , Yuexian Zou

Spoken language understanding (SLU) systems are widely used in handling of customer-care calls.A traditional SLU system consists of an acoustic model (AM) and a language model (LM) that areused to decode the utterance and a natural language…

Computation and Language · Computer Science 2018-10-02 Shahab Jalalvand , Andrej Ljolje , Srinivas Bangalore