English
Related papers

Related papers: Multimodal Audio-textual Architecture for Robust S…

200 papers

Language understanding in speech-based systems have attracted much attention in recent years with the growing demand for voice interface applications. However, the robustness of natural language understanding (NLU) systems to errors…

Computation and Language · Computer Science 2022-03-17 Lingyun Feng , Jianwei Yu , Deng Cai , Songxiang Liu , Haitao Zheng , Yan Wang

In a modern spoken language understanding (SLU) system, the natural language understanding (NLU) module takes interpretations of a speech from the automatic speech recognition (ASR) module as the input. The NLU module usually uses the first…

Computation and Language · Computer Science 2020-01-16 Mingda Li , Weitong Ruan , Xinyue Liu , Luca Soldaini , Wael Hamza , Chengwei Su

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

In the realm of spoken language understanding (SLU), numerous natural language understanding (NLU) methodologies have been adapted by supplying large language models (LLMs) with transcribed speech instead of conventional written text. In…

Building Spoken Language Understanding (SLU) robust to Automatic Speech Recognition (ASR) errors is an essential issue for various voice-enabled virtual assistants. Considering that most ASR errors are caused by phonetic confusion between…

Computation and Language · Computer Science 2022-03-24 Zexun Wang , Yuquan Le , Yi Zhu , Yuming Zhao , Mingchao Feng , Meng Chen , Xiaodong He

Spoken Language Understanding (SLU) systems parse speech into semantic structures like dialog acts and slots. This involves the use of an Automatic Speech Recognizer (ASR) to transcribe speech into multiple text alternatives (hypotheses).…

Computation and Language · Computer Science 2021-06-14 Karthik Ganesan , Pakhi Bamdev , Jaivarsan B , Amresh Venugopal , Abhinav Tushar

We consider the problem of spoken language understanding (SLU) of extracting natural language intents and associated slot arguments or named entities from speech that is primarily directed at voice assistants. Such a system subsumes both…

Computation and Language · Computer Science 2021-02-16 Milind Rao , Anirudh Raju , Pranav Dheram , Bach Bui , Ariya Rastrow

Spoken Language Understanding (SLU) aims to extract structured semantic representations (e.g., slot-value pairs) from speech recognized texts, which suffers from errors of Automatic Speech Recognition (ASR). To alleviate the problem caused…

Computation and Language · Computer Science 2020-09-08 Chen Liu , Su Zhu , Lu Chen , Kai Yu

Spoken language understanding (SLU) is a task aiming to extract high-level semantics from spoken utterances. Previous works have investigated the use of speech self-supervised models and textual pre-trained models, which have shown…

Computation and Language · Computer Science 2022-11-08 Jiatong Shi , Chan-Jan Hsu , Holam Chung , Dongji Gao , Paola Garcia , Shinji Watanabe , Ann Lee , Hung-yi Lee

This paper addresses the problem of automatic speech recognition (ASR) error detection and their use for improving spoken language understanding (SLU) systems. In this study, the SLU task consists in automatically extracting, from ASR…

Computation and Language · Computer Science 2017-05-29 Edwin Simonnet , Sahar Ghannay , Nathalie Camelin , Yannick Estève , Renato De Mori

Spoken Language Understanding (SLU) models are a core component of voice assistants (VA), such as Alexa, Bixby, and Google Assistant. In this paper, we introduce a pipeline designed to extend SLU systems to new languages, utilizing Large…

Computation and Language · Computer Science 2024-04-04 Jakub Hoscilowicz , Pawel Pawlowski , Marcin Skorupa , Marcin Sowański , Artur Janicki

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

Computation and Language · Computer Science 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

In this paper, we perform an exhaustive evaluation of different representations to address the intent classification problem in a Spoken Language Understanding (SLU) setup. We benchmark three types of systems to perform the SLU intent…

In the traditional cascading architecture for spoken language understanding (SLU), it has been observed that automatic speech recognition errors could be detrimental to the performance of natural language understanding. End-to-end (E2E) SLU…

Computation and Language · Computer Science 2021-09-02 Qian Chen , Wen Wang , Qinglin Zhang

Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based model. Recent advances in self-supervised representation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-01 Lasse Borgholt , Jakob Drachmann Havtorn , Mostafa Abdou , Joakim Edin , Lars Maaløe , Anders Søgaard , Christian Igel

This paper addresses the question as to what degree a BERT-based multilingual Spoken Language Understanding (SLU) model can transfer knowledge across languages. Through experiments we will show that, although it works substantially well…

Computation and Language · Computer Science 2020-11-11 Quynh Do , Judith Gaspers , Tobias Roding , Melanie Bradford

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

Spoken language understanding (SLU) systems extract both text transcripts and semantics associated with intents and slots from input speech utterances. SLU systems usually consist of (1) an automatic speech recognition (ASR) module, (2) an…

Computation and Language · Computer Science 2022-07-27 Anirudh Raju , Milind Rao , Gautam Tiwari , Pranav Dheram , Bryan Anderson , Zhe Zhang , Chul Lee , Bach Bui , Ariya Rastrow

Collecting sufficient labeled data for spoken language understanding (SLU) is expensive and time-consuming. Recent studies achieved promising results by using pre-trained models in low-resource scenarios. Inspired by this, we aim to ask:…

Computation and Language · Computer Science 2022-11-17 Yifan Peng , Siddhant Arora , Yosuke Higuchi , Yushi Ueda , Sujay Kumar , Karthik Ganesan , Siddharth Dalmia , Xuankai Chang , Shinji Watanabe

A recent line of research on spoken language assessment (SLA) employs neural models such as BERT and wav2vec 2.0 (W2V) to evaluate speaking proficiency across linguistic and acoustic modalities. Although both models effectively capture…

Computation and Language · Computer Science 2025-09-12 Hong-Yun Lin , Tien-Hong Lo , Yu-Hsuan Fang , Jhen-Ke Lin , Chung-Chun Wang , Hao-Chien Lu , Berlin Chen
‹ Prev 1 2 3 10 Next ›