English
Related papers

Related papers: Towards Semi-Supervised Semantics Understanding fr…

200 papers

End-to-end spoken language understanding (SLU) models are a class of model architectures that predict semantics directly from speech. Because of their input and output types, we refer to them as speech-to-interpretation (STI) models.…

Computation and Language · Computer Science 2020-08-10 Joseph P. McKenna , Samridhi Choudhary , Michael Saxon , Grant P. Strimel , Athanasios Mouchtaris

Recent research has shown that word embedding spaces learned from text corpora of different languages can be aligned without any parallel data supervision. Inspired by the success in unsupervised cross-lingual word embeddings, in this paper…

Computation and Language · Computer Science 2018-09-24 Yu-An Chung , Wei-Hung Weng , Schrasing Tong , James Glass

Learning intents and slot labels from user utterances is a fundamental step in all spoken language understanding (SLU) and dialog systems. State-of-the-art neural network based methods, after deployment, often suffer from performance…

Computation and Language · Computer Science 2018-09-19 Avik Ray , Yilin Shen , Hongxia Jin

Neural models have yielded state-of-the-art results in deciphering spoken language understanding (SLU) problems; however, these models require a significant amount of domain-specific labeled examples for training, which is prohibitively…

Computation and Language · Computer Science 2020-10-12 Jin Cao , Jun Wang , Wael Hamza , Kelly Vanee , Shang-Wen Li

The Spoken Language Understanding Evaluation (SLUE) suite of benchmark tasks was recently introduced to address the need for open resources and benchmarking of complex spoken language understanding (SLU) tasks, including both classification…

Self-supervised learning (SSL) for speech representation has been successfully applied in various downstream tasks, such as speech and speaker recognition. More recently, speech SSL models have also been shown to be beneficial in advancing…

Computation and Language · Computer Science 2024-08-28 Takanori Ashihara , Takafumi Moriya , Kohei Matsuura , Tomohiro Tanaka , Yusuke Ijima , Taichi Asami , Marc Delcroix , Yukinori Honma

End-to-end (E2E) spoken language understanding (SLU) is constrained by the cost of collecting speech-semantics pairs, especially when label domains change. Hence, we explore \textit{zero-shot} E2E SLU, which learns E2E SLU without…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-06 Jianfeng He , Julian Salazar , Kaisheng Yao , Haoqi Li , Jinglun Cai

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots).…

Computation and Language · Computer Science 2022-01-13 Xiao Xu , Libo Qin , Kaiji Chen , Guoxing Wu , Linlin Li , Wanxiang Che

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

Computation and Language · Computer Science 2022-05-26 Akshat Gupta

Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not…

Computation and Language · Computer Science 2023-06-19 Suwon Shon , Siddhant Arora , Chyi-Jiunn Lin , Ankita Pasad , Felix Wu , Roshan Sharma , Wei-Lun Wu , Hung-Yi Lee , Karen Livescu , Shinji Watanabe

In a modern spoken language understanding (SLU) system, the natural language understanding (NLU) module takes interpretations of a speech from the automatic speech recognition (ASR) module as the input. The NLU module usually uses the first…

Computation and Language · Computer Science 2020-01-16 Mingda Li , Weitong Ruan , Xinyue Liu , Luca Soldaini , Wael Hamza , Chengwei Su

Spoken language understanding (SLU) tasks involve mapping from speech audio signals to semantic labels. Given the complexity of such tasks, good performance might be expected to require large labeled datasets, which are difficult to collect…

Computation and Language · Computer Science 2022-07-12 Ankita Pasad , Felix Wu , Suwon Shon , Karen Livescu , Kyu J. Han

End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, these systems model sequence labeling as a sequence prediction…

Computation and Language · Computer Science 2022-10-31 Siddhant Arora , Siddharth Dalmia , Brian Yan , Florian Metze , Alan W Black , Shinji Watanabe

Zero-shot spoken language understanding (SLU) enables systems to comprehend user utterances in new domains without prior exposure to training data. Recent studies often rely on large language models (LLMs), leading to excessive footprints…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Mohan Li , Simon Keizer , Rama Doddipatla

As Automatic Speech Processing (ASR) systems are getting better, there is an increasing interest of using the ASR output to do downstream Natural Language Processing (NLP) tasks. However, there are few open source toolkits that can be used…

This paper addresses the problem of automatic speech recognition (ASR) error detection and their use for improving spoken language understanding (SLU) systems. In this study, the SLU task consists in automatically extracting, from ASR…

Computation and Language · Computer Science 2017-05-29 Edwin Simonnet , Sahar Ghannay , Nathalie Camelin , Yannick Estève , Renato De Mori

In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline…

Computation and Language · Computer Science 2021-06-15 Suwon Shon , Pablo Brusco , Jing Pan , Kyu J. Han , Shinji Watanabe

Recently there have been efforts to introduce new benchmark tasks for spoken language understanding (SLU), like semantic parsing. In this paper, we describe our proposed spoken semantic parsing system for the quality track (Track 1) in…

Computation and Language · Computer Science 2023-05-09 Siddhant Arora , Hayato Futami , Shih-Lun Wu , Jessica Huynh , Yifan Peng , Yosuke Kashiwagi , Emiru Tsunoo , Brian Yan , Shinji Watanabe

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

In this paper we examine the use of semantically-aligned speech representations for end-to-end spoken language understanding (SLU). We employ the recently-introduced SAMU-XLSR model, which is designed to generate a single embedding that…

Computation and Language · Computer Science 2022-10-12 Gaëlle Laperrière , Valentin Pelloin , Mickaël Rouvier , Themos Stafylakis , Yannick Estève