English
Related papers

Related papers: An Effective Non-Autoregressive Model for Spoken L…

200 papers

Recent strides in large language models (LLMs) have yielded remarkable performance, leveraging reinforcement learning from human feedback (RLHF) to significantly enhance generation and alignment capabilities. However, RLHF encounters…

Computation and Language · Computer Science 2024-05-31 Kuo Liao , Shuang Li , Meng Zhao , Liqun Liu , Mengge Xue , Zhenyu Hu , Honglin Han , Chengguo Yin

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

Non-autoregressive (NAR) modeling has gained significant interest in speech processing since these models achieve dramatically lower inference time than autoregressive (AR) models while also achieving good transcription accuracy. Since NAR…

Computation and Language · Computer Science 2024-02-21 Siddhant Arora , George Saon , Shinji Watanabe , Brian Kingsbury

Recent advanced methods in Natural Language Understanding for Task-oriented Dialogue (TOD) Systems (e.g., intent detection and slot filling) require a large amount of annotated data to achieve competitive performance. In reality,…

Computation and Language · Computer Science 2023-08-10 Hoang H. Nguyen , Chenwei Zhang , Ye Liu , Philip S. Yu

End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, these systems model sequence labeling as a sequence prediction…

Computation and Language · Computer Science 2022-10-31 Siddhant Arora , Siddharth Dalmia , Brian Yan , Florian Metze , Alan W Black , Shinji Watanabe

Spoken Language Understanding (SLU) is a critical component of voice assistants; it consists of converting speech to semantic parses for task execution. Previous works have explored end-to-end models to improve the quality and robustness of…

Computation and Language · Computer Science 2024-06-13 Trang Le , Daniel Lazar , Suyoun Kim , Shan Jiang , Duc Le , Adithya Sagar , Aleksandr Livshits , Ahmed Aly , Akshat Shrivastava

Spoken Language Understanding (SLU) aims to extract the semantics frame of user queries, which is a core component in a task-oriented dialog system. With the burst of deep neural networks and the evolution of pre-trained language models,…

Computation and Language · Computer Science 2021-05-11 Libo Qin , Tianbao Xie , Wanxiang Che , Ting Liu

Forced alignment (FA) predicts start and end timestamps for words or characters in speech, but existing methods are language-specific and prone to cumulative temporal shifts. The multilingual speech understanding and long-sequence…

Sound · Computer Science 2026-02-02 Bingshen Mu , Xian Shi , Xiong Wang , Hexin Liu , Jin Xu , Lei Xie

This paper addresses the problem of automatic speech recognition (ASR) error detection and their use for improving spoken language understanding (SLU) systems. In this study, the SLU task consists in automatically extracting, from ASR…

Computation and Language · Computer Science 2017-05-29 Edwin Simonnet , Sahar Ghannay , Nathalie Camelin , Yannick Estève , Renato De Mori

End-to-end Spoken Language Understanding (SLU) models are made increasingly large and complex to achieve the state-ofthe-art accuracy. However, the increased complexity of a model can also introduce high risk of over-fitting, which is a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-14 Xueli Jia , Jianzong Wang , Zhiyong Zhang , Ning Cheng , Jing Xiao

Neural models have yielded state-of-the-art results in deciphering spoken language understanding (SLU) problems; however, these models require a significant amount of domain-specific labeled examples for training, which is prohibitively…

Computation and Language · Computer Science 2020-10-12 Jin Cao , Jun Wang , Wael Hamza , Kelly Vanee , Shang-Wen Li

The goal of spoken language understanding (SLU) systems is to determine the meaning of the input speech signal, unlike speech recognition which aims to produce verbatim transcripts. Advances in end-to-end (E2E) speech modeling have made it…

Computation and Language · Computer Science 2022-01-31 Hong-Kwang J. Kuo , Zoltan Tuske , Samuel Thomas , Brian Kingsbury , George Saon

Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, recurrent neural networks (RNNs) based methods achieved the…

Computation and Language · Computer Science 2020-09-29 Peilin Zhou , Zhiqi Huang , Fenglin Liu , Yuexian Zou

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

Computation and Language · Computer Science 2022-05-26 Akshat Gupta

This paper proposes a novel unsupervised autoregressive neural model for learning generic speech representations. In contrast to other speech representation learning methods that aim to remove noise or speaker variabilities, ours is…

Computation and Language · Computer Science 2019-06-20 Yu-An Chung , Wei-Ning Hsu , Hao Tang , James Glass

Spoken language understanding (SLU) is an essential component in conversational systems. Most SLU component treats each utterance independently, and then the following components aggregate the multi-turn information in the separate phases.…

Computation and Language · Computer Science 2017-12-12 Po-Chun Chen , Ta-Chung Chi , Shang-Yu Su , Yun-Nung Chen

Spoken language understanding (SLU) systems can be trained on two types of labelled data: aligned or unaligned. Unaligned data do not require word by word annotation and is easier to be obtained. In the paper, we focus on spoken language…

Computation and Language · Computer Science 2019-04-10 Zijian Zhao , Su Zhu , Kai Yu

In this paper, we perform an exhaustive evaluation of different representations to address the intent classification problem in a Spoken Language Understanding (SLU) setup. We benchmark three types of systems to perform the SLU intent…

The emergence of LM-based judging reward modeling, represented by generative reward models, has successfully made reinforcement learning from AI feedback (RLAIF) efficient and scalable. To further advance this paradigm, we propose a core…

Computation and Language · Computer Science 2025-11-18 Meiling Ning , Zhongbao Zhang , Junda Ye , Jiabao Guo , Qingyuan Guan