English
Related papers

Related papers: Data balancing for boosting performance of low-fre…

200 papers

End-to-end (E2E) spoken language understanding (SLU) systems avoid an intermediate textual representation by mapping speech directly into intents with slot values. This approach requires considerable domain-specific training data. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Pu Wang , Bagher BabaAli , Hugo Van hamme

Recent advanced methods in Natural Language Understanding for Task-oriented Dialogue (TOD) Systems (e.g., intent detection and slot filling) require a large amount of annotated data to achieve competitive performance. In reality,…

Computation and Language · Computer Science 2023-08-10 Hoang H. Nguyen , Chenwei Zhang , Ye Liu , Philip S. Yu

A spoken language understanding (SLU) system includes two main tasks, slot filling (SF) and intent detection (ID). The joint model for the two tasks is becoming a tendency in SLU. But the bi-directional interrelated connections between the…

Computation and Language · Computer Science 2019-07-02 Haihong E , Peiqing Niu , Zhongfu Chen , Meina Song

Learning intents and slot labels from user utterances is a fundamental step in all spoken language understanding (SLU) and dialog systems. State-of-the-art neural network based methods, after deployment, often suffer from performance…

Computation and Language · Computer Science 2018-09-19 Avik Ray , Yilin Shen , Hongxia Jin

Spoken language understanding (SLU) datasets, like many other machine learning datasets, usually suffer from the label imbalance problem. Label imbalance usually causes the learned model to replicate similar biases at the output which…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Leda Sarı , Mark Hasegawa-Johnson

The widespread use of conversational and question answering systems made it necessary to improve the performances of speaker intent detection and understanding of related semantic slots, i.e., Spoken Language Understanding (SLU). Often,…

Computation and Language · Computer Science 2019-07-18 Valentina Bellomaria , Giuseppe Castellucci , Andrea Favalli , Raniero Romagnoli

Spoken language understanding (SLU) requires a model to analyze input acoustic signal to understand its linguistic content and make predictions. To boost the models' performance, various pre-training methods have been proposed to learn rich…

Computation and Language · Computer Science 2021-03-16 Yu-An Chung , Chenguang Zhu , Michael Zeng

End-to-end spoken language understanding (SLU) systems benefit from pretraining on large corpora, followed by fine-tuning on application-specific data. The resulting models are too large for on-edge applications. For instance, BERT-based…

Computation and Language · Computer Science 2022-06-30 Pu Wang , Hugo Van hamme

This study examines the impact of class-imbalanced data on deep learning models and proposes a technique for data balancing by generating synthetic data for the minority class. Unlike random-based oversampling, our method prioritizes…

Machine Learning · Computer Science 2024-02-26 Hung Nguyen , Morris Chang

Slot filling is a crucial subtask in spoken language understanding (SLU), traditionally implemented as a cascade of speech recognition followed by one or more natural language understanding (NLU) components. The recent advent of…

Computation and Language · Computer Science 2025-10-20 Kadri Hacioglu , Manjunath K E , Andreas Stolcke

Spoken Language Understanding (SLU), which aims to extract user semantics to execute downstream tasks, is a crucial component of task-oriented dialog systems. Existing SLU datasets generally lack sufficient diversity and complexity, and…

Computation and Language · Computer Science 2025-12-02 Yuezhang Peng , Chonghao Cai , Ziang Liu , Shuai Fan , Sheng Jiang , Hua Xu , Yuxin Liu , Qiguang Chen , Kele Xu , Yao Li , Sheng Wang , Libo Qin , Xie Chen

Data imbalance in training data often leads to biased predictions from trained models, which in turn causes ethical and social issues. A straightforward solution is to carefully curate training data, but given the enormous scale of modern…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Moon Ye-Bin , Nam Hyeon-Woo , Wonseok Choi , Nayeong Kim , Suha Kwak , Tae-Hyun Oh

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

Computation and Language · Computer Science 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

Meta-Learning has emerged as a research direction to better transfer knowledge from related tasks to unseen but related tasks. However, Meta-Learning requires many training tasks to learn representations that transfer well to unseen tasks;…

Computation and Language · Computer Science 2022-10-13 Surya Kant Sahu

Spoken language understanding (SLU) acts as a critical component in goal-oriented dialog systems. It typically involves identifying the speakers intent and extracting semantic slots from user utterances, which are known as intent detection…

Computation and Language · Computer Science 2019-05-29 Mengyang Chen , Jin Zeng , Jie Lou

Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results…

Computation and Language · Computer Science 2020-02-17 Akshit Tyagi , Varun Sharma , Rahul Gupta , Lynn Samson , Nan Zhuang , Zihang Wang , Bill Campbell

Stuttering is a neuro-developmental speech impairment characterized by uncontrolled utterances (interjections) and core behaviors (blocks, repetitions, and prolongations), and is caused by the failure of speech sensorimotors. Due to its…

Sound · Computer Science 2023-02-23 Shakeel A. Sheikh , Md Sahidullah , Fabrice Hirsch , Slim Ouni

Training an end-to-end (E2E) neural network speech-to-intent (S2I) system that directly extracts intents from speech requires large amounts of intent-labeled speech data, which is time consuming and expensive to collect. Initializing the…

Computation and Language · Computer Science 2020-10-12 Yinghui Huang , Hong-Kwang Kuo , Samuel Thomas , Zvi Kons , Kartik Audhkhasi , Brian Kingsbury , Ron Hoory , Michael Picheny

Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, recurrent neural networks (RNNs) based methods achieved the…

Computation and Language · Computer Science 2020-09-29 Peilin Zhou , Zhiqi Huang , Fenglin Liu , Yuexian Zou

Neural-based models have achieved outstanding performance on slot filling and intent classification, when fairly large in-domain training data are available. However, as new domains are frequently added, creating sizeable data is expensive.…

Computation and Language · Computer Science 2020-09-09 Samuel Louvan , Bernardo Magnini