English
Related papers

Related papers: Parallel Intent and Slot Prediction using MLB Fusi…

200 papers

Modern spoken language understanding (SLU) systems rely on sophisticated semantic notions revealed in single utterances to detect intents and slots. However, they lack the capability of modeling multi-turn dynamics within a dialogue…

Computation and Language · Computer Science 2022-05-31 Ting-Wei Wu , Biing-Hwang Juang

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

The lack of publicly available evaluation data for low-resource languages limits progress in Spoken Language Understanding (SLU). As key tasks like intent classification and slot filling require abundant training data, it is desirable to…

Natural language understanding includes the tasks of intent detection (identifying a user's objectives) and slot filling (extracting the entities relevant to those objectives). Prior slot filling methods assume that each intent type cannot…

Computation and Language · Computer Science 2023-05-19 Harshil Shah , Arthur Wilcke , Marius Cobzarenco , Cristi Cobzarenco , Edward Challis , David Barber

Slot filling and intent detection are two highly correlated tasks in spoken language understanding (SLU). Recent SLU research attempts to explore zero-shot prompting techniques in large language models to alleviate the data scarcity…

Computation and Language · Computer Science 2024-06-18 Libo Qin , Fuxuan Wei , Qiguang Chen , Jingxuan Zhou , Shijue Huang , Jiasheng Si , Wenpeng Lu , Wanxiang Che

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Slot-filling, Translation, Intent classification, and Language identification, or STIL, is a newly-proposed task for multilingual Natural Language Understanding (NLU). By performing simultaneous slot filling and translation into a single…

Computation and Language · Computer Science 2022-04-20 Jack G. M. FitzGerald

Reliable slot and intent detection (SID) is crucial in natural language understanding for applications like digital assistants. Encoder-only transformer models fine-tuned on high-resource languages generally perform well on SID. However,…

Computation and Language · Computer Science 2025-01-08 Xaver Maria Krückl , Verena Blaschke , Barbara Plank

End-to-end spoken language understanding (SLU) has recently attracted increasing interest. Compared to the conventional tandem-based approach that combines speech recognition and language understanding as separate modules, the new approach…

Computation and Language · Computer Science 2021-07-20 Nihal Potdar , Anderson R. Avila , Chao Xing , Dong Wang , Yiran Cao , Xiao Chen

Intent detection and slot filling are critical tasks in spoken and natural language understanding for task-oriented dialog systems. In this work we describe our participation in the slot and intent detection for low-resource language…

Computation and Language · Computer Science 2023-04-27 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Alcides Alcoba Inciarte , Muhammad Abdul-Mageed

Building Spoken Language Understanding (SLU) systems that do not rely on language specific Automatic Speech Recognition (ASR) is an important yet less explored problem in language processing. In this paper, we present a comparative study…

Computation and Language · Computer Science 2022-04-19 Hemant Yadav , Akshat Gupta , Sai Krishna Rallabandi , Alan W Black , Rajiv Ratn Shah

Joint intent detection and slot filling, which is also termed as joint NLU (Natural Language Understanding) is invaluable for smart voice assistants. Recent advancements in this area have been heavily focusing on improving accuracy using…

Machine Learning · Computer Science 2023-09-27 Kalpa Gunaratna , Vijay Srinivasan , Hongxia Jin

Spoken Language Understanding (SLU), a core component of the task-oriented dialogue system, expects a shorter inference latency due to the impatience of humans. Non-autoregressive SLU models clearly increase the inference speed but suffer…

Computation and Language · Computer Science 2021-08-17 Lizhi Cheng , Weijia Jia , Wenmian Yang

Most human interactions occur in the form of spoken conversations where the semantic meaning of a given utterance depends on the context. Each utterance in spoken conversation can be represented by many semantic and speaker attributes, and…

Computation and Language · Computer Science 2023-05-02 Siddhant Arora , Hayato Futami , Emiru Tsunoo , Brian Yan , Shinji Watanabe

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

This paper presents a comprehensive study on stock price prediction, leveragingadvanced machine learning (ML) and deep learning (DL) techniques to improve financial forecasting accuracy. The research evaluates the performance of various…

Statistical Finance · Quantitative Finance 2025-02-25 Daksh Dave , Gauransh Sawhney , Vikhyat Chauhan

In this study, we propose a novel multi-modal end-to-end neural approach for automated assessment of non-native English speakers' spontaneous speech using attention fusion. The pipeline employs Bi-directional Recurrent Convolutional Neural…

Computation and Language · Computer Science 2021-11-30 Manraj Singh Grover , Yaman Kumar , Sumit Sarin , Payman Vafaee , Mika Hama , Rajiv Ratn Shah

Natural language understanding typically maps single utterances to a dual level semantic frame, sentence level intent and slot labels at the word level. The best performing models force explicit interaction between intent detection and slot…

Computation and Language · Computer Science 2023-05-30 Henry Weld , Sijia Hu , Siqu Long , Josiah Poon , Soyeon Caren Han

We present LINGUIST, a method for generating annotated data for Intent Classification and Slot Tagging (IC+ST), via fine-tuning AlexaTM 5B, a 5-billion-parameter multilingual sequence-to-sequence (seq2seq) model, on a flexible instruction…

Computation and Language · Computer Science 2022-09-21 Andy Rosenbaum , Saleh Soltan , Wael Hamza , Yannick Versley , Markus Boese

In this paper, we investigate few-shot joint learning for dialogue language understanding. Most existing few-shot models learn a single task each time with only a few examples. However, dialogue language understanding contains two closely…

Computation and Language · Computer Science 2021-06-15 Yutai Hou , Yongkui Lai , Cheng Chen , Wanxiang Che , Ting Liu