English
Related papers

Related papers: A Stack-Propagation Framework with Token-Level Int…

200 papers

Spoken language understanding (SLU) requires a model to analyze input acoustic signal to understand its linguistic content and make predictions. To boost the models' performance, various pre-training methods have been proposed to learn rich…

Computation and Language · Computer Science 2021-03-16 Yu-An Chung , Chenguang Zhu , Michael Zeng

Conversational systems have a Natural Language Understanding (NLU) module. In this module, there is a task known as an intent classification that aims at identifying what a user is attempting to achieve from an utterance. Previous works use…

Computation and Language · Computer Science 2024-11-12 Jeanfranco D. Farfan-Escobedo , Julio C. Dos Reis

Previous work on spoken language understanding (SLU) mainly focuses on single-intent settings, where each input utterance merely contains one user intent. This configuration significantly limits the surface form of user utterances and the…

Computation and Language · Computer Science 2024-02-29 Hongshen Xu , Ruisheng Cao , Su Zhu , Sheng Jiang , Hanchong Zhang , Lu Chen , Kai Yu

End-to-end spoken language understanding (SLU) systems are gaining popularity over cascaded approaches due to their simplicity and ability to avoid error propagation. However, these systems model sequence labeling as a sequence prediction…

Computation and Language · Computer Science 2022-10-31 Siddhant Arora , Siddharth Dalmia , Brian Yan , Florian Metze , Alan W Black , Shinji Watanabe

This paper presents a novel approach for multi-task learning of language understanding (LU) and dialogue state tracking (DST) in task-oriented dialogue systems. Multi-task training enables the sharing of the neural network layers…

Computation and Language · Computer Science 2018-11-14 Abhinav Rastogi , Raghav Gupta , Dilek Hakkani-Tur

Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not…

Computation and Language · Computer Science 2023-06-19 Suwon Shon , Siddhant Arora , Chyi-Jiunn Lin , Ankita Pasad , Felix Wu , Roshan Sharma , Wei-Lun Wu , Hung-Yi Lee , Karen Livescu , Shinji Watanabe

Hand gesture-based Sign Language Recognition (SLR) serves as a crucial communication bridge between deaf and non-deaf individuals. While Graph Convolutional Networks (GCNs) are common, they are limited by their reliance on fixed skeletal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Koki Hirooka , Abu Saleh Musa Miah , Tatsuya Murakami , Md. Al Mehedi Hasan , Yong Seok Hwang , Jungpil Shin

People judge interactions with large language models (LLMs) as successful when outputs match what they want, not what they type. Yet LLMs are trained to predict the next token solely from text input, not underlying intent. Because written…

Computation and Language · Computer Science 2026-03-13 Nadav Kunievsky , James A. Evans

This paper proposes a user semantic intent modeling algorithm based on Capsule Networks to address the problem of insufficient accuracy in intent recognition for human-computer interaction. The method represents semantic features in input…

Computation and Language · Computer Science 2025-07-02 Shixiao Wang , Yifan Zhuang , Runsheng Zhang , Zhijun Song

In the constant updates of the product dialogue systems, we need to retrain the natural language understanding (NLU) model as new data from the real users would be merged into the existent data accumulated in the last updates. Within the…

Computation and Language · Computer Science 2023-05-25 Zefan Cai , Xin Zheng , Tianyu Liu , Xu Wang , Haoran Meng , Jiaqi Han , Gang Yuan , Binghuai Lin , Baobao Chang , Yunbo Cao

Large language models (LLMs) are rapidly emerging in Artificial Intelligence (AI) applications, especially in the fields of natural language processing and generative AI. Not limited to text generation applications, these models inherently…

Networking and Internet Architecture · Computer Science 2024-04-25 Dimitrios Michael Manias , Ali Chouman , Abdallah Shami

Intent detection is a text classification task whose aim is to recognize and label the semantics behind a users query. It plays a critical role in various business applications. The output of the intent detection module strongly conditions…

Machine Learning · Computer Science 2024-08-07 Eduardo Sanchez-Karhunen , Jose F. Quesada-Moreno , Miguel A. Gutiérrez-Naranjo

Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic…

Computation and Language · Computer Science 2022-10-12 Sahar Ghannay , Antoine Caubrière , Salima Mdhaffar , Gaëlle Laperrière , Bassam Jabaian , Yannick Estève

Spoken Language Understanding (SLU) aims to extract structured semantic representations (e.g., slot-value pairs) from speech recognized texts, which suffers from errors of Automatic Speech Recognition (ASR). To alleviate the problem caused…

Computation and Language · Computer Science 2020-09-08 Chen Liu , Su Zhu , Lu Chen , Kai Yu

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

We present LINGUIST, a method for generating annotated data for Intent Classification and Slot Tagging (IC+ST), via fine-tuning AlexaTM 5B, a 5-billion-parameter multilingual sequence-to-sequence (seq2seq) model, on a flexible instruction…

Computation and Language · Computer Science 2022-09-21 Andy Rosenbaum , Saleh Soltan , Wael Hamza , Yannick Versley , Markus Boese

Intent detection is a crucial task in any Natural Language Understanding (NLU) system and forms the foundation of a task-oriented dialogue system. To build high-quality real-world conversational solutions for edge devices, there is a need…

Computation and Language · Computer Science 2022-01-31 Vibhav Agarwal , Sudeep Deepak Shivnikar , Sourav Ghosh , Himanshu Arora , Yashwant Saini

In practice, most spoken language understanding systems process user input in a pipelined manner; first domain is predicted, then intent and semantic slots are inferred according to the semantic frames of the predicted domain. The pipeline…

Computation and Language · Computer Science 2018-01-17 Young-Bum Kim , Sungjin Lee , Karl Stratos

Dialogue systems need to deal with the unpredictability of user intents to track dialogue state and the heterogeneity of slots to understand user preferences. In this paper we investigate the hypothesis that solving these challenges as one…

Computation and Language · Computer Science 2023-08-14 Diogo Tavares , Pedro Azevedo , David Semedo , Ricardo Sousa , João Magalhães

The research study of detecting multiple intents and filling slots is becoming more popular because of its relevance to complicated real-world situations. Recent advanced approaches, which are joint models based on graphs, might still face…

Computation and Language · Computer Science 2023-12-12 Thinh Pham , Chi Tran , Dat Quoc Nguyen