English
Related papers

Related papers: Enhancing Slot Tagging with Intent Features for Ta…

200 papers

We present LINGUIST, a method for generating annotated data for Intent Classification and Slot Tagging (IC+ST), via fine-tuning AlexaTM 5B, a 5-billion-parameter multilingual sequence-to-sequence (seq2seq) model, on a flexible instruction…

Computation and Language · Computer Science 2022-09-21 Andy Rosenbaum , Saleh Soltan , Wael Hamza , Yannick Versley , Markus Boese

Interest in dialog systems has grown substantially in the past decade. By extension, so too has interest in developing and improving intent classification and slot-filling models, which are two components that are commonly used in…

Computation and Language · Computer Science 2022-07-28 Stefan Larson , Kevin Leach

In task-oriented dialogue systems, spoken language understanding (SLU) is a critical component, which consists of two sub-tasks, intent detection and slot filling. Most existing methods focus on the single-intent SLU, where each utterance…

Computation and Language · Computer Science 2026-02-13 Liz Li , Wei Zhu

Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realistic but challenging…

Computation and Language · Computer Science 2023-12-27 Ayush Kumar , Vijit Malik , Jithendra Vepa

Intent detection and slot filling are important tasks in spoken and natural language understanding. However, Vietnamese is a low-resource language in these research topics. In this paper, we present the first public intent detection and…

Computation and Language · Computer Science 2021-06-10 Mai Hoang Dao , Thinh Hung Truong , Dat Quoc Nguyen

Slot-filling, Translation, Intent classification, and Language identification, or STIL, is a newly-proposed task for multilingual Natural Language Understanding (NLU). By performing simultaneous slot filling and translation into a single…

Computation and Language · Computer Science 2022-04-20 Jack G. M. FitzGerald

Dialogue systems need to deal with the unpredictability of user intents to track dialogue state and the heterogeneity of slots to understand user preferences. In this paper we investigate the hypothesis that solving these challenges as one…

Computation and Language · Computer Science 2023-08-14 Diogo Tavares , Pedro Azevedo , David Semedo , Ricardo Sousa , João Magalhães

Attention-based encoder-decoder neural network models have recently shown promising results in machine translation and speech recognition. In this work, we propose an attention-based neural network model for joint intent detection and slot…

Computation and Language · Computer Science 2016-09-07 Bing Liu , Ian Lane

It is expensive and difficult to obtain the large number of sentence-level intent and token-level slot label annotations required to train neural network (NN)-based Natural Language Understanding (NLU) components of task-oriented dialog…

Computation and Language · Computer Science 2022-12-16 Rashmi Gangadharaiah , Balakrishnan Narayanaswamy

We propose a novel Transformer encoder-based architecture with syntactical knowledge encoded for intent detection and slot filling. Specifically, we encode syntactic knowledge into the Transformer encoder by jointly training it to predict…

Artificial Intelligence · Computer Science 2020-12-23 Jixuan Wang , Kai Wei , Martin Radfar , Weiwei Zhang , Clement Chung

Intent detection and slot filling are two main tasks for building a spoken language understanding (SLU) system. The two tasks are closely tied and the slots often highly depend on the intent. In this paper, we propose a novel framework for…

Computation and Language · Computer Science 2019-09-06 Libo Qin , Wanxiang Che , Yangming Li , Haoyang Wen , Ting Liu

Recent graph-based models for joint multiple intent detection and slot filling have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only…

Computation and Language · Computer Science 2022-11-08 Bowen Xing , Ivor W. Tsang

Slot-filling and intent detection are the backbone of conversational agents such as voice assistants, and are active areas of research. Even though state-of-the-art techniques on publicly available benchmarks show impressive performance,…

Computation and Language · Computer Science 2022-01-31 David Alfonso-Hermelo , Ahmad Rashid , Abbas Ghaddar , Philippe Langlais , Mehdi Rezagholizadeh

Reliable slot and intent detection (SID) is crucial in natural language understanding for applications like digital assistants. Encoder-only transformer models fine-tuned on high-resource languages generally perform well on SID. However,…

Computation and Language · Computer Science 2025-01-08 Xaver Maria Krückl , Verena Blaschke , Barbara Plank

We propose a generative framework for joint sequence labeling and sentence-level classification. Our model performs multiple sequence labeling tasks at once using a single, shared natural language output space. Unlike prior discriminative…

Computation and Language · Computer Science 2020-09-29 Ben Athiwaratkun , Cicero Nogueira dos Santos , Jason Krone , Bing Xiang

Building the Natural Language Understanding (NLU) modules of task-oriented Spoken Dialogue Systems (SDS) involves a definition of intents and entities, collection of task-relevant data, annotating the data with intents and entities, and…

Computation and Language · Computer Science 2021-05-13 Saurav Sahay , Eda Okur , Nagib Hakim , Lama Nachman

This paper investigates the effectiveness of pre-training for few-shot intent classification. While existing paradigms commonly further pre-train language models such as BERT on a vast amount of unlabeled corpus, we find it highly effective…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Yuwei Zhang , Li-Ming Zhan , Jiaxin Chen , Guangyuan Shi , Albert Y. S. Lam , Xiao-Ming Wu

Intent detection and slot filling are critical tasks in spoken and natural language understanding for task-oriented dialog systems. In this work we describe our participation in the slot and intent detection for low-resource language…

Computation and Language · Computer Science 2023-04-27 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Alcides Alcoba Inciarte , Muhammad Abdul-Mageed

We present a systematic study on multilingual and cross-lingual intent detection from spoken data. The study leverages a new resource put forth in this work, termed MInDS-14, a first training and evaluation resource for the intent detection…

Computation and Language · Computer Science 2021-04-20 Daniela Gerz , Pei-Hao Su , Razvan Kusztos , Avishek Mondal , Michał Lis , Eshan Singhal , Nikola Mrkšić , Tsung-Hsien Wen , Ivan Vulić

Natural language understanding includes the tasks of intent detection (identifying a user's objectives) and slot filling (extracting the entities relevant to those objectives). Prior slot filling methods assume that each intent type cannot…

Computation and Language · Computer Science 2023-05-19 Harshil Shah , Arthur Wilcke , Marius Cobzarenco , Cristi Cobzarenco , Edward Challis , David Barber