English
Related papers

Related papers: Slot Induction via Pre-trained Language Model Prob…

200 papers

Mainstream cross-lingual task-oriented dialogue (ToD) systems leverage the transfer learning paradigm by training a joint model for intent recognition and slot-filling in English and applying it, zero-shot, to other languages. We address a…

Computation and Language · Computer Science 2024-02-06 Ekaterina Artemova , Verena Blaschke , Barbara Plank

Task oriented language understanding in dialog systems is often modeled using intents (task of a query) and slots (parameters for that task). Intent detection and slot tagging are, in turn, modeled using sentence classification and word…

Computation and Language · Computer Science 2019-11-14 Arash Einolghozati , Sonal Gupta , Mrinal Mohit , Rushin Shah

Automatically and accurately identifying user intents and filling the associated slots from their spoken language are critical to the success of dialogue systems. Traditional methods require manually defining the DOMAIN-INTENT-SLOT schema…

Artificial Intelligence · Computer Science 2021-03-17 Zengfeng Zeng , Dan Ma , Haiqin Yang , Zhen Gou , Jianping Shen

Zero-shot slot filling is a well-established subtask of Natural Language Understanding (NLU). However, most existing methods primarily focus on single-turn text data, overlooking the unique complexities of conversational dialogue.…

Computation and Language · Computer Science 2024-12-02 Mansi Rana , Kadri Hacioglu , Sindhuja Gopalan , Maragathamani Boothalingam

Existing task-oriented conversational search systems heavily rely on domain ontologies with pre-defined slots and candidate value sets. In practical applications, these prerequisites are hard to meet, due to the emerging new user…

Computation and Language · Computer Science 2023-05-09 Yuxia Wu , Tianhao Dai , Zhedong Zheng , Lizi Liao

Slot filling and intent detection are two highly correlated tasks in spoken language understanding (SLU). Recent SLU research attempts to explore zero-shot prompting techniques in large language models to alleviate the data scarcity…

Computation and Language · Computer Science 2024-06-18 Libo Qin , Fuxuan Wei , Qiguang Chen , Jingxuan Zhou , Shijue Huang , Jiasheng Si , Wenpeng Lu , Wanxiang Che

Natural language understanding (NLU) has two core tasks: intent classification and slot filling. The success of pre-training language models resulted in a significant breakthrough in the two tasks. One of the promising solutions called BERT…

Computation and Language · Computer Science 2023-02-03 Yu Guo , Zhilong Xie , Xingyan Chen , Huangen Chen , Leilei Wang , Huaming Du , Shaopeng Wei , Yu Zhao , Qing Li , Gang Wu

Intent classification and slot-filling are essential tasks of Spoken Language Understanding (SLU). In most SLUsystems, those tasks are realized by independent modules. For about fifteen years, models achieving both of themjointly and…

Computation and Language · Computer Science 2024-04-01 Nadège Alavoine , Gaëlle Laperriere , Christophe Servan , Sahar Ghannay , Sophie Rosset

Despite the fact that data imbalance is becoming more and more common in real-world Spoken Language Understanding (SLU) applications, it has not been studied extensively in the literature. To the best of our knowledge, this paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Judith Gaspers , Quynh Do , Fabian Triefenbach

Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slot filling have…

Computation and Language · Computer Science 2022-03-01 Soyeon Caren Han , Siqu Long , Huichun Li , Henry Weld , Josiah Poon

Traditional slot filling in natural language understanding (NLU) predicts a one-hot vector for each word. This form of label representation lacks semantic correlation modelling, which leads to severe data sparsity problem, especially when…

Computation and Language · Computer Science 2020-06-16 Su Zhu , Zijian Zhao , Rao Ma , Kai Yu

Intent detection is a critical component of task-oriented dialogue systems (TODS) which enables the identification of suitable actions to address user utterances at each dialog turn. Traditional approaches relied on computationally…

Computation and Language · Computer Science 2024-10-03 Gaurav Arora , Shreya Jain , Srujana Merugu

Multiple intent detection and slot filling are two fundamental and crucial tasks in spoken language understanding. Motivated by the fact that the two tasks are closely related, joint models that can detect intents and extract slots…

Computation and Language · Computer Science 2023-12-29 Nguyen Anh Tu , Hoang Thi Thu Uyen , Tu Minh Phuong , Ngo Xuan Bach

Slot filling is one of the critical tasks in modern conversational systems. The majority of existing literature employs supervised learning methods, which require labeled training data for each new domain. Zero-shot learning and weak…

Computation and Language · Computer Science 2023-03-27 Adib Mosharrof , Moghis Fereidouni , A. B. Siddique

Spoken Language Understanding (SLU) is one essential step in building a dialogue system. Due to the expensive cost of obtaining the labeled data, SLU suffers from the data scarcity problem. Therefore, in this paper, we focus on data…

Computation and Language · Computer Science 2021-09-03 Haitao Lin , Lu Xiang , Yu Zhou , Jiajun Zhang , Chengqing Zong

Task-oriented dialogue (TOD) systems facilitate users in executing various activities via multi-turn dialogues, but Large Language Models (LLMs) often struggle to comprehend these intricate contexts. In this study, we propose a novel…

Computation and Language · Computer Science 2023-09-25 Haoyu Gao , Ting-En Lin , Hangyu Li , Min Yang , Yuchuan Wu , Wentao Ma , Yongbin Li

The lack of publicly available evaluation data for low-resource languages limits progress in Spoken Language Understanding (SLU). As key tasks like intent classification and slot filling require abundant training data, it is desirable to…

Spoken language understanding (SLU) is a core task in task-oriented dialogue systems, which aims at understanding the user's current goal through constructing semantic frames. SLU usually consists of two subtasks, including intent detection…

Computation and Language · Computer Science 2024-06-03 Xuxin Cheng , Wanshi Xu , Zhihong Zhu , Hongxiang Li , Yuexian Zou

A spoken language understanding (SLU) system includes two main tasks, slot filling (SF) and intent detection (ID). The joint model for the two tasks is becoming a tendency in SLU. But the bi-directional interrelated connections between the…

Computation and Language · Computer Science 2019-07-02 Haihong E , Peiqing Niu , Zhongfu Chen , Meina Song

Recent joint intent detection and slot tagging models have seen improved performance when compared to individual models. In many real-world datasets, the slot labels and values have a strong correlation with their intent labels. In such…

Computation and Language · Computer Science 2022-05-24 Shruthi Hariharan , Vignesh Kumar Krishnamurthy , Utkarsh , Jayantha Gowda Sarapanahalli