English
Related papers

Related papers: Slot Induction via Pre-trained Language Model Prob…

200 papers

Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, recurrent neural networks (RNNs) based methods achieved the…

Computation and Language · Computer Science 2020-09-29 Peilin Zhou , Zhiqi Huang , Fenglin Liu , Yuexian Zou

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

Recent years have witnessed increasing interests in prompt-based learning in which models can be trained on only a few annotated instances, making them suitable in low-resource settings. When using prompt-based learning for text…

Computation and Language · Computer Science 2023-05-11 Hongjing Li , Hanqi Yan , Yanran Li , Li Qian , Yulan He , Lin Gui

Slot filling and intent detection are two fundamental tasks in the field of natural language understanding. Due to the strong correlation between these two tasks, previous studies make efforts on modeling them with multi-task learning or…

Computation and Language · Computer Science 2022-09-12 Baohang Zhou , Ying Zhang , Xuhui Sui , Kehui Song , Xiaojie Yuan

Intent Detection and Slot Filling are two pillar tasks in Spoken Natural Language Understanding. Common approaches adopt joint Deep Learning architectures in attention-based recurrent frameworks. In this work, we aim at exploiting the…

Computation and Language · Computer Science 2019-07-08 Giuseppe Castellucci , Valentina Bellomaria , Andrea Favalli , Raniero Romagnoli

Slot filling and intent detection are two main tasks in spoken language understanding (SLU) system. In this paper, we propose a novel non-autoregressive model named SlotRefine for joint intent detection and slot filling. Besides, we design…

Computation and Language · Computer Science 2020-11-03 Di Wu , Liang Ding , Fan Lu , Jian Xie

Identifying intents from dialogue utterances forms an integral component of task-oriented dialogue systems. Intent-related tasks are typically formulated either as a classification task, where the utterances are classified into predefined…

Computation and Language · Computer Science 2023-10-26 Bhavuk Singhal , Ashim Gupta , Shivasankaran V P , Amrith Krishna

Multi-intent spoken language understanding (SLU) involves two tasks: multiple intent detection and slot filling, which jointly handle utterances containing more than one intent. Owing to this characteristic, which closely reflects…

Computation and Language · Computer Science 2025-12-15 Di Wu , Ruiyu Fang , Liting Jiang , Shuangyong Song , Xiaomeng Huang , Shiquan Wang , Zhongqiu Li , Lingling Shi , Mengjiao Bao , Yongxiang Li , Hao Huang

Slot and intent detection (SID) is a classic natural language understanding task. Despite this, research has only more recently begun focusing on SID for dialectal and colloquial varieties. Many approaches for low-resource scenarios have…

Computation and Language · Computer Science 2025-01-08 Verena Blaschke , Felicia Körner , Barbara Plank

Intent and Slot Identification are two important tasks in Spoken Language Understanding (SLU). For a natural language utterance, there is a high correlation between these two tasks. A lot of work has been done on each of these using…

Computation and Language · Computer Science 2020-03-23 Anmol Bhasin , Bharatram Natarajan , Gaurav Mathur , Himanshu Mangla

Natural language understanding typically maps single utterances to a dual level semantic frame, sentence level intent and slot labels at the word level. The best performing models force explicit interaction between intent detection and slot…

Computation and Language · Computer Science 2023-05-30 Henry Weld , Sijia Hu , Siqu Long , Josiah Poon , Soyeon Caren Han

Intent classification and slot filling are two essential tasks for natural language understanding. They often suffer from small-scale human-labeled training data, resulting in poor generalization capability, especially for rare words.…

Computation and Language · Computer Science 2019-03-01 Qian Chen , Zhu Zhuo , Wen Wang

The goal of this paper is to learn cross-domain representations for slot filling task in spoken language understanding (SLU). Most of the recently published SLU models are domain-specific ones that work on individual task domains.…

Computation and Language · Computer Science 2017-12-01 Bing Liu , Ian Lane

Natural language understanding (NLU) in the context of goal-oriented dialog systems typically includes intent classification and slot labeling tasks. Existing methods to expand an NLU system to new languages use machine translation with…

Computation and Language · Computer Science 2020-10-09 Weijia Xu , Batool Haider , Saab Mansour

Joint intent detection and slot filling is a key research topic in natural language understanding (NLU). Existing joint intent and slot filling systems analyze and compute features collectively for all slot types, and importantly, have no…

Machine Learning · Computer Science 2022-10-20 Kalpa Gunaratna , Vijay Srinivasan , Akhila Yerukola , Hongxia Jin

New intent discovery is a crucial capability for task-oriented dialogue systems. Existing methods focus on transferring in-domain (IND) prior knowledge to out-of-domain (OOD) data through pre-training and clustering stages. They either…

Computation and Language · Computer Science 2024-10-29 Yimin Deng , Yuxia Wu , Guoshuai Zhao , Li Zhu , Xueming Qian

Despite the great success of spoken language understanding (SLU) in high-resource languages, it remains challenging in low-resource languages mainly due to the lack of labeled training data. The recent multilingual code-switching approach…

Computation and Language · Computer Science 2022-10-26 Shining Liang , Linjun Shou , Jian Pei , Ming Gong , Wanli Zuo , Xianglin Zuo , Daxin Jiang

How can we extend a pre-trained model to many language understanding tasks, without labeled or additional unlabeled data? Pre-trained language models (PLMs) have been effective for a wide range of NLP tasks. However, existing approaches…

Computation and Language · Computer Science 2023-05-29 Xuandong Zhao , Siqi Ouyang , Zhiguo Yu , Ming Wu , Lei Li

Interest in dialog systems has grown substantially in the past decade. By extension, so too has interest in developing and improving intent classification and slot-filling models, which are two components that are commonly used in…

Computation and Language · Computer Science 2022-07-28 Stefan Larson , Kevin Leach

Slot labelling is an essential component of any dialogue system, aiming to find important arguments in every user turn. Common approaches involve large pre-trained language models (PLMs) like BERT or RoBERTa, but they face challenges such…

Computation and Language · Computer Science 2024-01-22 Vladimir Vlasov