English
Related papers

Related papers: Zero-Shot Slot and Intent Detection in Low-Resourc…

200 papers

Out-of-scope intent detection is of practical importance in task-oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on strong assumptions on…

Computation and Language · Computer Science 2021-06-18 Li-Ming Zhan , Haowen Liang , Bo Liu , Lu Fan , Xiao-Ming Wu , Albert Y. S. Lam

Task-oriented dialog(TOD) aims to assist users in achieving specific goals through multi-turn conversation. Recently, good results have been obtained based on large pre-trained models. However, the labeled-data scarcity hinders the…

Computation and Language · Computer Science 2022-12-26 Zhitong Yang , Xing Ma , Anqi Liu , Zheyu Zhang

Existing task-oriented conversational search systems heavily rely on domain ontologies with pre-defined slots and candidate value sets. In practical applications, these prerequisites are hard to meet, due to the emerging new user…

Computation and Language · Computer Science 2023-05-09 Yuxia Wu , Tianhao Dai , Zhedong Zheng , Lizi Liao

Mainstream cross-lingual task-oriented dialogue (ToD) systems leverage the transfer learning paradigm by training a joint model for intent recognition and slot-filling in English and applying it, zero-shot, to other languages. We address a…

Computation and Language · Computer Science 2024-02-06 Ekaterina Artemova , Verena Blaschke , Barbara Plank

Intent Detection is one of the tasks of the Natural Language Understanding (NLU) unit in task-oriented dialogue systems. Out of Scope (OOS) and Out of Domain (OOD) inputs may run these systems into a problem. On the other side, a labeled…

Computation and Language · Computer Science 2023-08-01 Masoud Akbari , Ali Mohades , M. Hassan Shirali-Shahreza

Although Large Language Models (LLMs) can generate coherent text, they often struggle to recognise user intent behind queries. In contrast, Natural Language Understanding (NLU) models interpret the purpose and key information of user input…

Computation and Language · Computer Science 2025-06-02 Yan Li , So-Eon Kim , Seong-Bae Park , Soyeon Caren Han

Slot-filling, Translation, Intent classification, and Language identification, or STIL, is a newly-proposed task for multilingual Natural Language Understanding (NLU). By performing simultaneous slot filling and translation into a single…

Computation and Language · Computer Science 2022-04-20 Jack G. M. FitzGerald

State-of-the-art intent classification (IC) and slot filling (SF) methods often rely on data-intensive deep learning models, limiting their practicality for industry applications. Large language models on the other hand, particularly…

Computation and Language · Computer Science 2024-03-27 Paramita Mirza , Viju Sudhi , Soumya Ranjan Sahoo , Sinchana Ramakanth Bhat

Profile-based intent detection and slot filling are important tasks aimed at reducing the ambiguity in user utterances by leveraging user-specific supporting profile information. However, research in these two tasks has not been extensively…

Computation and Language · Computer Science 2023-12-19 Thinh Pham , Dat Quoc Nguyen

With the advent of conversational assistants, like Amazon Alexa, Google Now, etc., dialogue systems are gaining a lot of traction, especially in industrial setting. These systems typically consist of Spoken Language understanding component…

Computation and Language · Computer Science 2019-07-19 Arshit Gupta , John Hewitt , Katrin Kirchhoff

Zero-shot slot filling is a well-established subtask of Natural Language Understanding (NLU). However, most existing methods primarily focus on single-turn text data, overlooking the unique complexities of conversational dialogue.…

Computation and Language · Computer Science 2024-12-02 Mansi Rana , Kadri Hacioglu , Sindhuja Gopalan , Maragathamani Boothalingam

Slot filling and intent detection are two highly correlated tasks in spoken language understanding (SLU). Recent SLU research attempts to explore zero-shot prompting techniques in large language models to alleviate the data scarcity…

Computation and Language · Computer Science 2024-06-18 Libo Qin , Fuxuan Wei , Qiguang Chen , Jingxuan Zhou , Shijue Huang , Jiasheng Si , Wenpeng Lu , Wanxiang Che

We propose a novel Transformer encoder-based architecture with syntactical knowledge encoded for intent detection and slot filling. Specifically, we encode syntactic knowledge into the Transformer encoder by jointly training it to predict…

Artificial Intelligence · Computer Science 2020-12-23 Jixuan Wang , Kai Wei , Martin Radfar , Weiwei Zhang , Clement Chung

Large Language Models (LLMs) remain vulnerable to jailbreak attacks, where adversarially crafted prompts induce policy-violating responses despite safety alignment. Existing defenses typically improve safety through external filtering,…

Cryptography and Security · Computer Science 2026-05-12 Yulong Chen , Qi Zhang , Jiawen Zhang , Yadong Liu , Mu Li , Jie Wen , Yong Xu

Despite the fact that data imbalance is becoming more and more common in real-world Spoken Language Understanding (SLU) applications, it has not been studied extensively in the literature. To the best of our knowledge, this paper presents…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Judith Gaspers , Quynh Do , Fabian Triefenbach

Intent classification and slot filling are two essential tasks for natural language understanding. They often suffer from small-scale human-labeled training data, resulting in poor generalization capability, especially for rare words.…

Computation and Language · Computer Science 2019-03-01 Qian Chen , Zhu Zhuo , Wen Wang

Intent detection is a crucial task in any Natural Language Understanding (NLU) system and forms the foundation of a task-oriented dialogue system. To build high-quality real-world conversational solutions for edge devices, there is a need…

Computation and Language · Computer Science 2022-01-31 Vibhav Agarwal , Sudeep Deepak Shivnikar , Sourav Ghosh , Himanshu Arora , Yashwant Saini

Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, recurrent neural networks (RNNs) based methods achieved the…

Computation and Language · Computer Science 2020-09-29 Peilin Zhou , Zhiqi Huang , Fenglin Liu , Yuexian Zou

Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-oriented dialog systems.…

Computation and Language · Computer Science 2021-01-19 A. B. Siddique , Fuad Jamour , Vagelis Hristidis

In this paper, we provide an extensive analysis of multi-label intent classification using Large Language Models (LLMs) that are open-source, publicly available, and can be run in consumer hardware. We use the MultiWOZ 2.1 dataset, a…

Computation and Language · Computer Science 2025-09-15 Adnan Ahmad , Philine Kowol , Stefan Hillmann , Sebastian Möller