English
Related papers

Related papers: Zero-Shot Learning for Joint Intent and Slot Label…

200 papers

When a human communicates with a machine using natural language on the web and online, how can it understand the human's intention and semantic context of their talk? This is an important AI task as it enables the machine to construct a…

Computation and Language · Computer Science 2022-12-22 Soyeon Caren Han , Siqu Long , Henry Weld , Josiah Poon

Recently slot filling has witnessed great development thanks to deep learning and the availability of large-scale annotated data. However, it poses a critical challenge to handle a novel domain whose samples are never seen during training.…

Computation and Language · Computer Science 2023-10-25 Yuanjun Shi , Linzhi Wu , Minglai Shao

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Traditional slot filling in natural language understanding (NLU) predicts a one-hot vector for each word. This form of label representation lacks semantic correlation modelling, which leads to severe data sparsity problem, especially when…

Computation and Language · Computer Science 2020-06-16 Su Zhu , Zijian Zhao , Rao Ma , Kai Yu

Spoken language understanding (SLU) systems, such as goal-oriented chatbots or personal assistants, rely on an initial natural language understanding (NLU) module to determine the intent and to extract the relevant information from the user…

Computation and Language · Computer Science 2018-07-10 Mladen Dimovski , Claudiu Musat , Vladimir Ilievski , Andreea Hossmann , Michael Baeriswyl

We propose a new paradigm for zero-shot learners that is format agnostic, i.e., it is compatible with any format and applicable to a list of language tasks, such as text classification, commonsense reasoning, coreference resolution, and…

Computation and Language · Computer Science 2022-10-19 Ping Yang , Junjie Wang , Ruyi Gan , Xinyu Zhu , Lin Zhang , Ziwei Wu , Xinyu Gao , Jiaxing Zhang , Tetsuya Sakai

Zero-shot cross-domain slot filling aims to transfer knowledge from the labeled source domain to the unlabeled target domain. Existing models either encode slot descriptions and examples or design handcrafted question templates using…

Computation and Language · Computer Science 2023-07-07 Xuefeng Li , Liwen Wang , Guanting Dong , Keqing He , Jinzheng Zhao , Hao Lei , Jiachi Liu , Weiran Xu

Intent detection and slot filling are critical tasks in spoken and natural language understanding for task-oriented dialog systems. In this work we describe our participation in the slot and intent detection for low-resource language…

Computation and Language · Computer Science 2023-04-27 Sang Yun Kwon , Gagan Bhatia , El Moatez Billah Nagoudi , Alcides Alcoba Inciarte , Muhammad Abdul-Mageed

Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realistic but challenging…

Computation and Language · Computer Science 2023-12-27 Ayush Kumar , Vijit Malik , Jithendra Vepa

Task-oriented dialog systems increasingly rely on deep learning-based slot filling models, usually needing extensive labeled training data for target domains. Often, however, little to no target domain training data may be available, or the…

Computation and Language · Computer Science 2019-06-18 Darsh J Shah , Raghav Gupta , Amir A Fayazi , Dilek Hakkani-Tur

Spoken language understanding (SLU) typically includes two subtasks: intent detection and slot filling. Currently, it has achieved great success in high-resource languages, but it still remains challenging in low-resource languages due to…

Computation and Language · Computer Science 2023-10-05 Tianjun Mao , Chenghong Zhang

Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slot filling have…

Computation and Language · Computer Science 2022-03-01 Soyeon Caren Han , Siqu Long , Huichun Li , Henry Weld , Josiah Poon

Recent advances in large pretrained language models have increased attention to zero-shot text classification. In particular, models finetuned on natural language inference datasets have been widely adopted as zero-shot classifiers due to…

Computation and Language · Computer Science 2022-11-01 Ariel Gera , Alon Halfon , Eyal Shnarch , Yotam Perlitz , Liat Ein-Dor , Noam Slonim

State-of-the-art slot filling models for goal-oriented human/machine conversational language understanding systems rely on deep learning methods. While multi-task training of such models alleviates the need for large in-domain annotated…

Artificial Intelligence · Computer Science 2017-07-11 Ankur Bapna , Gokhan Tur , Dilek Hakkani-Tur , Larry Heck

The lack of publicly available evaluation data for low-resource languages limits progress in Spoken Language Understanding (SLU). As key tasks like intent classification and slot filling require abundant training data, it is desirable to…

Bootstrapping natural language understanding (NLU) systems with minimal training data is a fundamental challenge of extending digital assistants like Alexa and Siri to a new language. A common approach that is adapted in digital assistants…

Computation and Language · Computer Science 2019-11-18 Shubham Kapoor , Caglar Tirkaz

Conversational NLU providers often need to scale to thousands of intent-classification models where new customers often face the cold-start problem. Scaling to so many customers puts a constraint on storage space as well. In this paper, we…

Computation and Language · Computer Science 2023-05-15 Soham Parikh , Quaizar Vohra , Prashil Tumbade , Mitul Tiwari

A significant shortcoming of current state-of-the-art (SOTA) named-entity recognition (NER) systems is their lack of generalization to unseen domains, which poses a major problem since obtaining labeled data for NER in a new domain is…

Artificial Intelligence · Computer Science 2021-11-16 Nguyen Van Hoang , Soeren Hougaard Mulvad , Dexter Neo Yuan Rong , Yang Yue

Intent detection and slot filling are two fundamental tasks for building a spoken language understanding (SLU) system. Multiple deep learning-based joint models have demonstrated excellent results on the two tasks. In this paper, we propose…

Computation and Language · Computer Science 2021-02-10 Pengfei Wei , Bi Zeng , Wenxiong Liao

Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effective knowledge transfer…

Computation and Language · Computer Science 2021-10-08 Liwen Wang , Xuefeng Li , Jiachi Liu , Keqing He , Yuanmeng Yan , Weiran Xu