English
Related papers

Related papers: CG-BERT: Conditional Text Generation with BERT for…

200 papers

In a practical dialogue system, users may input out-of-domain (OOD) queries. The Generalized Intent Discovery (GID) task aims to discover OOD intents from OOD queries and extend them to the in-domain (IND) classifier. However, GID only…

Computation and Language · Computer Science 2023-10-17 Xiaoshuai Song , Yutao Mou , Keqing He , Yueyan Qiu , Pei Wang , Weiran Xu

Zero-shot intent detection (ZSID) aims to deal with the continuously emerging intents without annotated training data. However, existing ZSID systems suffer from two limitations: 1) They are not good at modeling the relationship between…

Computation and Language · Computer Science 2021-06-10 Qingyi Si , Yuanxin Liu , Peng Fu , Zheng Lin , Jiangnan Li , Weiping Wang

BERT is a popular language model whose main pre-training task is to fill in the blank, i.e., predicting a word that was masked out of a sentence, based on the remaining words. In some applications, however, having an additional context can…

Computation and Language · Computer Science 2020-10-30 Timo I. Denk , Ana Peleteiro Ramallo

Most existing studies on few-shot learning focus on unimodal settings, where models are trained to generalize to unseen data using a limited amount of labeled examples from a single modality. However, real-world data are inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zhengwei Yang , Yuke Li , Qiang Sun , Basura Fernando , Heng Huang , Zheng Wang

Training semantic segmentation models requires a large amount of finely annotated data, making it hard to quickly adapt to novel classes not satisfying this condition. Few-Shot Segmentation (FS-Seg) tackles this problem with many…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Zhuotao Tian , Xin Lai , Li Jiang , Shu Liu , Michelle Shu , Hengshuang Zhao , Jiaya Jia

Providing pretrained language models with simple task descriptions in natural language enables them to solve some tasks in a fully unsupervised fashion. Moreover, when combined with regular learning from examples, this idea yields…

Computation and Language · Computer Science 2021-10-05 Timo Schick , Hinrich Schütze

Transformer-based language models have achieved significant success in various domains. However, the data-intensive nature of the transformer architecture requires much labeled data, which is challenging in low-resource scenarios (i.e.,…

Traditional intent classification models are based on a pre-defined intent set and only recognize limited in-domain (IND) intent classes. But users may input out-of-domain (OOD) queries in a practical dialogue system. Such OOD queries can…

Computation and Language · Computer Science 2022-09-14 Yutao Mou , Keqing He , Yanan Wu , Pei Wang , Jingang Wang , Wei Wu , Yi Huang , Junlan Feng , Weiran Xu

Spoken intent detection has become a popular approach to interface with various smart devices with ease. However, such systems are limited to the preset list of intents-terms or commands, which restricts the quick customization of personal…

Computation and Language · Computer Science 2021-06-30 Ashish Mittal , Samarth Bharadwaj , Shreya Khare , Saneem Chemmengath , Karthik Sankaranarayanan , Brian Kingsbury

A key challenge of dialog systems research is to effectively and efficiently adapt to new domains. A scalable paradigm for adaptation necessitates the development of generalizable models that perform well in few-shot settings. In this…

Computation and Language · Computer Science 2021-05-26 Shikib Mehri , Mihail Eric

Dialogue systems need to deal with the unpredictability of user intents to track dialogue state and the heterogeneity of slots to understand user preferences. In this paper we investigate the hypothesis that solving these challenges as one…

Computation and Language · Computer Science 2023-08-14 Diogo Tavares , Pedro Azevedo , David Semedo , Ricardo Sousa , João Magalhães

Recent joint intent detection and slot tagging models have seen improved performance when compared to individual models. In many real-world datasets, the slot labels and values have a strong correlation with their intent labels. In such…

Computation and Language · Computer Science 2022-05-24 Shruthi Hariharan , Vignesh Kumar Krishnamurthy , Utkarsh , Jayantha Gowda Sarapanahalli

We consider the task of few-shot intent detection, which involves training a deep learning model to classify utterances based on their underlying intents using only a small amount of labeled data. The current approach to address this…

Computation and Language · Computer Science 2024-09-17 Haode Zhang , Haowen Liang , Liming Zhan , Albert Y. S. Lam , Xiao-Ming Wu

Few-shot Intent Detection is challenging due to the scarcity of available annotated utterances. Although recent works demonstrate that multi-level matching plays an important role in transferring learned knowledge from seen training classes…

Computation and Language · Computer Science 2020-10-13 Hoang Nguyen , Chenwei Zhang , Congying Xia , Philip S. Yu

Identifying user intents from natural language utterances is a crucial step in conversational systems that has been extensively studied as a supervised classification problem. However, in practice, new intents emerge after deploying an…

Computation and Language · Computer Science 2021-02-08 A. B. Siddique , Fuad Jamour , Luxun Xu , Vagelis Hristidis

Few-shot learning (FSL), purposing to resolve the problem of data-scarce, has attracted considerable attention in recent years. A popular FSL framework contains two phases: (i) the pre-train phase employs the base data to train a CNN-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Rui Xu , Lei Xing , Shuai Shao , Lifei Zhao , Baodi Liu , Weifeng Liu , Yicong Zhou

Abusive language is a concerning problem in online social media. Past research on detecting abusive language covers different platforms, languages, demographies, etc. However, models trained using these datasets do not perform well in…

Computation and Language · Computer Science 2023-07-31 Punyajoy Saha , Divyanshu Sheth , Kushal Kedia , Binny Mathew , Animesh Mukherjee

Intent discovery is a crucial task in natural language processing, and it is increasingly relevant for various of industrial applications. Identifying novel, unseen intents from user inputs remains one of the biggest challenges in this…

Computation and Language · Computer Science 2023-12-11 Daniele Comi , Dimitrios Christofidellis , Pier Francesco Piazza , Matteo Manica

We present a systematic study on multilingual and cross-lingual intent detection from spoken data. The study leverages a new resource put forth in this work, termed MInDS-14, a first training and evaluation resource for the intent detection…

Computation and Language · Computer Science 2021-04-20 Daniela Gerz , Pei-Hao Su , Razvan Kusztos , Avishek Mondal , Michał Lis , Eshan Singhal , Nikola Mrkšić , Tsung-Hsien Wen , Ivan Vulić

Aspect-based sentiment analysis (ABSA) and Targeted ASBA (TABSA) allow finer-grained inferences about sentiment to be drawn from the same text, depending on context. For example, a given text can have different targets (e.g., neighborhoods)…

Computation and Language · Computer Science 2020-12-15 Zhengxuan Wu , Desmond C. Ong