English
Related papers

Related papers: Discovering New Intents Using Latent Variables

200 papers

Answer selection in open-domain dialogues aims to select an accurate answer from candidates. Recent success of answer selection models hinges on training with large amounts of labeled data. However, collecting large-scale labeled data is…

Computation and Language · Computer Science 2023-07-14 Wentao Deng , Jiahuan Pei , Zhaochun Ren , Zhumin Chen , Pengjie Ren

In the constant updates of the product dialogue systems, we need to retrain the natural language understanding (NLU) model as new data from the real users would be merged into the existent data accumulated in the last updates. Within the…

Computation and Language · Computer Science 2023-05-25 Zefan Cai , Xin Zheng , Tianyu Liu , Xu Wang , Haoran Meng , Jiaqi Han , Gang Yuan , Binghuai Lin , Baobao Chang , Yunbo Cao

Identifying the unknown (novel) user intents that have never appeared in the training set is a challenging task in the dialogue system. In this paper, we present a two-stage method for detecting unknown intents. We use bidirectional long…

Computation and Language · Computer Science 2019-06-04 Ting-En Lin , Hua Xu

Intent modelling has become an important part of modern dialogue systems. With the rapid expansion of practical dialogue systems and virtual assistants, such as Amazon Alexa, Apple Siri, and Google Assistant, the interest has only…

Computation and Language · Computer Science 2021-05-11 Sindre André Jacobsen , Anton Ragni

The rapidly growing market demand for automatic dialogue agents capable of goal-oriented behavior has caused many tech-industry leaders to invest considerable efforts into task-oriented dialog systems. The success of these systems is highly…

Computation and Language · Computer Science 2022-10-25 Ella Rabinovich , Matan Vetzler , David Boaz , Vineet Kumar , Gaurav Pandey , Ateret Anaby-Tavor

Traditional intent classification models are based on a pre-defined intent set and only recognize limited in-domain (IND) intent classes. But users may input out-of-domain (OOD) queries in a practical dialogue system. Such OOD queries can…

Computation and Language · Computer Science 2022-09-14 Yutao Mou , Keqing He , Yanan Wu , Pei Wang , Jingang Wang , Wei Wu , Yi Huang , Junlan Feng , Weiran Xu

Open intent classification, which aims to correctly classify the known intents into their corresponding classes while identifying the new unknown (open) intents, is an essential but challenging task in dialogue systems. In this paper, we…

Computation and Language · Computer Science 2023-04-21 Xiaokang Liu , Jianquan Li , Jingjing Mu , Min Yang , Ruifeng Xu , Benyou Wang

Recently several deep learning based models have been proposed for end-to-end learning of dialogs. While these models can be trained from data without the need for any additional annotations, it is hard to interpret them. On the other hand,…

Artificial Intelligence · Computer Science 2018-11-05 Dhiraj Madan , Dinesh Raghu , Gaurav Pandey , Sachindra Joshi

Most dialogue systems in real world rely on predefined intents and answers for QA service, so discovering potential intents from large corpus previously is really important for building such dialogue services. Considering that most…

Machine Learning · Computer Science 2022-01-20 Feng Wei , Zhenbo Chen , Zhenghong Hao , Fengxin Yang , Hua Wei , Bing Han , Sheng Guo

Deriving value from a conversational AI system depends on the capacity of a user to translate the prior knowledge into a configuration. In most cases, discovering the set of relevant turn-level speaker intents is often one of the key steps.…

Computation and Language · Computer Science 2024-10-22 Mrinal Rawat , Hithesh Sankararaman , Victor Barres

Automatically and accurately identifying user intents and filling the associated slots from their spoken language are critical to the success of dialogue systems. Traditional methods require manually defining the DOMAIN-INTENT-SLOT schema…

Artificial Intelligence · Computer Science 2021-03-17 Zengfeng Zeng , Dan Ma , Haiqin Yang , Zhen Gou , Jianping Shen

Goal-conditioned planning benefits from learned low-dimensional representations of rich observations. While compact latent representations typically learned from variational autoencoders or inverse dynamics enable goal-conditioned decision…

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

Open intent classification is a challenging task in dialogue systems. On the one hand, it should ensure the quality of known intent identification. On the other hand, it needs to detect the open (unknown) intent without prior knowledge.…

Computation and Language · Computer Science 2023-04-24 Hanlei Zhang , Hua Xu , Ting-En Lin

The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences…

Machine Learning · Computer Science 2019-11-25 Thibault Duhamel , Mariane Maynard , Froduald Kabanza

Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recognition models and dialog policy learning algorithms. The…

Computation and Language · Computer Science 2019-12-24 Saurav Sahay , Shachi H Kumar , Eda Okur , Haroon Syed , Lama Nachman

Intent classification is a task in spoken language understanding. An intent classification system is usually implemented as a pipeline process, with a speech recognition module followed by text processing that classifies the intents. There…

Computation and Language · Computer Science 2021-02-16 Bidisha Sharma , Maulik Madhavi , Haizhou Li

Compute scaling for language model (LM) pretraining has outpaced the growth of human-written texts, leading to concerns that data will become the bottleneck to LM scaling. To continue scaling pretraining in this data-constrained regime, we…

Machine Learning · Computer Science 2025-09-30 Yangjun Ruan , Neil Band , Chris J. Maddison , Tatsunori Hashimoto

The recent advances in transfer learning techniques and pre-training of large contextualized encoders foster innovation in real-life applications, including dialog assistants. Practical needs of intent recognition require effective data…

Computation and Language · Computer Science 2022-06-23 Dmitry Lamanov , Pavel Burnyshev , Ekaterina Artemova , Valentin Malykh , Andrey Bout , Irina Piontkovskaya

Open intent classification is a practical yet challenging task in dialogue systems. Its objective is to accurately classify samples of known intents while at the same time detecting those of open (unknown) intents. Existing methods usually…

Computation and Language · Computer Science 2022-05-10 Zifeng Cheng , Zhiwei Jiang , Yafeng Yin , Cong Wang , Qing Gu