English
Related papers

Related papers: OutFlip: Generating Out-of-Domain Samples for Unkn…

200 papers

Natural Language Understanding (NLU) is a vital component of dialogue systems, and its ability to detect Out-of-Domain (OOD) inputs is critical in practical applications, since the acceptance of the OOD input that is unsupported by the…

Computation and Language · Computer Science 2022-05-25 Yinhe Zheng , Guanyi Chen , Minlie Huang

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

In many real-world settings, machine learning models need to identify user inputs that are out-of-domain (OOD) so as to avoid performing wrong actions. This work focuses on a challenging case of OOD detection, where no labels for in-domain…

Computation and Language · Computer Science 2022-03-23 Di Jin , Shuyang Gao , Seokhwan Kim , Yang Liu , Dilek Hakkani-Tur

Out-of-scope intent detection is of practical importance in task-oriented dialogue systems. Since the distribution of outlier utterances is arbitrary and unknown in the training stage, existing methods commonly rely on strong assumptions on…

Computation and Language · Computer Science 2021-06-18 Li-Ming Zhan , Haowen Liang , Bo Liu , Lu Fan , Xiao-Ming Wu , Albert Y. S. Lam

Intent Detection is one of the tasks of the Natural Language Understanding (NLU) unit in task-oriented dialogue systems. Out of Scope (OOS) and Out of Domain (OOD) inputs may run these systems into a problem. On the other side, a labeled…

Computation and Language · Computer Science 2023-08-01 Masoud Akbari , Ali Mohades , M. Hassan Shirali-Shahreza

The task of identifying out-of-domain (OOD) input examples directly at test-time has seen renewed interest recently due to increased real world deployment of models. In this work, we focus on OOD detection for natural language sentence…

Computation and Language · Computer Science 2020-01-01 Varun Gangal , Abhinav Arora , Arash Einolghozati , Sonal Gupta

The ability to detect Out-of-Domain (OOD) inputs has been a critical requirement in many real-world NLP applications. For example, intent classification in dialogue systems. The reason is that the inclusion of unsupported OOD inputs may…

Computation and Language · Computer Science 2022-01-20 Iftitahu Ni'mah , Meng Fang , Vlado Menkovski , Mykola Pechenizkiy

Out-of-Domain (OOD) intent detection is vital for practical dialogue systems, and it usually requires considering multi-turn dialogue contexts. However, most previous OOD intent detection approaches are limited to single dialogue turns. In…

Computation and Language · Computer Science 2024-02-26 Hao Lang , Yinhe Zheng , Binyuan Hui , Fei Huang , Yongbin Li

Neural dialog models often lack robustness to anomalous user input and produce inappropriate responses which leads to frustrating user experience. Although there are a set of prior approaches to out-of-domain (OOD) utterance detection, they…

Computation and Language · Computer Science 2019-05-27 Sungjin Lee , Igor Shalyminov

Spread of fake news using out-of-context images and captions has become widespread in this era of information overload. Since fake news can belong to different domains like politics, sports, etc. with their unique characteristics, inference…

Machine Learning · Computer Science 2025-01-08 Amartya Bhattacharya , Debarshi Brahma , Suraj Nagaje Mahadev , Anmol Asati , Vikas Verma , Soma Biswas

For most intelligent assistant systems, it is essential to have a mechanism that detects out-of-domain (OOD) utterances automatically to handle noisy input properly. One typical approach would be introducing a separate class that contains…

Computation and Language · Computer Science 2020-03-30 Yueqi Feng , Jiali Lin

Deployed real-world machine learning applications are often subject to uncontrolled and even potentially malicious inputs. Those out-of-domain inputs can lead to unpredictable outputs and sometimes catastrophic safety issues. Prior studies…

Computation and Language · Computer Science 2022-05-23 Keyang Xu , Tongzheng Ren , Shikun Zhang , Yihao Feng , Caiming Xiong

Conversational agents are usually designed for closed-world environments. Unfortunately, users can behave unexpectedly. Based on the open-world environment, we often encounter the situation that the training and test data are sampled from…

Computation and Language · Computer Science 2022-04-25 Petr Lorenc , Tommaso Gargiani , Jan Pichl , Jakub Konrád , Petr Marek , Ondřej Kobza , Jan Šedivý

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. Traditional softmax-based confidence scores are susceptible to the overconfidence issue. In this paper, we propose a simple…

Computation and Language · Computer Science 2022-10-18 Yanan Wu , Zhiyuan Zeng , Keqing He , Yutao Mou , Pei Wang , Yuanmeng Yan , Weiran Xu

Out-of-domain (OOD) intent detection aims to examine whether the user's query falls outside the predefined domain of the system, which is crucial for the proper functioning of task-oriented dialogue (TOD) systems. Previous methods address…

Computation and Language · Computer Science 2024-03-05 Pei Wang , Keqing He , Yejie Wang , Xiaoshuai Song , Yutao Mou , Jingang Wang , Yunsen Xian , Xunliang Cai , Weiran Xu

Out-of-Domain (OOD) intent detection is important for practical dialog systems. To alleviate the issue of lacking OOD training samples, some works propose synthesizing pseudo OOD samples and directly assigning one-hot OOD labels to these…

Computation and Language · Computer Science 2022-11-11 Hao Lang , Yinhe Zheng , Jian Sun , Fei Huang , Luo Si , Yongbin Li

Out-of-distribution (OOD) detection aims to discern outliers from the intended data distribution, which is crucial to maintaining high reliability and a good user experience. Most recent studies in OOD detection utilize the information from…

Computation and Language · Computer Science 2022-10-21 Hyunsoo Cho , Choonghyun Park , Jaewook Kang , Kang Min Yoo , Taeuk Kim , Sang-goo Lee

Out-of-Distribution (OOD) detection is a critical task that has garnered significant attention. The emergence of CLIP has spurred extensive research into zero-shot OOD detection, often employing a training-free approach. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haoran Xu , Yanlin Liu , Zizhao Tong , Jiaze Li , Kexue Fu , Yuyang Zhang , Longxiang Gao , Shuaiguang Li , Xingyu Li , Yanran Xu , Changwei Wang

Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task. The goal is to detect the OOD cases with limited in-domain (ID) training data, since we observe that training data is often…

Computation and Language · Computer Science 2019-09-13 Ming Tan , Yang Yu , Haoyu Wang , Dakuo Wang , Saloni Potdar , Shiyu Chang , Mo Yu

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

Computation and Language · Computer Science 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li
‹ Prev 1 2 3 10 Next ›