English
Related papers

Related papers: GOLD: Improving Out-of-Scope Detection in Dialogue…

200 papers

For most intelligent assistant systems, it is essential to have a mechanism that detects out-of-domain (OOD) utterances automatically to handle noisy input properly. One typical approach would be introducing a separate class that contains…

Computation and Language · Computer Science 2020-03-30 Yueqi Feng , Jiali Lin

Neural dialog models often lack robustness to anomalous user input and produce inappropriate responses which leads to frustrating user experience. Although there are a set of prior approaches to out-of-domain (OOD) utterance detection, they…

Computation and Language · Computer Science 2019-05-27 Sungjin Lee , Igor Shalyminov

Out-of-scope (OOS) intent detection is a critical challenge in task-oriented dialogue systems (TODS), as it ensures robustness to unseen and ambiguous queries. In this work, we propose a novel but simple modular framework that combines…

Computation and Language · Computer Science 2025-07-03 Álvaro Zaera , Diana Nicoleta Popa , Ivan Sekulic , Paolo Rosso

Natural Language Understanding (NLU) is a vital component of dialogue systems, and its ability to detect Out-of-Domain (OOD) inputs is critical in practical applications, since the acceptance of the OOD input that is unsupported by the…

Computation and Language · Computer Science 2022-05-25 Yinhe Zheng , Guanyi Chen , Minlie Huang

Knowledge distillation from LLMs is essential for the efficient deployment of language models. Prior works have proposed data generation using LLMs for preparing distilled models. We argue that generating data with LLMs is prone to sampling…

Computation and Language · Computer Science 2024-04-01 Mohsen Gholami , Mohammad Akbari , Cindy Hu , Vaden Masrani , Z. Jane Wang , Yong Zhang

Conversational agents are usually designed for closed-world environments. Unfortunately, users can behave unexpectedly. Based on the open-world environment, we often encounter the situation that the training and test data are sampled from…

Computation and Language · Computer Science 2022-04-25 Petr Lorenc , Tommaso Gargiani , Jan Pichl , Jakub Konrád , Petr Marek , Ondřej Kobza , Jan Šedivý

Detecting out-of-scope (OOS) user utterances remains a key challenge in task-oriented dialogue systems and, more broadly, in open-set intent recognition. Existing approaches often depend on strong distributional assumptions or auxiliary…

Computation and Language · Computer Science 2025-10-17 Wael Rashwan , Hossam M. Zawbaa , Sourav Dutta , Haytham Assem

Despite graph neural networks' (GNNs) great success in modelling graph-structured data, out-of-distribution (OOD) test instances still pose a great challenge for current GNNs. One of the most effective techniques to detect OOD nodes is to…

Machine Learning · Computer Science 2025-04-11 Danny Wang , Ruihong Qiu , Guangdong Bai , Zi Huang

Out-of-distribution (OOD) detection in multimodal contexts is essential for identifying deviations in combined inputs from different modalities, particularly in applications like open-domain dialogue systems or real-life dialogue…

Computation and Language · Computer Science 2024-11-01 Rena Gao , Xuetong Wu , Siwen Luo , Caren Han , Feng Liu

Recent advances in open-domain dialogue systems rely on the success of neural models that are trained on large-scale data. However, collecting large-scale dialogue data is usually time-consuming and labor-intensive. To address this data…

Computation and Language · Computer Science 2020-11-11 Rongsheng Zhang , Yinhe Zheng , Jianzhi Shao , Xiaoxi Mao , Yadong Xi , Minlie Huang

Out-of-stock (OOS) detection is a very important retail verification process that aims to infer the unavailability of products in their designated areas on the shelf. In this paper, we introduce OOS-DSD, a novel deep learning-based method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Franko Šikić , Sven Lončarić

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

Out of Scope (OOS) detection in Conversational AI solutions enables a chatbot to handle a conversation gracefully when it is unable to make sense of the end-user query. Accurately tagging a query as out-of-domain is particularly hard in…

Computation and Language · Computer Science 2023-01-18 Cheng Qian , Haode Qi , Gengyu Wang , Ladislav Kunc , Saloni Potdar

Detecting an Out-of-Domain (OOD) utterance is crucial for a robust dialog system. Most dialog systems are trained on a pool of annotated OOD data to achieve this goal. However, collecting the annotated OOD data for a given domain is an…

Computation and Language · Computer Science 2021-04-07 Petr Marek , Vishal Ishwar Naik , Vincent Auvray , Anuj Goyal

While pre-trained large-scale deep models have garnered attention as an important topic for many downstream natural language processing (NLP) tasks, such models often make unreliable predictions on out-of-distribution (OOD) inputs. As such,…

Computation and Language · Computer Science 2022-10-18 Dhanasekar Sundararaman , Nikhil Mehta , Lawrence Carin

Out-of-distribution (OOD) object detection is a critical task focused on detecting objects that originate from a data distribution different from that of the training data. In this study, we investigate to what extent state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Sadia Ilyas , Ido Freeman , Matthias Rottmann

Out-of-distribution (OOD) detection has seen significant advancements with zero-shot approaches by leveraging the powerful Vision-Language Models (VLMs) such as CLIP. However, prior research works have predominantly focused on enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Pei-Kang Lee , Jun-Cheng Chen , Ja-Ling Wu

How can models effectively detect out-of-distribution (OOD) samples in complex, multi-label settings without extensive retraining? Existing OOD detection methods struggle to capture the intricate semantic relationships and label…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhendong Liu , Yi Nian , Yuehan Qin , Henry Peng Zou , Li Li , Xiyang Hu , Yue Zhao

Open-world classification systems should discern out-of-distribution (OOD) data whose labels deviate from those of in-distribution (ID) cases, motivating recent studies in OOD detection. Advanced works, despite their promising progress, may…

Machine Learning · Computer Science 2023-12-27 Qizhou Wang , Zhen Fang , Yonggang Zhang , Feng Liu , Yixuan Li , Bo Han

Out-of-Vocabulary (OOV) is a problem for Neural Machine Translation (NMT). OOV refers to words with a low occurrence in the training data, or to those that are absent from the training data. To alleviate this, word or phrase-based Data…

Computation and Language · Computer Science 2022-05-19 Aloka Fernando , Surangika Ranathunga
‹ Prev 1 2 3 10 Next ›