English
Related papers

Related papers: GOLD: Improving Out-of-Scope Detection in Dialogue…

200 papers

Detecting out-of-distribution (OOD) samples is essential when deploying machine learning models in open-world scenarios. Zero-shot OOD detection, requiring no training on in-distribution (ID) data, has been possible with the advent of…

Machine Learning · Computer Science 2024-06-04 Chentao Cao , Zhun Zhong , Zhanke Zhou , Yang Liu , Tongliang Liu , Bo Han

Dialogue generation models face the challenge of producing generic and repetitive responses. Unlike previous augmentation methods that mostly focus on token manipulation and ignore the essential variety within a single sample using hard…

Computation and Language · Computer Science 2021-03-03 Yu Cao , Liang Ding , Zhiliang Tian , Meng Fang

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Out-of-Distribution (OOD) detection is essential for the trustworthiness of AI systems. Methods using prior information (i.e., subspace-based methods) have shown effective performance by extracting information geometry to detect OOD data…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Kaiyu Guo , Zijian Wang , Tan Pan , Brian C. Lovell , Mahsa Baktashmotlagh

Collecting data for training dialog systems can be extremely expensive due to the involvement of human participants and need for extensive annotation. Especially in document-grounded dialog systems, human experts need to carefully read the…

Computation and Language · Computer Science 2021-12-16 Qingyang Wu , Song Feng , Derek Chen , Sachindra Joshi , Luis A. Lastras , Zhou Yu

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Understanding open-world semantics is critical for robotic planning and control, particularly in unstructured outdoor environments. Existing vision-language mapping approaches typically rely on object-centric segmentation priors, which…

Robotics · Computer Science 2025-09-23 Simon Schwaiger , Stefan Thalhammer , Wilfried Wöber , Gerald Steinbauer-Wagner

Recommendation systems (RS) are an increasingly relevant area for both academic and industry researchers, given their widespread impact on the daily online experiences of billions of users. One common issue in real RS is the cold-start…

Information Retrieval · Computer Science 2024-03-28 William Shiao , Mingxuan Ju , Zhichun Guo , Xin Chen , Evangelos Papalexakis , Tong Zhao , Neil Shah , Yozen Liu

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Haoyue Bai

Lack of training data presents a grand challenge to scaling out spoken language understanding (SLU) to low-resource languages. Although various data augmentation approaches have been proposed to synthesize training data in low-resource…

Computation and Language · Computer Science 2021-09-06 Yingmei Guo , Linjun Shou , Jian Pei , Ming Gong , Mingxing Xu , Zhiyong Wu , Daxin Jiang

Dealing with previously unseen slots is a challenging problem in a real-world multi-domain dialogue state tracking task. Other approaches rely on predefined mappings to generate candidate slot keys, as well as their associated values. This,…

Machine Learning · Computer Science 2019-08-28 Adrian de Wynter , Lambert Mathias

Advancing Machine Learning (ML)-based perception models for autonomous systems necessitates addressing weak spots within the models, particularly in challenging Operational Design Domains (ODDs). These are environmental operating conditions…

Machine Learning · Computer Science 2024-09-02 Ahmed Hammam , Bharathwaj Krishnaswami Sreedhar , Nura Kawa , Tim Patzelt , Oliver De Candido

Most statistical machine translation systems cannot translate words that are unseen in the training data. However, humans can translate many classes of out-of-vocabulary (OOV) words (e.g., novel morphological variants, misspellings, and…

Computation and Language · Computer Science 2018-08-20 Nelson F. Liu , Jonathan May , Michael Pust , Kevin Knight

While Out-of-distribution (OOD) detection has been well explored in computer vision, there have been relatively few prior attempts in OOD detection for NLP classification. In this paper we argue that these prior attempts do not fully…

Artificial Intelligence · Computer Science 2021-11-09 Mrinal Rawat , Ramya Hebbalaguppe , Lovekesh Vig

Existing vision-language models exhibit strong generalization on a variety of visual domains and tasks. However, such models mainly perform zero-shot recognition in a closed-set manner, and thus struggle to handle open-domain visual…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yuhang Zang , Hanlin Goh , Josh Susskind , Chen Huang

Out-of-distribution (OOD) detection, which maps high-dimensional data into a scalar OOD score, is critical for the reliable deployment of machine learning models. A key challenge in recent research is how to effectively leverage and…

Machine Learning · Computer Science 2026-02-06 Claus Hofmann , Christian Huber , Bernhard Lehner , Daniel Klotz , Sepp Hochreiter , Werner Zellinger

While several state-of-the-art approaches to dialogue state tracking (DST) have shown promising performances on several benchmarks, there is still a significant performance gap between seen slot values (i.e., values that occur in both…

Computation and Language · Computer Science 2020-02-25 Xiaohui Song , Liangjun Zang , Yipeng Su , Xing Wu , Jizhong Han , Songlin Hu

Knowledge distillation optimises a smaller student model to behave similarly to a larger teacher model, retaining some of the performance benefits. While this method can improve results on in-distribution examples, it does not necessarily…

Computation and Language · Computer Science 2024-07-26 Joe Stacey , Marek Rei

Recent successes of artificial intelligence and deep learning often depend on the well-collected training dataset which is assumed to have an identical distribution with the test dataset. However, this assumption, which is called closed-set…

Artificial Intelligence · Computer Science 2025-01-14 Eui-Soo Jung , Hae-Hun Seo , Hyun-Woo Jung , Je-Geon Oh , Yoon-Yeong Kim

Overlapped speech detection (OSD) is critical for speech applications in scenario of multi-party conversion. Despite numerous research efforts and progresses, comparing with speech activity detection (VAD), OSD remains an open challenge and…

Sound · Computer Science 2022-09-27 Ziqing Du , Kai Liu , Xucheng Wan , Huan Zhou