English
Related papers

Related papers: Generating Hard-Negative Out-of-Scope Data with Ch…

200 papers

Task oriented language understanding in dialog systems is often modeled using intents (task of a query) and slots (parameters for that task). Intent detection and slot tagging are, in turn, modeled using sentence classification and word…

Computation and Language · Computer Science 2019-11-14 Arash Einolghozati , Sonal Gupta , Mrinal Mohit , Rushin Shah

User intent detection plays a critical role in question-answering and dialog systems. Most previous works treat intent detection as a classification problem where utterances are labeled with predefined intents. However, it is…

Computation and Language · Computer Science 2018-09-05 Congying Xia , Chenwei Zhang , Xiaohui Yan , Yi Chang , Philip S. Yu

User queries for a real-world dialog system may sometimes fall outside the scope of the system's capabilities, but appropriate system responses will enable smooth processing throughout the human-computer interaction. This paper is concerned…

Computation and Language · Computer Science 2021-12-15 Pengfei Liu , Kun Li , Helen Meng

Practical dialogue systems require robust methods of detecting out-of-scope (OOS) utterances to avoid conversational breakdowns and related failure modes. Directly training a model with labeled OOS examples yields reasonable performance,…

Computation and Language · Computer Science 2021-09-08 Derek Chen , Zhou Yu

Traditional intent classification models are based on a pre-defined intent set and only recognize limited in-domain (IND) intent classes. But users may input out-of-domain (OOD) queries in a practical dialogue system. Such OOD queries can…

Computation and Language · Computer Science 2022-09-14 Yutao Mou , Keqing He , Yanan Wu , Pei Wang , Jingang Wang , Wei Wu , Yi Huang , Junlan Feng , Weiran Xu

Hate speech is a severe issue that affects many online platforms. So far, several studies have been performed to develop robust hate speech detection systems. Large language models like ChatGPT have recently shown a great promise in…

Computation and Language · Computer Science 2023-05-24 Mithun Das , Saurabh Kumar Pandey , Animesh Mukherjee

Data augmentation is a widely employed technique to alleviate the problem of data scarcity. In this work, we propose a prompting-based approach to generate labelled training data for intent classification with off-the-shelf language models…

Computation and Language · Computer Science 2022-04-06 Gaurav Sahu , Pau Rodriguez , Issam H. Laradji , Parmida Atighehchian , David Vazquez , Dzmitry Bahdanau

Intent detection is one of the core components of goal-oriented dialog systems, and detecting out-of-scope (OOS) intents is also a practically important skill. Few-shot learning is attracting much attention to mitigate data scarcity, but…

Computation and Language · Computer Science 2020-10-27 Jian-Guo Zhang , Kazuma Hashimoto , Wenhao Liu , Chien-Sheng Wu , Yao Wan , Philip S. Yu , Richard Socher , Caiming Xiong

Out-of-Domain (OOD) intent detection is important for practical dialog systems. To alleviate the issue of lacking OOD training samples, some works propose synthesizing pseudo OOD samples and directly assigning one-hot OOD labels to these…

Computation and Language · Computer Science 2022-11-11 Hao Lang , Yinhe Zheng , Jian Sun , Fei Huang , Luo Si , Yongbin Li

Goal oriented dialogue systems have become a prominent customer-care interaction channel for most businesses. However, not all interactions are smooth, and customer intent misunderstanding is a major cause of dialogue failure. We show that…

Computation and Language · Computer Science 2021-10-26 Eyal Ben-David , Boaz Carmeli , Ateret Anaby-Tavor

Since state-of-the-art approaches to offensive language detection rely on supervised learning, it is crucial to quickly adapt them to the continuously evolving scenario of social media. While several approaches have been proposed to tackle…

Computation and Language · Computer Science 2022-10-17 Elisa Leonardelli , Stefano Menini , Alessio Palmero Aprosio , Marco Guerini , Sara Tonelli

Detecting out-of-scope (OOS) user utterances remains a key challenge in task-oriented dialogue systems and, more broadly, in open-set intent recognition. Existing approaches often depend on strong distributional assumptions or auxiliary…

Computation and Language · Computer Science 2025-10-17 Wael Rashwan , Hossam M. Zawbaa , Sourav Dutta , Haytham Assem

In today's digitally driven world, dialogue systems play a pivotal role in enhancing user interactions, from customer service to virtual assistants. In these dialogues, it is important to identify user's goals automatically to resolve their…

Computation and Language · Computer Science 2024-11-19 Juan A. Rodriguez , Nicholas Botzer , David Vazquez , Christopher Pal , Marco Pedersoli , Issam Laradji

ChatGPT is an AI language model developed by OpenAI that can understand and generate human-like text. It can be used for a variety of use cases such as language generation, question answering, text summarization, chatbot development,…

Human-Computer Interaction · Computer Science 2023-10-09 Ishika Joshi , Ritvik Budhiraja , Harshal Dev , Jahnvi Kadia , M. Osama Ataullah , Sayan Mitra , Dhruv Kumar , Harshal D. Akolekar

A key challenge of dialog systems research is to effectively and efficiently adapt to new domains. A scalable paradigm for adaptation necessitates the development of generalizable models that perform well in few-shot settings. In this…

Computation and Language · Computer Science 2021-05-26 Shikib Mehri , Mihail Eric

Out-of-Domain (OOD) intent detection is vital for practical dialogue systems, and it usually requires considering multi-turn dialogue contexts. However, most previous OOD intent detection approaches are limited to single dialogue turns. In…

Computation and Language · Computer Science 2024-02-26 Hao Lang , Yinhe Zheng , Binyuan Hui , Fei Huang , Yongbin Li

Existing prompt learning methods have shown certain capabilities in Out-of-Distribution (OOD) detection, but the lack of OOD images in the target dataset in their training can lead to mismatches between OOD images and In-Distribution (ID)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Tianqi Li , Guansong Pang , Xiao Bai , Wenjun Miao , Jin Zheng

Pre-trained large language models, such as ChatGPT, archive outstanding performance in various reasoning tasks without supervised training and were found to have outperformed crowdsourcing workers. Nonetheless, ChatGPT's performance in the…

Computation and Language · Computer Science 2024-02-08 Frances Yung , Mansoor Ahmad , Merel Scholman , Vera Demberg

Many real-world tasks involve a mixed-initiative setup, wherein humans and AI systems collaboratively perform a task. While significant work has been conducted towards enabling humans to specify, through language, exactly how an agent…

Artificial Intelligence · Computer Science 2023-10-24 Pradyumna Tambwekar , Lakshita Dodeja , Nathan Vaska , Wei Xu , Matthew Gombolay

Detecting an Out-of-Domain (OOD) utterance is crucial for a robust dialog system. Most dialog systems are trained on a pool of annotated OOD data to achieve this goal. However, collecting the annotated OOD data for a given domain is an…

Computation and Language · Computer Science 2021-04-07 Petr Marek , Vishal Ishwar Naik , Vincent Auvray , Anuj Goyal