English
Related papers

Related papers: An Evaluation Dataset for Intent Classification an…

200 papers

Intent modelling has become an important part of modern dialogue systems. With the rapid expansion of practical dialogue systems and virtual assistants, such as Amazon Alexa, Apple Siri, and Google Assistant, the interest has only…

Computation and Language · Computer Science 2021-05-11 Sindre André Jacobsen , Anton Ragni

Much recent work in task-oriented parsing has focused on finding a middle ground between flat slots and intents, which are inexpressive but easy to annotate, and powerful representations such as the lambda calculus, which are expressive but…

Computation and Language · Computer Science 2022-12-02 Konstantine Arkoudas , Nicolas Guenon des Mesnards , Melanie Rubino , Sandesh Swamy , Saarthak Khanna , Weiqi Sun , Khan Haidar

Task-oriented dialogue systems aim at providing users with task-specific services. Users of such systems often do not know all the information about the task they are trying to accomplish, requiring them to seek information about the task.…

Computation and Language · Computer Science 2023-05-24 Yue Feng , Hossein A. Rahmani , Aldo Lipani , Emine Yilmaz

Conversational systems have a Natural Language Understanding (NLU) module. In this module, there is a task known as an intent classification that aims at identifying what a user is attempting to achieve from an utterance. Previous works use…

Computation and Language · Computer Science 2024-11-12 Jeanfranco D. Farfan-Escobedo , Julio C. Dos Reis

The semantic understanding of natural dialogues composes of several parts. Some of them, like intent classification and entity detection, have a crucial role in deciding the next steps in handling user input. Handling each task as an…

Computation and Language · Computer Science 2021-09-08 Petr Lorenc

Conversational agents are increasingly deployed in knowledge-intensive settings, where correct behavior depends on retrieving and applying domain-specific knowledge from large, proprietary, and unstructured corpora during live interactions…

Artificial Intelligence · Computer Science 2026-03-05 Quan Shi , Alexandra Zytek , Pedram Razavi , Karthik Narasimhan , Victor Barres

The open-source model ecosystem now contains hundreds of thousands of pretrained models, yet picking the best model for a new dataset is increasingly infeasible: new models and unbenchmarked datasets emerge continuously, leaving…

Machine Learning · Computer Science 2026-05-11 Rui Cai , Weijie Jacky Mo , Xiaofei Wen , Qiyao Ma , Wenhui Zhu , Xiwen Chen , Muhao Chen , Zhe Zhao

We introduce a dataset of concept learning tasks that helps uncover implicit biases in large language models. Using in-context concept learning experiments, we found that language models may have a bias toward upward monotonicity in…

Computation and Language · Computer Science 2025-11-27 Leroy Z. Wang

Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results…

Computation and Language · Computer Science 2020-02-17 Akshit Tyagi , Varun Sharma , Rahul Gupta , Lynn Samson , Nan Zhuang , Zihang Wang , Bill Campbell

Modern classification models tend to struggle when the amount of annotated data is scarce. To overcome this issue, several neural few-shot classification models have emerged, yielding significant progress over time, both in Computer Vision…

Computation and Language · Computer Science 2021-01-29 Thomas Dopierre , Christophe Gravier , Wilfried Logerais

Intent classification is a text understanding task that identifies user needs from input text queries. While intent classification has been extensively studied in various domains, it has not received much attention in the music domain. In…

Computation and Language · Computer Science 2024-11-21 Daeyong Kwon , SeungHeon Doh , Juhan Nam

We introduce the task of entity-centric query refinement. Given an input query whose answer is a (potentially large) collection of entities, the task output is a small set of query refinements meant to assist the user in efficient domain…

Computation and Language · Computer Science 2022-09-19 David Wadden , Nikita Gupta , Kenton Lee , Kristina Toutanova

In today's digitally driven world, dialogue systems play a pivotal role in enhancing user interactions, from customer service to virtual assistants. In these dialogues, it is important to identify user's goals automatically to resolve their…

Computation and Language · Computer Science 2024-11-19 Juan A. Rodriguez , Nicholas Botzer , David Vazquez , Christopher Pal , Marco Pedersoli , Issam Laradji

Generating complex multi-turn goal-oriented dialogue agents is a difficult problem that has seen a considerable focus from many leaders in the tech industry, including IBM, Google, Amazon, and Microsoft. This is in large part due to the…

Intent classifiers are vital to the successful operation of virtual agent systems. This is especially so in voice activated systems where the data can be noisy with many ambiguous directions for user intents. Before operation begins, these…

Computation and Language · Computer Science 2022-02-22 Zvi Kons , Aharon Satt , Hong-Kwang Kuo , Samuel Thomas , Boaz Carmeli , Ron Hoory , Brian Kingsbury

Intent classification is an important task in natural language understanding systems. Existing approaches have achieved perfect scores on the benchmark datasets. However they are not suitable for deployment on low-resource devices like…

Computation and Language · Computer Science 2021-01-13 Sudeep Deepak Shivnikar , Himanshu Arora , Harichandana B S S

In recent years, fostered by deep learning technologies and by the high demand for conversational AI, various approaches have been proposed that address the capacity to elicit and understand user's needs in task-oriented dialogue systems.…

Computation and Language · Computer Science 2020-11-03 Samuel Louvan , Bernardo Magnini

Language models have been shown to perform better with an increase in scale on a wide variety of tasks via the in-context learning paradigm. In this paper, we investigate the hypothesis that the ability of a large language model to…

Computation and Language · Computer Science 2023-08-17 Hritik Bansal , Karthik Gopalakrishnan , Saket Dingliwal , Sravan Bodapati , Katrin Kirchhoff , Dan Roth

Since the Transformer architecture emerged, language model development has grown, driven by their promising potential. Releasing these models into production requires properly understanding their behavior, particularly in sensitive domains…

Computation and Language · Computer Science 2024-10-25 Andrea Posada , Daniel Rueckert , Felix Meissen , Philip Müller

Identifying arguments is a necessary prerequisite for various tasks in automated discourse analysis, particularly within contexts such as political debates, online discussions, and scientific reasoning. In addition to theoretical advances…

Computation and Language · Computer Science 2025-05-29 Marc Feger , Katarina Boland , Stefan Dietze