English
Related papers

Related papers: Zero-Shot Slot and Intent Detection in Low-Resourc…

200 papers

Intent discovery is a crucial task in natural language processing, and it is increasingly relevant for various of industrial applications. Identifying novel, unseen intents from user inputs remains one of the biggest challenges in this…

Computation and Language · Computer Science 2023-12-11 Daniele Comi , Dimitrios Christofidellis , Pier Francesco Piazza , Matteo Manica

This paper describes the SLT-CDT-UoS group's submission to the first Special Task on Formality Control for Spoken Language Translation, part of the IWSLT 2022 Evaluation Campaign. Our efforts were split between two fronts: data engineering…

Computation and Language · Computer Science 2022-05-13 Sebastian T. Vincent , Loïc Barrault , Carolina Scarton

Conventional Intent Detection (ID) models are usually trained offline, which relies on a fixed dataset and a predefined set of intent classes. However, in real-world applications, online systems usually involve continually emerging new user…

Computation and Language · Computer Science 2021-08-11 Qingbin Liu , Xiaoyan Yu , Shizhu He , Kang Liu , Jun Zhao

Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., 2020). It has been hypothesized that this is a consequence of implicit multitask learning in language…

Detecting out-of-scope user utterances is essential for task-oriented dialogues and intent classification. Current methodologies face difficulties with the unpredictable distribution of outliers and often rely on assumptions about data…

Computation and Language · Computer Science 2024-06-03 Hossam M. Zawbaa , Wael Rashwan , Sourav Dutta , Haytham Assem

Spoken language understanding (SLU) system usually consists of various pipeline components, where each component heavily relies on the results of its upstream ones. For example, Intent detection (ID), and slot filling (SF) require its…

Computation and Language · Computer Science 2021-04-14 Di Wu , Yiren Chen , Liang Ding , Dacheng Tao

Modern task-oriented dialogue (TOD) systems increasingly rely on large language model (LLM) agents, leveraging Retrieval-Augmented Generation (RAG) and long-context capabilities for long-term memory utilization. However, these methods are…

Computation and Language · Computer Science 2025-08-14 Yiming Du , Bingbing Wang , Yang He , Bin Liang , Baojun Wang , Zhongyang Li , Lin Gui , Jeff Z. Pan , Ruifeng Xu , Kam-Fai Wong

Task-oriented dialog systems increasingly rely on deep learning-based slot filling models, usually needing extensive labeled training data for target domains. Often, however, little to no target domain training data may be available, or the…

Computation and Language · Computer Science 2019-06-18 Darsh J Shah , Raghav Gupta , Amir A Fayazi , Dilek Hakkani-Tur

In the era of "Software Engineering 2.0" (SE 2.0), where intelligent agents collaborate with human engineers, Generative AI is advancing beyond code generation into Software Architecture (SA). While Large Language Models (LLMs) demonstrate…

Software Engineering · Computer Science 2026-03-10 Ha Vo , Nhut Tran , Khang Vo , Phat T. Tran-Truong , Son Ha

Large Language Models (LLMs) have demonstrated impressive capabilities in language generation and general task performance. However, their application to spoken language understanding (SLU) remains challenging, particularly for token-level…

Computation and Language · Computer Science 2025-10-09 Shangjian Yin , Peijie Huang , Jiatian Chen , Haojing Huang , Yuhong Xu

Slot filling and intent detection are two fundamental tasks in the field of natural language understanding. Due to the strong correlation between these two tasks, previous studies make efforts on modeling them with multi-task learning or…

Computation and Language · Computer Science 2022-09-12 Baohang Zhou , Ying Zhang , Xuhui Sui , Kehui Song , Xiaojie Yuan

We explore the use of large language models (LLMs) for zero-shot semantic parsing. Semantic parsing involves mapping natural language utterances to task-specific meaning representations. Language models are generally trained on the publicly…

Computation and Language · Computer Science 2022-12-22 Dheeraj Mekala , Jason Wolfe , Subhro Roy

In this paper we present our submission for the NorSID Shared Task as part of the 2025 VarDial Workshop (Scherrer et al., 2025), consisting of three tasks: Intent Detection, Slot Filling and Dialect Identification, evaluated using data in…

Computation and Language · Computer Science 2025-01-10 Jaione Bengoetxea , Mikel Zubillaga , Ekhi Azurmendi , Maite Heredia , Julen Etxaniz , Markel Ferro , Jeremy Barnes

Large Language Models (LLMs) have recently shown promise as high-level planners for robots when given access to a selection of low-level skills. However, it is often assumed that LLMs do not possess sufficient knowledge to be used for the…

Robotics · Computer Science 2024-06-19 Teyun Kwon , Norman Di Palo , Edward Johns

Natural language understanding typically maps single utterances to a dual level semantic frame, sentence level intent and slot labels at the word level. The best performing models force explicit interaction between intent detection and slot…

Computation and Language · Computer Science 2023-05-30 Henry Weld , Sijia Hu , Siqu Long , Josiah Poon , Soyeon Caren Han

Cross-lingual summarization (CLS) aims to generate a summary for the source text in a different target language. Currently, instruction-tuned large language models (LLMs) excel at various English tasks. However, unlike languages such as…

Computation and Language · Computer Science 2025-03-26 Zhecheng Li , Yiwei Wang , Bryan Hooi , Yujun Cai , Naifan Cheung , Nanyun Peng , Kai-wei Chang

Building a machine learning driven spoken dialog system for goal-oriented interactions involves careful design of intents and data collection along with development of intent recognition models and dialog policy learning algorithms. The…

Computation and Language · Computer Science 2019-12-24 Saurav Sahay , Shachi H Kumar , Eda Okur , Haroon Syed , Lama Nachman

Spoken Language Understanding (SLU) is composed of two subtasks: intent detection (ID) and slot filling (SF). There are two lines of research on SLU. One jointly tackles these two subtasks to improve their prediction accuracy, and the other…

Computation and Language · Computer Science 2021-07-27 Linhao Zhang , Yu Shi , Linjun Shou , Ming Gong , Houfeng Wang , Michael Zeng

Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating…

Computation and Language · Computer Science 2023-11-28 Yuxiang Wu , Guanting Dong , Weiran Xu

This work investigates the ability of open Large Language Models (LLMs) to predict citation intent through in-context learning and fine-tuning. Unlike traditional approaches relying on domain-specific pre-trained models like SciBERT, we…

Computation and Language · Computer Science 2025-11-17 Paris Koloveas , Serafeim Chatzopoulos , Thanasis Vergoulis , Christos Tryfonopoulos