English
Related papers

Related papers: Intent Recognition and Unsupervised Slot Identific…

200 papers

Speech large language models (speech-LLMs) integrate speech and text-based foundation models to provide a unified framework for handling a wide range of downstream tasks. In this paper, we introduce WHISMA, a speech-LLM tailored for spoken…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-30 Mohan Li , Cong-Thanh Do , Simon Keizer , Youmna Farag , Svetlana Stoyanchev , Rama Doddipatla

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

Computation and Language · Computer Science 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

End-to-end spoken language understanding (SLU) systems benefit from pretraining on large corpora, followed by fine-tuning on application-specific data. The resulting models are too large for on-edge applications. For instance, BERT-based…

Computation and Language · Computer Science 2022-06-30 Pu Wang , Hugo Van hamme

Slot-filling and intent detection are the backbone of conversational agents such as voice assistants, and are active areas of research. Even though state-of-the-art techniques on publicly available benchmarks show impressive performance,…

Computation and Language · Computer Science 2022-01-31 David Alfonso-Hermelo , Ahmad Rashid , Abbas Ghaddar , Philippe Langlais , Mehdi Rezagholizadeh

Spoken Language Understanding (SLU) models are a core component of voice assistants (VA), such as Alexa, Bixby, and Google Assistant. In this paper, we introduce a pipeline designed to extend SLU systems to new languages, utilizing Large…

Computation and Language · Computer Science 2024-04-04 Jakub Hoscilowicz , Pawel Pawlowski , Marcin Skorupa , Marcin Sowański , Artur Janicki

Existing task-oriented conversational search systems heavily rely on domain ontologies with pre-defined slots and candidate value sets. In practical applications, these prerequisites are hard to meet, due to the emerging new user…

Computation and Language · Computer Science 2023-05-09 Yuxia Wu , Tianhao Dai , Zhedong Zheng , Lizi Liao

Slot filling is identifying contiguous spans of words in an utterance that correspond to certain parameters (i.e., slots) of a user request/query. Slot filling is one of the most important challenges in modern task-oriented dialog systems.…

Computation and Language · Computer Science 2021-01-19 A. B. Siddique , Fuad Jamour , Vagelis Hristidis

The Spoken Language Understanding Evaluation (SLUE) suite of benchmark tasks was recently introduced to address the need for open resources and benchmarking of complex spoken language understanding (SLU) tasks, including both classification…

Spoken Language Understanding (SLU) aims to extract the semantics frame of user queries, which is a core component in a task-oriented dialog system. With the burst of deep neural networks and the evolution of pre-trained language models,…

Computation and Language · Computer Science 2021-05-11 Libo Qin , Tianbao Xie , Wanxiang Che , Ting Liu

Self-attention networks (SAN) have shown promising performance in various Natural Language Processing (NLP) scenarios, especially in machine translation. One of the main points of SANs is the strength of capturing long-range and multi-scale…

Computation and Language · Computer Science 2020-06-30 Sevinj Yolchuyeva , Géza Németh , Bálint Gyires-Tóth

Performance of spoken language understanding (SLU) can be degraded with automatic speech recognition (ASR) errors. We propose a novel approach to improve SLU robustness by randomly corrupting clean training text with an ASR error simulator,…

Computation and Language · Computer Science 2022-11-09 Yik-Cheung Tam , Jiacheng Xu , Jiakai Zou , Zecheng Wang , Tinglong Liao , Shuhan Yuan

Training an end-to-end (E2E) neural network speech-to-intent (S2I) system that directly extracts intents from speech requires large amounts of intent-labeled speech data, which is time consuming and expensive to collect. Initializing the…

Computation and Language · Computer Science 2020-10-12 Yinghui Huang , Hong-Kwang Kuo , Samuel Thomas , Zvi Kons , Kartik Audhkhasi , Brian Kingsbury , Ron Hoory , Michael Picheny

Intent detection and slot filling are important tasks in spoken and natural language understanding. However, Vietnamese is a low-resource language in these research topics. In this paper, we present the first public intent detection and…

Computation and Language · Computer Science 2021-06-10 Mai Hoang Dao , Thinh Hung Truong , Dat Quoc Nguyen

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

Sound · Computer Science 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

End-to-end (E2E) models are becoming increasingly popular for spoken language understanding (SLU) systems and are beginning to achieve competitive performance to pipeline-based approaches. However, recent work has shown that these models…

Computation and Language · Computer Science 2022-08-01 Siddhant Arora , Siddharth Dalmia , Xuankai Chang , Brian Yan , Alan Black , Shinji Watanabe

In this paper, we introduce a methodology for predicting intent and slots of a query for a chatbot that answers career-related queries. We take a multi-staged approach where both the processes (intent-classification and slot-tagging) inform…

Computation and Language · Computer Science 2019-01-14 Amber Nigam , Prashik Sahare , Kushagra Pandya

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

Accurate multi-turn intent classification is essential for advancing conversational AI systems. However, challenges such as the scarcity of comprehensive datasets and the complexity of contextual dependencies across dialogue turns hinder…

Computation and Language · Computer Science 2024-11-20 Junhua Liu , Yong Keat Tan , Bin Fu , Kwan Hui Lim

Intent Detection is one of the core tasks of dialog systems. Few-shot Intent Detection is challenging due to limited number of annotated utterances for novel classes. Generalized Few-shot intent detection is more realistic but challenging…

Computation and Language · Computer Science 2023-12-27 Ayush Kumar , Vijit Malik , Jithendra Vepa

Intent Classification (IC) and Slot Labeling (SL) models, which form the basis of dialogue systems, often encounter noisy data in real-word environments. In this work, we investigate how robust IC/SL models are to noisy data. We collect and…

Computation and Language · Computer Science 2021-11-03 Sailik Sengupta , Jason Krone , Saab Mansour