English
Related papers

Related papers: HIT-SCIR at MMNLU-22: Consistency Regularization f…

200 papers

Multi-intent Spoken Language Understanding has great potential for widespread implementation. Jointly modeling Intent Detection and Slot Filling in it provides a channel to exploit the correlation between intents and slots. However, current…

Computation and Language · Computer Science 2022-10-10 Feifan Song , Lianzhe Huang , Houfeng Wang

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

Multiple intent detection and slot filling are two fundamental and crucial tasks in spoken language understanding. Motivated by the fact that the two tasks are closely related, joint models that can detect intents and extract slots…

Computation and Language · Computer Science 2023-12-29 Nguyen Anh Tu , Hoang Thi Thu Uyen , Tu Minh Phuong , Ngo Xuan Bach

Intent detection and slot filling are two main tasks for building a spoken language understanding(SLU) system. Multiple deep learning based models have demonstrated good results on these tasks . The most effective algorithms are based on…

Computation and Language · Computer Science 2018-12-27 Yu Wang , Yilin Shen , Hongxia Jin

Despite the promising results of current cross-lingual models for spoken language understanding systems, they still suffer from imperfect cross-lingual representation alignments between the source and target languages, which makes the…

Computation and Language · Computer Science 2020-10-01 Zihan Liu , Genta Indra Winata , Peng Xu , Zhaojiang Lin , Pascale Fung

Fine-tuning pre-trained cross-lingual language models can transfer task-specific supervision from one language to the others. In this work, we propose to improve cross-lingual fine-tuning with consistency regularization. Specifically, we…

Computation and Language · Computer Science 2021-06-16 Bo Zheng , Li Dong , Shaohan Huang , Wenhui Wang , Zewen Chi , Saksham Singhal , Wanxiang Che , Ting Liu , Xia Song , Furu Wei

Continual learning has emerged as an increasingly important challenge across various tasks, including Spoken Language Understanding (SLU). In SLU, its objective is to effectively handle the emergence of new concepts and evolving…

Computation and Language · Computer Science 2024-02-19 Muqiao Yang , Xiang Li , Umberto Cappellazzo , Shinji Watanabe , Bhiksha Raj

Spoken Language Understanding (SLU) is the problem of extracting the meaning from speech utterances. It is typically addressed as a two-step problem, where an Automatic Speech Recognition (ASR) model is employed to convert speech into text,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-04 Elisavet Palogiannidi , Ioannis Gkinis , George Mastrapas , Petr Mizera , Themos Stafylakis

Slot filling and intent detection have become a significant theme in the field of natural language understanding. Even though slot filling is intensively associated with intent detection, the characteristics of the information required for…

Computation and Language · Computer Science 2021-02-23 Yanfei Hui , Jianzong Wang , Ning Cheng , Fengying Yu , Tianbo Wu , Jing Xiao

Spoken Language Understanding (SLU) is an essential part of the spoken dialogue system, which typically consists of intent detection (ID) and slot filling (SF) tasks. Recently, recurrent neural networks (RNNs) based methods achieved the…

Computation and Language · Computer Science 2020-09-29 Peilin Zhou , Zhiqi Huang , Fenglin Liu , Yuexian Zou

Spoken Language Understanding (SLU) is one essential step in building a dialogue system. Due to the expensive cost of obtaining the labeled data, SLU suffers from the data scarcity problem. Therefore, in this paper, we focus on data…

Computation and Language · Computer Science 2021-09-03 Haitao Lin , Lu Xiang , Yu Zhou , Jiajun Zhang , Chengqing Zong

Natural Language Understanding (NLU) is important in today's technology as it enables machines to comprehend and process human language, leading to improved human-computer interactions and advancements in fields such as virtual assistants,…

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Natural language understanding (NLU) has two core tasks: intent classification and slot filling. The success of pre-training language models resulted in a significant breakthrough in the two tasks. One of the promising solutions called BERT…

Computation and Language · Computer Science 2023-02-03 Yu Guo , Zhilong Xie , Xingyan Chen , Huangen Chen , Leilei Wang , Huaming Du , Shaopeng Wei , Yu Zhao , Qing Li , Gang Wu

Current researches on spoken language understanding (SLU) heavily are limited to a simple setting: the plain text-based SLU that takes the user utterance as input and generates its corresponding semantic frames (e.g., intent and slots).…

Computation and Language · Computer Science 2022-01-13 Xiao Xu , Libo Qin , Kaiji Chen , Guoxing Wu , Linlin Li , Wanxiang Che

Intent classification and slot filling are two critical tasks for natural language understanding. Traditionally the two tasks proceeded independently. However, more recently joint models for intent classification and slot filling have…

Computation and Language · Computer Science 2022-03-01 Soyeon Caren Han , Siqu Long , Huichun Li , Henry Weld , Josiah Poon

Intent Recognition and Slot Identification are crucial components in spoken language understanding (SLU) systems. In this paper, we present a novel approach towards both these tasks in the context of low resourced and unwritten languages.…

Computation and Language · Computer Science 2021-09-29 Akshat Gupta , Olivia Deng , Akruti Kushwaha , Saloni Mittal , William Zeng , Sai Krishna Rallabandi , Alan W Black

State-of-the-art spoken language understanding (SLU) models have shown tremendous success in benchmark SLU datasets, yet they still fail in many practical scenario due to the lack of model compositionality when trained on limited training…

Computation and Language · Computer Science 2023-12-27 Avik Ray , Yilin Shen , Hongxia Jin

Multilingual sentence representations are the foundation for similarity-based bitext mining, which is crucial for scaling multilingual neural machine translation (NMT) system to more languages. In this paper, we introduce MuSR: a…

Computation and Language · Computer Science 2023-06-13 Pengzhi Gao , Liwen Zhang , Zhongjun He , Hua Wu , Haifeng Wang

Slot filling and intent detection are two highly correlated tasks in spoken language understanding (SLU). Recent SLU research attempts to explore zero-shot prompting techniques in large language models to alleviate the data scarcity…

Computation and Language · Computer Science 2024-06-18 Libo Qin , Fuxuan Wei , Qiguang Chen , Jingxuan Zhou , Shijue Huang , Jiasheng Si , Wenpeng Lu , Wanxiang Che