English
Related papers

Related papers: Towards Spoken Language Understanding via Multi-le…

200 papers

Natural language understanding (NLU) in the context of goal-oriented dialog systems typically includes intent classification and slot labeling tasks. Existing methods to expand an NLU system to new languages use machine translation with…

Computation and Language · Computer Science 2020-10-09 Weijia Xu , Batool Haider , Saab Mansour

Spoken language understanding (SLU) treats automatic speech recognition (ASR) and natural language understanding (NLU) as a unified task and usually suffers from data scarcity. We exploit an ASR and NLU joint training method based on meta…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Yingying Gao , Junlan Feng , Chao Deng , Shilei Zhang

Intent recognition is critical for task-oriented dialogue systems. However, for emerging domains and new services, it is difficult to accurately identify the key intent of a conversation due to time-consuming data annotation and…

Computation and Language · Computer Science 2023-03-10 Caiyuan Chu , Ya Li , Yifan Liu , Jia-Chen Gu , Quan Liu , Yongxin Ge , Guoping Hu

Modern spoken language understanding (SLU) systems rely on sophisticated semantic notions revealed in single utterances to detect intents and slots. However, they lack the capability of modeling multi-turn dynamics within a dialogue…

Computation and Language · Computer Science 2022-05-31 Ting-Wei Wu , Biing-Hwang Juang

Spoken Language Understanding (SLU) consists of two sub-tasks: intent detection (ID) and slot filling (SF). Given its broad range of real-world applications, enhancing SLU for practical deployment is increasingly critical. Profile-based SLU…

Artificial Intelligence · Computer Science 2025-11-25 Di Wu , Liting Jiang , Ruiyu Fang , Bianjing , Hongyan Xie , Haoxiang Su , Hao Huang , Zhongjiang He , Shuangyong Song , Xuelong Li

Large Language Models (LLMs) are increasingly used in Spoken Language Understanding (SLU), where effective multimodal learning depends on the alignment between audio and text. Despite various fusion methods, no standard metric exists to…

Computation and Language · Computer Science 2025-07-08 Pooneh Mousavi , Yingzhi Wang , Mirco Ravanelli , Cem Subakan

Natural Language Inference (NLI) is a growingly essential task in natural language understanding, which requires inferring the relationship between the sentence pairs (premise and hypothesis). Recently, low-resource natural language…

Computation and Language · Computer Science 2022-06-01 Shu'ang Li , Xuming Hu , Li Lin , Aiwei Liu , Lijie Wen , Philip S. Yu

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

Recently deep learning has dominated many machine learning areas, including spoken language understanding (SLU). However, deep learning models are notorious for being data-hungry, and the heavily optimized models are usually sensitive to…

Computation and Language · Computer Science 2020-12-15 Shang-Wen Li , Jason Krone , Shuyan Dong , Yi Zhang , Yaser Al-onaizan

Sentence Representation Learning (SRL) is a crucial task in Natural Language Processing (NLP), where contrastive Self-Supervised Learning (SSL) is currently a mainstream approach. However, the reasons behind its remarkable effectiveness…

Computation and Language · Computer Science 2024-06-06 Mingxin Li , Richong Zhang , Zhijie Nie

Selecting an appropriate response from many candidates given the utterances in a multi-turn dialogue is the key problem for a retrieval-based dialogue system. Existing work formalizes the task as matching between the utterances and a…

Computation and Language · Computer Science 2022-03-03 Wentao Zhang , Shuang Xu , Haoran Huang

Human multimodal language understanding (MLU) is an indispensable component of expression analysis (e.g., sentiment or humor) from heterogeneous modalities, including visual postures, linguistic contents, and acoustic behaviours. Existing…

Artificial Intelligence · Computer Science 2024-12-16 Zhi Xu , Dingkang Yang , Mingcheng Li , Yuzheng Wang , Zhaoyu Chen , Jiawei Chen , Jinjie Wei , Lihua Zhang

Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not…

Computation and Language · Computer Science 2023-06-19 Suwon Shon , Siddhant Arora , Chyi-Jiunn Lin , Ankita Pasad , Felix Wu , Roshan Sharma , Wei-Lun Wu , Hung-Yi Lee , Karen Livescu , Shinji Watanabe

Natural language understanding typically maps single utterances to a dual level semantic frame, sentence level intent and slot labels at the word level. The best performing models force explicit interaction between intent detection and slot…

Computation and Language · Computer Science 2023-05-30 Henry Weld , Sijia Hu , Siqu Long , Josiah Poon , Soyeon Caren Han

End-to-end approaches open a new way for more accurate and efficient spoken language understanding (SLU) systems by alleviating the drawbacks of traditional pipeline systems. Previous works exploit textual information for an SLU model via…

Computation and Language · Computer Science 2021-06-11 Seongbin Kim , Gyuwan Kim , Seongjin Shin , Sangmin Lee

Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior…

Computation and Language · Computer Science 2020-08-11 Won Ik Cho , Donghyun Kwak , Ji Won Yoon , Nam Soo Kim

Cross-language pre-trained models such as multilingual BERT (mBERT) have achieved significant performance in various cross-lingual downstream NLP tasks. This paper proposes a multi-level contrastive learning (ML-CTL) framework to further…

Computation and Language · Computer Science 2022-03-01 Beiduo Chen , Wu Guo , Bin Gu , Quan Liu , Yongchao Wang

Spoken language understanding (SLU), which is a core component of the task-oriented dialogue system, has made substantial progress in the research of single-turn dialogue. However, the performance in multi-turn dialogue is still not…

Computation and Language · Computer Science 2021-03-11 Lizhi Cheng , Weijia Jia , Wenmian Yang

Recently, large language models (LLMs) have emerged as a groundbreaking technology and their unparalleled text generation capabilities have sparked interest in their application to the fundamental sentence representation learning task.…

Computation and Language · Computer Science 2024-05-20 Huiming Wang , Zhaodonghui Li , Liying Cheng , Soh De Wen , Lidong Bing