English
Related papers

Related papers: End-to-End Neural Transformer Based Spoken Languag…

200 papers

Training an end-to-end (E2E) neural network speech-to-intent (S2I) system that directly extracts intents from speech requires large amounts of intent-labeled speech data, which is time consuming and expensive to collect. Initializing the…

Computation and Language · Computer Science 2020-10-12 Yinghui Huang , Hong-Kwang Kuo , Samuel Thomas , Zvi Kons , Kartik Audhkhasi , Brian Kingsbury , Ron Hoory , Michael Picheny

Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU…

Computation and Language · Computer Science 2022-03-01 Xinliang Frederick Zhang

Emotion and intent recognition from speech is essential and has been widely investigated in human-computer interaction. The rapid development of social media platforms, chatbots, and other technologies has led to a large volume of speech…

Sound · Computer Science 2025-07-11 Zhao Ren , Rathi Adarshi Rammohan , Kevin Scheck , Sheng Li , Tanja Schultz

Spoken language understanding (SLU) requires a model to analyze input acoustic signal to understand its linguistic content and make predictions. To boost the models' performance, various pre-training methods have been proposed to learn rich…

Computation and Language · Computer Science 2021-03-16 Yu-An Chung , Chenguang Zhu , Michael Zeng

Spoken Language Understanding (SLU) consists of two sub-tasks: intent detection (ID) and slot filling (SF). Given its broad range of real-world applications, enhancing SLU for practical deployment is increasingly critical. Profile-based SLU…

Artificial Intelligence · Computer Science 2025-11-25 Di Wu , Liting Jiang , Ruiyu Fang , Bianjing , Hongyan Xie , Haoxiang Su , Hao Huang , Zhongjiang He , Shuangyong Song , Xuelong Li

Neural models have become ubiquitous in automatic speech recognition systems. While neural networks are typically used as acoustic models in more complex systems, recent studies have explored end-to-end speech recognition systems based on…

Computation and Language · Computer Science 2017-09-15 Yonatan Belinkov , James Glass

Slot filling is a crucial subtask in spoken language understanding (SLU), traditionally implemented as a cascade of speech recognition followed by one or more natural language understanding (NLU) components. The recent advent of…

Computation and Language · Computer Science 2025-10-20 Kadri Hacioglu , Manjunath K E , Andreas Stolcke

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

Computation and Language · Computer Science 2022-05-26 Akshat Gupta

Natural Language Understanding (NLU) is an established component within a conversational AI or digital assistant system, and it is responsible for producing semantic understanding of a user request. We propose a scalable and automatic…

Computation and Language · Computer Science 2021-09-13 Sunghyun Park , Han Li , Ameen Patel , Sidharth Mudgal , Sungjin Lee , Young-Bum Kim , Spyros Matsoukas , Ruhi Sarikaya

Recent advances in Speech Large Language Models (Speech LLMs) have led to great progress in speech understanding tasks such as Automatic Speech Recognition (ASR) and Speech Emotion Recognition (SER). However, whether these models can…

Sound · Computer Science 2025-12-01 Chen Li , Peiji Yang , Yicheng Zhong , Jianxing Yu , Zhisheng Wang , Zihao Gou , Wenqing Chen , Jian Yin

We present NLU++, a novel dataset for natural language understanding (NLU) in task-oriented dialogue (ToD) systems, with the aim to provide a much more challenging evaluation environment for dialogue NLU models, up to date with the current…

Computation and Language · Computer Science 2022-05-06 Iñigo Casanueva , Ivan Vulić , Georgios P. Spithourakis , Paweł Budzianowski

End-to-end (E2E) spoken language understanding (SLU) systems can infer the semantics of a spoken utterance directly from an audio signal. However, training an E2E system remains a challenge, largely due to the scarcity of paired…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Bhuvan Agrawal , Markus Müller , Martin Radfar , Samridhi Choudhary , Athanasios Mouchtaris , Siegfried Kunzmann

Spoken Language Understanding (SLU) is a critical component of voice assistants; it consists of converting speech to semantic parses for task execution. Previous works have explored end-to-end models to improve the quality and robustness of…

Computation and Language · Computer Science 2024-06-13 Trang Le , Daniel Lazar , Suyoun Kim , Shan Jiang , Duc Le , Adithya Sagar , Aleksandr Livshits , Ahmed Aly , Akshat Shrivastava

Machine Translation (MT) is a zone of concentrate in Natural Language processing which manages the programmed interpretation of human language, starting with one language then onto the next by the PC. Having a rich research history…

Computation and Language · Computer Science 2019-09-24 Siddhant Srivastava , Ritu Tiwari

Although Large Language Models (LLMs) can generate coherent text, they often struggle to recognise user intent behind queries. In contrast, Natural Language Understanding (NLU) models interpret the purpose and key information of user input…

Computation and Language · Computer Science 2025-06-02 Yan Li , So-Eon Kim , Seong-Bae Park , Soyeon Caren Han

Spoken language understanding (SLU) systems, such as goal-oriented chatbots or personal assistants, rely on an initial natural language understanding (NLU) module to determine the intent and to extract the relevant information from the user…

Computation and Language · Computer Science 2018-07-10 Mladen Dimovski , Claudiu Musat , Vladimir Ilievski , Andreea Hossmann , Michael Baeriswyl

Conventional spoken language translation (SLT) systems are pipeline based systems, where we have an Automatic Speech Recognition (ASR) system to convert the modality of source from speech to text and a Machine Translation (MT) systems to…

Lattices are compact representations that encode multiple hypotheses, such as speech recognition results or different word segmentations. It is shown that encoding lattices as opposed to 1-best results generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

The integration of pre-trained text-based large language models (LLM) with speech input has enabled instruction-following capabilities for diverse speech tasks. This integration requires the use of a speech encoder, a speech adapter, and an…

Computation and Language · Computer Science 2024-06-14 Suwon Shon , Kwangyoun Kim , Yi-Te Hsu , Prashant Sridhar , Shinji Watanabe , Karen Livescu

Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results…

Computation and Language · Computer Science 2020-02-17 Akshit Tyagi , Varun Sharma , Rahul Gupta , Lynn Samson , Nan Zhuang , Zihang Wang , Bill Campbell