English
Related papers

Related papers: Improving End-to-End Speech-to-Intent Classificati…

200 papers

Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic…

Computation and Language · Computer Science 2022-10-12 Sahar Ghannay , Antoine Caubrière , Salima Mdhaffar , Gaëlle Laperrière , Bassam Jabaian , Yannick Estève

Spoken Language Understanding (SLU) systems consist of several machine learning components operating together (e.g. intent classification, named entity recognition and resolution). Deep learning models have obtained state of the art results…

Computation and Language · Computer Science 2020-02-17 Akshit Tyagi , Varun Sharma , Rahul Gupta , Lynn Samson , Nan Zhuang , Zihang Wang , Bill Campbell

Continual learning has emerged as an increasingly important challenge across various tasks, including Spoken Language Understanding (SLU). In SLU, its objective is to effectively handle the emergence of new concepts and evolving…

Computation and Language · Computer Science 2024-02-19 Muqiao Yang , Xiang Li , Umberto Cappellazzo , Shinji Watanabe , Bhiksha Raj

We explore the benefits that multitask learning offer to speech processing as we train models on dual objectives with automatic speech recognition and intent classification or sentiment classification. Our models, although being of modest…

Computation and Language · Computer Science 2022-11-28 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

Intent classification is a fundamental task in the spoken language understanding field that has recently gained the attention of the scientific community, mainly because of the feasibility of approaching it with end-to-end neural models. In…

Computation and Language · Computer Science 2023-03-14 Mohamed Nabih Ali , Alessio Brutti , Daniele Falavigna

Automation of on-call customer support relies heavily on accurate and efficient speech-to-intent (S2I) systems. Building such systems using multi-component pipelines can pose various challenges because they require large annotated datasets,…

Computation and Language · Computer Science 2023-05-31 Abhinav Goyal , Anupam Singh , Nikesh Garera

End-to-end speech translation (ST), which directly translates from source language speech into target language text, has attracted intensive attentions in recent years. Compared to conventional pipeline systems, end-to-end ST models have…

Computation and Language · Computer Science 2019-04-18 Yuchen Liu , Hao Xiong , Zhongjun He , Jiajun Zhang , Hua Wu , Haifeng Wang , Chengqing Zong

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

Computation and Language · Computer Science 2022-05-26 Akshat Gupta

Spoken language understanding (SLU) systems are widely used in handling of customer-care calls.A traditional SLU system consists of an acoustic model (AM) and a language model (LM) that areused to decode the utterance and a natural language…

Computation and Language · Computer Science 2018-10-02 Shahab Jalalvand , Andrej Ljolje , Srinivas Bangalore

Meta-learning, i.e., "learning to learn", is a promising approach to enable efficient BCI classifier training with limited amounts of data. It can effectively use collections of in some way similar classification tasks, with rapid…

Machine Learning · Computer Science 2025-01-22 Daniil A. Berdyshev , Artem M. Grachev , Sergei L. Shishkin , Bogdan L. Kozyrskiy

Recent advances in deep learning show that end-to-end speech to text translation model is a promising approach to direct the speech translation field. In this work, we provide an overview of different end-to-end architectures, as well as…

Computation and Language · Computer Science 2019-11-21 Parnia Bahar , Tobias Bieschke , Hermann Ney

Building speech recognizers in multiple languages typically involves replicating a monolingual training recipe for each language, or utilizing a multi-task learning approach where models for different languages have separate output labels…

Computation and Language · Computer Science 2017-11-08 Suyoun Kim , Michael L. Seltzer

Training a high performance end-to-end speech (E2E) processing model requires an enormous amount of labeled speech data, especially in the era of data-centric artificial intelligence. However, labeled speech data are usually scarcer and…

Computation and Language · Computer Science 2023-10-25 Jianqiao Lu , Wenyong Huang , Nianzu Zheng , Xingshan Zeng , Yu Ting Yeung , Xiao Chen

End-to-end approaches open a new way for more accurate and efficient spoken language understanding (SLU) systems by alleviating the drawbacks of traditional pipeline systems. Previous works exploit textual information for an SLU model via…

Computation and Language · Computer Science 2021-06-11 Seongbin Kim , Gyuwan Kim , Seongjin Shin , Sangmin Lee

Recent advances in End-to-End (E2E) Spoken Language Understanding (SLU) have been primarily due to effective pretraining of speech representations. One such pretraining paradigm is the distillation of semantic knowledge from…

Computation and Language · Computer Science 2022-07-04 Vishal Sunder , Eric Fosler-Lussier , Samuel Thomas , Hong-Kwang J. Kuo , Brian Kingsbury

Recent works showed that end-to-end neural approaches tend to become very popular for spoken language understanding (SLU). Through the term end-to-end, one considers the use of a single model optimized to extract semantic information…

Computation and Language · Computer Science 2022-04-05 Salima Mdhaffar , Jarod Duret , Titouan Parcollet , Yannick Estève

It is challenging to extract semantic meanings directly from audio signals in spoken language understanding (SLU), due to the lack of textual information. Popular end-to-end (E2E) SLU models utilize sequence-to-sequence automatic speech…

Computation and Language · Computer Science 2023-06-05 Jixuan Wang , Martin Radfar , Kai Wei , Clement Chung

Natural language understanding (NLU) in the context of goal-oriented dialog systems typically includes intent classification and slot labeling tasks. Existing methods to expand an NLU system to new languages use machine translation with…

Computation and Language · Computer Science 2020-10-09 Weijia Xu , Batool Haider , Saab Mansour

Speech is one of the most effective means of communication and is full of information that helps the transmission of utterer's thoughts. However, mainly due to the cumbersome processing of acoustic features, phoneme or word posterior…

Computation and Language · Computer Science 2020-08-11 Won Ik Cho , Donghyun Kwak , Ji Won Yoon , Nam Soo Kim

Through end-to-end training to predict the next token, LLMs have become valuable tools for various tasks. Enhancing their core training in language modeling can improve numerous downstream applications. A successful approach to enhance…

Computation and Language · Computer Science 2024-10-17 Nathan Cornille , Florian Mai , Jingyuan Sun , Marie-Francine Moens