English
Related papers

Related papers: Intent Classification Using Pre-trained Language A…

200 papers

Performance of spoken language understanding (SLU) can be degraded with automatic speech recognition (ASR) errors. We propose a novel approach to improve SLU robustness by randomly corrupting clean training text with an ASR error simulator,…

Computation and Language · Computer Science 2022-11-09 Yik-Cheung Tam , Jiacheng Xu , Jiakai Zou , Zecheng Wang , Tinglong Liao , Shuhan Yuan

Sentiment analysis in low-resource languages suffers from a lack of annotated corpora to estimate high-performing models. Machine translation and bilingual word embeddings provide some relief through cross-lingual sentiment approaches.…

Computation and Language · Computer Science 2018-05-24 Jeremy Barnes , Roman Klinger , Sabine Schulte im Walde

An essential component of spoken language understanding (SLU) is slot filling: representing the meaning of a spoken utterance using semantic entity labels. In this paper, we develop end-to-end (E2E) spoken language understanding systems…

The problem of audio-to-text alignment has seen significant amount of research using complete supervision during training. However, this is typically not in the context of long audio recordings wherein the text being queried does not appear…

Computation and Language · Computer Science 2023-10-11 Piyush Singh Pasi , Karthikeya Battepati , Preethi Jyothi , Ganesh Ramakrishnan , Tanmay Mahapatra , Manoj Singh

Speech encoders pretrained through self-supervised learning (SSL) have demonstrated remarkable performance in various downstream tasks, including Spoken Language Understanding (SLU) and Automatic Speech Recognition (ASR). For instance,…

Computation and Language · Computer Science 2024-07-10 Salima Mdhaffar , Haroun Elleuch , Fethi Bougares , Yannick Estève

Spoken language understanding (SLU) topic has seen a lot of progress these last three years, with the emergence of end-to-end neural approaches. Spoken language understanding refers to natural language processing tasks related to semantic…

Computation and Language · Computer Science 2022-10-12 Sahar Ghannay , Antoine Caubrière , Salima Mdhaffar , Gaëlle Laperrière , Bassam Jabaian , Yannick Estève

Speech-enabled systems typically first convert audio to text through an automatic speech recognition (ASR) model and then feed the text to downstream natural language processing (NLP) modules. The errors of the ASR system can seriously…

Computation and Language · Computer Science 2021-03-26 Tong Cui , Jinghui Xiao , Liangyou Li , Xin Jiang , Qun Liu

Lattices are compact representations that encode multiple hypotheses, such as speech recognition results or different word segmentations. It is shown that encoding lattices as opposed to 1-best results generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

We present a systematic study on multilingual and cross-lingual intent detection from spoken data. The study leverages a new resource put forth in this work, termed MInDS-14, a first training and evaluation resource for the intent detection…

Computation and Language · Computer Science 2021-04-20 Daniela Gerz , Pei-Hao Su , Razvan Kusztos , Avishek Mondal , Michał Lis , Eshan Singhal , Nikola Mrkšić , Tsung-Hsien Wen , Ivan Vulić

Acoustic word embeddings are typically created by training a pooling function using pairs of word-like units. For unsupervised systems, these are mined using k-nearest neighbor (KNN) search, which is slow. Recently, mean-pooled…

Computation and Language · Computer Science 2023-06-06 Ramon Sanabria , Ondrej Klejch , Hao Tang , Sharon Goldwater

A number of methods have been proposed for End-to-End Spoken Language Understanding (E2E-SLU) using pretrained models, however their evaluation often lacks multilingual setup and tasks that require prediction of lexical fillers, such as…

Computation and Language · Computer Science 2023-10-11 Pavel Denisov , Ngoc Thang Vu

This memo describes NTR/TSU winning submission for Low Resource ASR challenge at Dialog2021 conference, language identification track. Spoken Language Identification (LID) is an important step in a multilingual Automated Speech Recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-02 Roman Bedyakin , Nikolay Mikhaylovskiy

Spoken language understanding (SLU) is a key component of task-oriented dialogue systems. SLU parses natural language user utterances into semantic frames. Previous work has shown that incorporating context information significantly…

Computation and Language · Computer Science 2020-03-04 Qian Chen , Zhu Zhuo , Wen Wang , Qiuyun Xu

Historically lower-level tasks such as automatic speech recognition (ASR) and speaker identification are the main focus in the speech field. Interest has been growing in higher-level spoken language understanding (SLU) tasks recently, like…

Computation and Language · Computer Science 2022-04-25 Lin Yao , Jianfei Song , Ruizhuo Xu , Yingfang Yang , Zijian Chen , Yafeng Deng

End-to-end spoken language understanding (SLU) models are a class of model architectures that predict semantics directly from speech. Because of their input and output types, we refer to them as speech-to-interpretation (STI) models.…

Computation and Language · Computer Science 2020-08-10 Joseph P. McKenna , Samridhi Choudhary , Michael Saxon , Grant P. Strimel , Athanasios Mouchtaris

Accurate detection of offensive language is essential for a number of applications related to social media safety. There is a sharp contrast in performance in this task between low and high-resource languages. In this paper, we adapt…

Computation and Language · Computer Science 2025-04-07 Shanilka Haturusinghe , Tharindu Cyril Weerasooriya , Marcos Zampieri , Christopher M. Homan , S. R. Liyanage

The lack of speech data annotated with labels required for spoken language understanding (SLU) is often a major hurdle in building end-to-end (E2E) systems that can directly process speech inputs. In contrast, large amounts of text data…

Computation and Language · Computer Science 2022-03-02 Samuel Thomas , Hong-Kwang J. Kuo , Brian Kingsbury , George Saon

Automatic speech recognition (ASR) has been widely researched with supervised approaches, while many low-resourced languages lack audio-text aligned data, and supervised methods cannot be applied on them. In this work, we propose a…

Computation and Language · Computer Science 2018-08-14 Yi-Chen Chen , Chia-Hao Shen , Sung-Feng Huang , Hung-yi Lee

Zero-shot spoken language understanding (SLU) enables systems to comprehend user utterances in new domains without prior exposure to training data. Recent studies often rely on large language models (LLMs), leading to excessive footprints…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Mohan Li , Simon Keizer , Rama Doddipatla

Intent classification is a fundamental task in the spoken language understanding field that has recently gained the attention of the scientific community, mainly because of the feasibility of approaching it with end-to-end neural models. In…

Computation and Language · Computer Science 2023-03-14 Mohamed Nabih Ali , Alessio Brutti , Daniele Falavigna