中文
相关论文

相关论文: Turbocharge Speech Understanding with Pilot Infere…

200 篇论文

Spoken language understanding system is traditionally designed as a pipeline of a number of components. First, the audio signal is processed by an automatic speech recognizer for transcription or n-best hypotheses. With the recognition…

计算与语言 · 计算机科学 2018-02-26 Dmitriy Serdyuk , Yongqiang Wang , Christian Fuegen , Anuj Kumar , Baiyang Liu , Yoshua Bengio

In Spoken Language Understanding (SLU) the task is to extract important information from audio commands, like the intent of what a user wants the system to do and special entities like locations or numbers. This paper presents a simple…

计算与语言 · 计算机科学 2022-06-30 Daniel Bermuth , Alexander Poeppel , Wolfgang Reif

End-to-end (E2E) spoken language understanding (SLU) systems that generate a semantic parse from speech have become more promising recently. This approach uses a single model that utilizes audio and text representations from pre-trained…

计算与语言 · 计算机科学 2023-07-25 Suyoun Kim , Akshat Shrivastava , Duc Le , Ju Lin , Ozlem Kalinli , Michael L. Seltzer

End-to-end spoken language understanding (SLU) remains elusive even with current large pretrained language models on text and speech, especially in multilingual cases. Machine translation has been established as a powerful pretraining…

计算与语言 · 计算机科学 2023-10-18 Mutian He , Philip N. Garner

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

计算与语言 · 计算机科学 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

Voice Assistants such as Alexa, Siri, and Google Assistant typically use a two-stage Spoken Language Understanding pipeline; first, an Automatic Speech Recognition (ASR) component to process customer speech and generate text transcriptions,…

计算与语言 · 计算机科学 2020-12-17 Subendhu Rongali , Beiye Liu , Liwei Cai , Konstantine Arkoudas , Chengwei Su , Wael Hamza

Spoken Language Understanding (SLU) is the problem of extracting the meaning from speech utterances. It is typically addressed as a two-step problem, where an Automatic Speech Recognition (ASR) model is employed to convert speech into text,…

音频与语音处理 · 电气工程与系统科学 2020-05-04 Elisavet Palogiannidi , Ioannis Gkinis , George Mastrapas , Petr Mizera , Themos Stafylakis

Disfluency detection has mainly been solved in a pipeline approach, as post-processing of speech recognition. In this study, we propose Transformer-based encoder-decoder models that jointly solve speech recognition and disfluency detection,…

计算与语言 · 计算机科学 2023-05-12 Hayato Futami , Emiru Tsunoo , Kentaro Shibata , Yosuke Kashiwagi , Takao Okuda , Siddhant Arora , Shinji Watanabe

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

End-to-end models are an attractive new approach to spoken language understanding (SLU) in which the meaning of an utterance is inferred directly from the raw audio without employing the standard pipeline composed of a separately trained…

音频与语音处理 · 电气工程与系统科学 2019-10-22 Loren Lugosch , Brett Meyer , Derek Nowrouzezahrai , Mirco Ravanelli

End-to-end Spoken Language Understanding (SLU) models are made increasingly large and complex to achieve the state-ofthe-art accuracy. However, the increased complexity of a model can also introduce high risk of over-fitting, which is a…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Xueli Jia , Jianzong Wang , Zhiyong Zhang , Ning Cheng , Jing Xiao

This paper introduces a parallel and asynchronous Transformer framework designed for efficient and accurate multilingual lip synchronization in real-time video conferencing systems. The proposed architecture integrates translation, speech…

多媒体 · 计算机科学 2025-12-23 Eren Caglar , Amirkia Rafiei Oskooei , Mehmet Kutanoglu , Mustafa Keles , Mehmet S. Aktas

Spoken language understanding (SLU) tasks have been studied for many decades in the speech research community, but have not received as much attention as lower-level tasks like speech and speaker recognition. In particular, there are not…

Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these…

音频与语音处理 · 电气工程与系统科学 2019-07-26 Loren Lugosch , Mirco Ravanelli , Patrick Ignoto , Vikrant Singh Tomar , Yoshua Bengio

An end-to-end speech-to-text translation (ST) takes audio in a source language and outputs the text in a target language. Existing methods are limited by the amount of parallel corpus. Can we build a system to fully utilize signals in a…

计算与语言 · 计算机科学 2021-04-06 Qianqian Dong , Rong Ye , Mingxuan Wang , Hao Zhou , Shuang Xu , Bo Xu , Lei Li

End-to-end architectures have been recently proposed for spoken language understanding (SLU) and semantic parsing. Based on a large amount of data, those models learn jointly acoustic and linguistic-sequential features. Such architectures…

计算与语言 · 计算机科学 2020-02-17 Marco Dinarelli , Nikita Kapoor , Bassam Jabaian , Laurent Besacier

A system based on speech recognition is proposed for pilot assist decision-making. It is based on a HIL aircraft simulation platform and uses the microcontroller SPCE061A as the central processor to achieve better reliability and higher…

人机交互 · 计算机科学 2014-06-12 Jian Zhao , Hengzhu Liu , Xucan Chen , Zhengfa Liang

Speech is a hierarchical collection of text, prosody, emotions, dysfluencies, etc. Automatic transcription of speech that goes beyond text (words) is an underexplored problem. We focus on transcribing speech along with non-fluencies…

音频与语音处理 · 电气工程与系统科学 2024-12-03 Jiachen Lian , Xuanru Zhou , Zoe Ezzes , Jet Vonk , Brittany Morin , David Baquirin , Zachary Mille , Maria Luisa Gorno Tempini , Gopala Krishna Anumanchipalli

Recent progress in auditory intelligence has yielded high-performing systems for sound event detection (SED), acoustic scene classification (ASC), automated audio captioning (AAC), and audio question answering (AQA). Yet these tasks remain…

音频与语音处理 · 电气工程与系统科学 2025-08-12 Hyeonuk Nam

An intelligent virtual assistant (IVA) enables effortless conversations in call routing through spoken utterance classification (SUC) which is a special form of spoken language understanding (SLU). Building a SUC system requires a large…

计算与语言 · 计算机科学 2021-07-05 Shahab Jalalvand , Srinivas Bangalore