中文
相关论文

相关论文: Deliberation Model Based Two-Pass End-to-End Speec…

200 篇论文

It is difficult for an E2E ASR system to recognize words such as entities appearing infrequently in the training data. A widely used method to mitigate this issue is feeding contextual information into the acoustic model. Previous works…

声音 · 计算机科学 2023-06-09 Zhanheng Yang , Sining Sun , Xiong Wang , Yike Zhang , Long Ma , Lei Xie

In this paper, we propose a new loss function called generalized end-to-end (GE2E) loss, which makes the training of speaker verification models more efficient than our previous tuple-based end-to-end (TE2E) loss function. Unlike TE2E, the…

音频与语音处理 · 电气工程与系统科学 2020-11-10 Li Wan , Quan Wang , Alan Papir , Ignacio Lopez Moreno

Recent advancements in multilingual speech encoding as well as transcription raise the question of the most effective approach to semantic speech classification. Concretely, can (1) end-to-end (E2E) classifiers obtained by fine-tuning…

计算与语言 · 计算机科学 2024-09-11 Lennart Keller , Goran Glavaš

Recently, end-to-end (E2E) models, which allow to take spectral vector sequences of L2 (second-language) learners' utterances as input and produce the corresponding phone-level sequences as output, have attracted much research attention in…

声音 · 计算机科学 2021-10-19 Tien-Hong Lo , Yao-Ting Sung , Berlin Chen

As human-machine voice interfaces provide easy access to increasingly intelligent machines, many state-of-the-art automatic speech recognition (ASR) systems are proposed. However, commercial ASR systems usually have poor performance on…

计算与语言 · 计算机科学 2023-09-28 Yanan Jia

Most spoken language understanding systems use a pipeline approach composed of an automatic speech recognition interface and a natural language understanding module. This approach forces hard decisions when converting continuous inputs into…

计算与语言 · 计算机科学 2023-10-18 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

While deep learning models have made significant advances in supervised classification problems, the application of these models for out-of-set verification tasks like speaker recognition has been limited to deriving feature embeddings. The…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Shreyas Ramoji , Prashant Krishnan , Sriram Ganapathy

Many neural network speaker recognition systems model each speaker using a fixed-dimensional embedding vector. These embeddings are generally compared using either linear or 2nd-order scoring and, until recently, do not handle…

计算与语言 · 计算机科学 2022-03-14 Jason Pelecanos , Quan Wang , Ignacio Lopez Moreno

Recent years have seen significant advances in end-to-end (E2E) spoken language understanding (SLU) systems, which directly predict intents and slots from spoken audio. While dialogue history has been exploited to improve conventional…

End-to-end (E2E) systems for automatic speech recognition (ASR), such as RNN Transducer (RNN-T) and Listen-Attend-Spell (LAS) blend the individual components of a traditional hybrid ASR system - acoustic model, language model, pronunciation…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Mahaveer Jain , Gil Keren , Jay Mahadeokar , Geoffrey Zweig , Florian Metze , Yatharth Saraf

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

计算与语言 · 计算机科学 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong

Second pass rescoring is a critical component of competitive automatic speech recognition (ASR) systems. Large language models have demonstrated their ability in using pre-trained information for better rescoring of ASR hypothesis.…

音频与语音处理 · 电气工程与系统科学 2023-10-11 Prashanth Gurunath Shivakumar , Jari Kolehmainen , Yile Gu , Ankur Gandhe , Ariya Rastrow , Ivan Bulyko

End-to-end (E2E) models have gained attention in the research field of automatic speech recognition (ASR). Many E2E models proposed so far assume left-to-right autoregressive generation of an output token sequence except for connectionist…

音频与语音处理 · 电气工程与系统科学 2020-11-17 Yuya Fujita , Shinji Watanabe , Motoi Omachi , Xuankai Chan

In recent years, all-neural, end-to-end (E2E) ASR systems gained rapid interest in the speech recognition community. They convert speech input to text units in a single trainable Neural Network model. In ASR, many utterances contain rich…

计算与语言 · 计算机科学 2020-08-11 Rongqing Huang , Ossama Abdel-hamid , Xinwei Li , Gunnar Evermann

End-to-end (E2E) models have achieved promising results on multiple speech recognition benchmarks, and shown the potential to become the mainstream. However, the unified structure and the E2E training hamper injecting contextual information…

计算与语言 · 计算机科学 2021-02-19 Minglun Han , Linhao Dong , Shiyu Zhou , Bo Xu

Using end-to-end models for speech translation (ST) has increasingly been the focus of the ST community. These models condense the previously cascaded systems by directly converting sound waves into translated text. However, cascaded models…

计算与语言 · 计算机科学 2021-01-25 Orion Weller , Matthias Sperber , Christian Gollan , Joris Kluivers

The increasing reliability of automatic speech recognition has proliferated its everyday use. However, for research purposes, it is often unclear which model one should choose for a task, particularly if there is a requirement for speed as…

计算与语言 · 计算机科学 2023-02-24 Ryan Whetten , Mir Tahsin Imtiaz , Casey Kennington

End-to-end speech summarization (E2E SSum) is a technique to directly generate summary sentences from speech. Compared with the cascade approach, which combines automatic speech recognition (ASR) and text summarization models, the E2E…

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

Decoding speech from non-invasive brain signals is challenging. For the LibriBrain 2025 Speech Detection task, we propose a novel two-step framework that bypasses direct reconstruction. First, a contrastive learning model retrieves the…

声音 · 计算机科学 2026-05-14 Boda Xiao , Bo Wang , Heping Cheng