中文
相关论文

相关论文: Personalization of CTC-based End-to-End Speech Rec…

200 篇论文

Speech is one of the most effective ways of communication among humans. Even though audio is the most common way of transmitting speech, very important information can be found in other modalities, such as vision. Vision is particularly…

计算与语言 · 计算机科学 2016-11-22 Ramon Sanabria , Florian Metze , Fernando De La Torre

End-to-end speech recognition systems usually require huge amounts of labeling resource, while annotating the speech data is complicated and expensive. Active learning is the solution by selecting the most valuable samples for annotation.…

音频与语音处理 · 电气工程与系统科学 2021-07-12 Jian Luo , Jianzong Wang , Ning Cheng , Jing Xiao

There are individual differences in expressive behaviors driven by cultural norms and personality. This between-person variation can result in reduced emotion recognition performance. Therefore, personalization is an important step in…

音频与语音处理 · 电气工程与系统科学 2023-09-06 Minh Tran , Yufeng Yin , Mohammad Soleymani

Transcription or sub-titling of open-domain videos is still a challenging domain for Automatic Speech Recognition (ASR) due to the data's challenging acoustics, variable signal processing and the essentially unrestricted domain of the data.…

音频与语音处理 · 电气工程与系统科学 2018-04-27 Shruti Palaskar , Ramon Sanabria , Florian Metze

The two most common paradigms for end-to-end speech recognition are connectionist temporal classification (CTC) and attention-based encoder-decoder (AED) models. It has been argued that the latter is better suited for learning an implicit…

音频与语音处理 · 电气工程与系统科学 2021-02-22 Lasse Borgholt , Jakob Drachmann Havtorn , Željko Agić , Anders Søgaard , Lars Maaløe , Christian Igel

End-to-end (E2E) systems have shown comparable performance to hybrid systems for automatic speech recognition (ASR). Word timings, as a by-product of ASR, are essential in many applications, especially for subtitling and computer-aided…

音频与语音处理 · 电气工程与系统科学 2023-06-14 Xianzhao Chen , Yist Y. Lin , Kang Wang , Yi He , Zejun Ma

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

Connectionist temporal classification (CTC) is widely used for maximum likelihood learning in end-to-end speech recognition models. However, there is usually a disparity between the negative maximum likelihood and the performance metric…

计算与语言 · 计算机科学 2017-12-20 Yingbo Zhou , Caiming Xiong , Richard Socher

End-to-end automatic speech recognition directly maps input speech to characters. However, the mapping can be problematic when several different pronunciations should be mapped into one character or when one pronunciation is shared among…

计算与语言 · 计算机科学 2023-03-14 Yusuke Fujita , Tatsuya Komatsu , Yusuke Kida

Most end-to-end speech recognition systems model text directly as a sequence of characters or sub-words. Current approaches to sub-word extraction only consider character sequence frequencies, which at times produce inferior sub-word…

计算与语言 · 计算机科学 2019-02-22 Hainan Xu , Shuoyang Ding , Shinji Watanabe

Training the state-of-the-art speech-to-text (STT) models in mobile devices is challenging due to its limited resources relative to a server environment. In addition, these models are trained on generic datasets that are not exhaustive in…

音频与语音处理 · 电气工程与系统科学 2021-12-08 Zitha S , Raghavendra Rao Suresh , Pooja Rao , T. V. Prabhakar

Recently, the advance in deep learning has brought a considerable improvement in the end-to-end speech recognition field, simplifying the traditional pipeline while producing promising results. Among the end-to-end models, the connectionist…

音频与语音处理 · 电气工程与系统科学 2022-11-29 Ji Won Yoon , Beom Jun Woo , Sunghwan Ahn , Hyeonseung Lee , Nam Soo Kim

End-to-end neural TTS has achieved superior performance on reading style speech synthesis. However, it's still a challenge to build a high-quality conversational TTS due to the limitations of the corpus and modeling capability. This study…

声音 · 计算机科学 2020-11-17 Haohan Guo , Shaofei Zhang , Frank K. Soong , Lei He , Lei Xie

Subword tokenization is a commonly used input pre-processing step in most recent NLP models. However, it limits the models' ability to leverage end-to-end task learning. Its frequency-based vocabulary creation compromises tokenization in…

In the recent literature, "end-to-end" speech systems often refer to letter-based acoustic models trained in a sequence-to-sequence manner, either via a recurrent model or via a structured output learning approach (such as CTC). In contrast…

计算与语言 · 计算机科学 2019-02-19 Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

Connectionist Temporal Classification (CTC) based end-to-end speech recognition system usually need to incorporate an external language model by using WFST-based decoding in order to achieve promising results. This is more essential to…

音频与语音处理 · 电气工程与系统科学 2019-04-24 Shiliang Zhang , Ming Lei , Zhijie Yan

Techniques for multi-lingual and cross-lingual speech recognition can help in low resource scenarios, to bootstrap systems and enable analysis of new languages and domains. End-to-end approaches, in particular sequence-based techniques, are…

计算与语言 · 计算机科学 2018-03-08 Siddharth Dalmia , Ramon Sanabria , Florian Metze , Alan W. Black

Despite recent advances in end-to-end speech recognition methods, their output is biased to the training data's vocabulary, resulting in inaccurate recognition of unknown terms or proper nouns. To improve the recognition accuracy for a…

计算与语言 · 计算机科学 2024-06-24 Yu Nakagome , Michael Hentschel

This work investigates spoken language understanding (SLU) systems in the scenario when the semantic information is extracted directly from the speech signal by means of a single end-to-end neural network model. Two SLU tasks are…

计算与语言 · 计算机科学 2019-10-29 Natalia Tomashenko , Antoine Caubriere , Yannick Esteve , Antoine Laurent , Emmanuel Morin

Speaker-independent speech recognition systems trained with data from many users are generally robust against speaker variability and work well for a large population of speakers. However, these systems do not always generalize well for…

音频与语音处理 · 电气工程与系统科学 2019-09-17 Khe Chai Sim , Petr Zadrazil , Françoise Beaufays