中文
相关论文

相关论文: Speaker-Distinguishable CTC: Learning Speaker Dist…

200 篇论文

Connectionist Temporal Classification (CTC) based end-to-end speech recognition system usually need to incorporate an external language model by using WFST-based decoding in order to achieve promising results. This is more essential to…

音频与语音处理 · 电气工程与系统科学 2019-04-24 Shiliang Zhang , Ming Lei , Zhijie Yan

The success of self-attention in NLP has led to recent applications in end-to-end encoder-decoder architectures for speech recognition. Separately, connectionist temporal classification (CTC) has matured as an alignment-free,…

音频与语音处理 · 电气工程与系统科学 2019-07-02 Julian Salazar , Katrin Kirchhoff , Zhiheng Huang

Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However for translation, CTC exhibits clear limitations due to the…

计算与语言 · 计算机科学 2022-10-12 Brian Yan , Siddharth Dalmia , Yosuke Higuchi , Graham Neubig , Florian Metze , Alan W Black , Shinji Watanabe

Recently, end-to-end multi-speaker text-to-speech (TTS) systems gain success in the situation where a lot of high-quality speech plus their corresponding transcriptions are available. However, laborious paired data collection processes…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Tao Tu , Yuan-Jui Chen , Alexander H. Liu , Hung-yi Lee

When labeled data is insufficient, semi-supervised learning with the pseudo-labeling technique can significantly improve the performance of automatic speech recognition. However, pseudo-labels are often noisy, containing numerous incorrect…

音频与语音处理 · 电气工程与系统科学 2023-08-15 Han Zhu , Dongji Gao , Gaofeng Cheng , Daniel Povey , Pengyuan Zhang , Yonghong Yan

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common…

音频与语音处理 · 电气工程与系统科学 2022-10-18 Juan Zuluaga-Gomez , Seyyed Saeed Sarfjoo , Amrutha Prasad , Iuliia Nigmatulina , Petr Motlicek , Karel Ondrej , Oliver Ohneiser , Hartmut Helmke

This paper introduces a novel training framework called Focused Discriminative Training (FDT) to further improve streaming word-piece end-to-end (E2E) automatic speech recognition (ASR) models trained using either CTC or an interpolation of…

机器学习 · 计算机科学 2024-08-26 Adnan Haider , Xingyu Na , Erik McDermott , Tim Ng , Zhen Huang , Xiaodan Zhuang

In recent years, end-to-end speech recognition has emerged as a technology that integrates the acoustic, pronunciation dictionary, and language model components of the traditional Automatic Speech Recognition model. It is possible to…

计算与语言 · 计算机科学 2023-12-18 Tzu-Ting Yang , Hsin-Wei Wang , Berlin Chen

In recent years, Speech Emotion Recognition (SER) has been investigated mainly transforming the speech signal into spectrograms that are then classified using Convolutional Neural Networks pretrained on generic images and fine tuned with…

声音 · 计算机科学 2022-11-07 A. Arezzo , S. Berretti

Streaming recognition and segmentation of multi-party conversations with overlapping speech is crucial for the next generation of voice assistant applications. In this work we address its challenges discovered in the previous work on…

音频与语音处理 · 电气工程与系统科学 2022-05-12 Ilya Sklyar , Anna Piunova , Christian Osendorfer

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from…

音频与语音处理 · 电气工程与系统科学 2018-01-24 Sibo Tong , Philip N. Garner , Hervé Bourlard

Scene text recognition has been an important, active research topic in computer vision for years. Previous approaches mainly consider text as 1D signals and cast scene text recognition as a sequence prediction problem, by feat of CTC or…

计算机视觉与模式识别 · 计算机科学 2019-07-24 Zhaoyi Wan , Fengming Xie , Yibo Liu , Xiang Bai , Cong Yao

Recent work on end-to-end automatic speech recognition (ASR) has shown that the connectionist temporal classification (CTC) loss can be used to convert acoustics to phone or character sequences. Such systems are used with a dictionary and…

计算与语言 · 计算机科学 2017-03-23 Kartik Audhkhasi , Bhuvana Ramabhadran , George Saon , Michael Picheny , David Nahamoo

We propose a separation guided speaker diarization (SGSD) approach by fully utilizing a complementarity of speech separation and speaker clustering. Since the conventional clustering-based speaker diarization (CSD) approach cannot well…

音频与语音处理 · 电气工程与系统科学 2021-07-07 Shu-Tong Niu , Jun Du , Lei Sun , Chin-Hui Lee

This paper integrates a voice activity detection (VAD) function with end-to-end automatic speech recognition toward an online speech interface and transcribing very long audio recordings. We focus on connectionist temporal classification…

音频与语音处理 · 电气工程与系统科学 2020-03-16 Takenori Yoshimura , Tomoki Hayashi , Kazuya Takeda , Shinji Watanabe

This paper proposes an adaptation method for end-to-end speech recognition. In this method, multiple automatic speech recognition (ASR) 1-best hypotheses are integrated in the computation of the connectionist temporal classification (CTC)…

计算与语言 · 计算机科学 2021-04-01 Cong-Thanh Do , Rama Doddipatla , Thomas Hain

Phonetic speech transcription is crucial for fine-grained linguistic analysis and downstream speech applications. While Connectionist Temporal Classification (CTC) is a widely used approach for such tasks due to its efficiency, it often…

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

音频与语音处理 · 电气工程与系统科学 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

This paper advances the design of CTC-based all-neural (or end-to-end) speech recognizers. We propose a novel symbol inventory, and a novel iterated-CTC method in which a second system is used to transform a noisy initial output into a…

计算与语言 · 计算机科学 2022-02-24 G. Zweig , C. Yu , J. Droppo , A. Stolcke

Self-supervised learning (SSL) has shown promise in learning representations of audio that are useful for automatic speech recognition (ASR). But, training SSL models like wav2vec~2.0 requires a two-stage pipeline. In this paper we…

计算与语言 · 计算机科学 2021-02-16 Chaitanya Talnikar , Tatiana Likhomanenko , Ronan Collobert , Gabriel Synnaeve