English
Related papers

Related papers: Tone Recognition Using Lifters and CTC

200 papers

The mismatch of speech length and text length poses a challenge in automatic speech recognition (ASR). In previous research, various approaches have been employed to align text with speech, including the utilization of Connectionist…

Computation and Language · Computer Science 2025-10-14 Peng Fan , Wenping Wang , Fei Deng

There has been an increasing interest in large speech models that can perform multiple tasks in a single model. Such models usually adopt an encoder-decoder or decoder-only architecture due to their popularity and good performance in many…

Computation and Language · Computer Science 2024-08-28 Yifan Peng , Yui Sudo , Muhammad Shakeel , Shinji Watanabe

This paper proposes a simple and effective approach for automatic recognition of Cued Speech (CS), a visual communication tool that helps people with hearing impairment to understand spoken language with the help of hand gestures that can…

Computation and Language · Computer Science 2022-04-12 Sanjana Sankar , Denis Beautemps , Thomas Hueber

Voice conversion refers to transferring speaker identity with well-preserved content. Better disentanglement of speech representations leads to better voice conversion. Recent studies have found that phonetic information from input audio…

Sound · Computer Science 2024-01-19 Yimin Deng , Huaizhen Tang , Xulong Zhang , Ning Cheng , Jing Xiao , Jianzong Wang

We present results that show it is possible to build a competitive, greatly simplified, large vocabulary continuous speech recognition system with whole words as acoustic units. We model the output vocabulary of about 100,000 words directly…

Computation and Language · Computer Science 2016-11-01 Hagen Soltau , Hank Liao , Hasim Sak

The Vocal Joystick Vowel Corpus, by Washington University, was used to study monophthongs pronounced by native English speakers. The objective of this study was to quantitatively measure the extent at which speech recognition methods can…

Computation and Language · Computer Science 2017-02-24 Keith Y. Patarroyo , Vladimir Vargas-Calderón

In this work, we describe a novel method of training an embedding-matching word-level connectionist temporal classification (CTC) automatic speech recognizer (ASR) such that it directly produces word start times and durations, required by…

Computation and Language · Computer Science 2023-06-21 Woojay Jeon

Previous studies demonstrated that a dynamic phone-informed compression of the input audio is beneficial for speech translation (ST). However, they required a dedicated model for phone recognition and did not test this solution for direct…

Computation and Language · Computer Science 2021-10-15 Marco Gaido , Mauro Cettolo , Matteo Negri , Marco Turchi

The goal of this work is to recognise phrases and sentences being spoken by a talking face, with or without the audio. Unlike previous works that have focussed on recognising a limited number of words or phrases, we tackle lip reading as an…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Triantafyllos Afouras , Joon Son Chung , Andrew Senior , Oriol Vinyals , Andrew Zisserman

Continuous Sign Language Recognition (CSLR) is a challenging research task due to the lack of accurate annotation on the temporal sequence of sign language data. The recent popular usage is a hybrid model based on "CNN + RNN" for CSLR.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Qidan Zhu , Jing Li , Fei Yuan , Quan Gan

Recent works in speech recognition rely either on connectionist temporal classification (CTC) or sequence-to-sequence models for character-level recognition. CTC assumes conditional independence of individual characters, whereas…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Stavros Petridis , Themos Stafylakis , Pingchuan Ma , Georgios Tzimiropoulos , Maja Pantic

Topic classification systems on spoken documents usually consist of two modules: an automatic speech recognition (ASR) module to convert speech into text and a text topic classification (TTC) module to predict the topic class from the…

Computation and Language · Computer Science 2021-06-17 Tan Liu , Wu Guo , Bin Gu

In this paper we explore continuous silent speech recognition using electroencephalography (EEG) signals. We implemented a connectionist temporal classification (CTC) automatic speech recognition (ASR) model to translate EEG signals…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-06 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Speech enhancement algorithms based on deep learning have been improved in terms of speech intelligibility and perceptual quality greatly. Many methods focus on enhancing the amplitude spectrum while reconstructing speech using the mixture…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-10 Qinglong Li , Fei Gao , Haixin Guan , Kaichi Ma

Connectionist Temporal Classification (CTC) is a widely used approach for automatic speech recognition (ASR) that performs conditionally independent monotonic alignment. However for translation, CTC exhibits clear limitations due to the…

Computation and Language · Computer Science 2022-10-12 Brian Yan , Siddharth Dalmia , Yosuke Higuchi , Graham Neubig , Florian Metze , Alan W Black , Shinji Watanabe

Combining end-to-end speech translation (ST) and non-autoregressive (NAR) generation is promising in language and speech processing for their advantages of less error propagation and low latency. In this paper, we investigate the potential…

Computation and Language · Computer Science 2023-05-30 Chen Xu , Xiaoqian Liu , Xiaowen Liu , Qingxuan Sun , Yuhao Zhang , Murun Yang , Qianqian Dong , Tom Ko , Mingxuan Wang , Tong Xiao , Anxiang Ma , Jingbo Zhu

Manner of articulation detection using deep neural networks require a priori knowledge of the attribute discriminative features or the decent phoneme alignments. However generating an appropriate phoneme alignment is complex and its…

Computation and Language · Computer Science 2018-11-20 Pradeep Rangan , Sreenivasa Rao K

In this work, we explore a Connectionist Temporal Classification (CTC) based end-to-end Automatic Speech Recognition (ASR) model for the Myanmar language. A series of experiments is presented on the topology of the model in which the…

Machine Learning · Computer Science 2021-05-17 Khin Me Me Chit , Laet Laet Lin

Deep learning approaches have been widely used in Automatic Speech Recognition (ASR) and they have achieved a significant accuracy improvement. Especially, Convolutional Neural Networks (CNNs) have been revisited in ASR recently. However,…

Computation and Language · Computer Science 2017-02-28 Yisen Wang , Xuejiao Deng , Songbai Pu , Zhiheng Huang

This paper presents the use of non-autoregressive (NAR) approaches for joint automatic speech recognition (ASR) and spoken language understanding (SLU) tasks. The proposed NAR systems employ a Conformer encoder that applies connectionist…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-24 Mohan Li , Rama Doddipatla