English
Related papers

Related papers: Conversation-oriented ASR with multi-look-ahead CB…

200 papers

Automatic speech recognition (ASR) is a key area in computational linguistics, focusing on developing technologies that enable computers to convert spoken language into text. This field combines linguistics and machine learning. ASR models,…

Computation and Language · Computer Science 2024-06-27 Anish Saha , A. G. Ramakrishnan

This paper proposes a novel automatic speech recognition (ASR) system that can transcribe individual speaker's speech while identifying whether they are target or non-target speakers from multi-talker overlapped speech. Target-speaker ASR…

This paper delves into the challenging task of Active Speaker Detection (ASD), where the system needs to determine in real-time whether a person is speaking or not in a series of video frames. While previous works have made significant…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Arnav Kundu , Yanzi Jin , Mohammad Sekhavat , Max Horton , Danny Tormoen , Devang Naik

Inspired by a human speech chain mechanism, a machine speech chain framework based on deep learning was recently proposed for the semi-supervised development of automatic speech recognition (ASR) and text-to-speech synthesis TTS) systems.…

Computation and Language · Computer Science 2020-11-05 Sashi Novitasari , Andros Tjandra , Tomoya Yanagita , Sakriani Sakti , Satoshi Nakamura

Utilizing air-traffic control (ATC) data for downstream natural-language processing tasks requires preprocessing steps. Key steps are the transcription of the data via automatic speech recognition (ASR) and speaker diarization, respectively…

Computation and Language · Computer Science 2024-06-21 Alexander Blatt , Aravind Krishnan , Dietrich Klakow

Automatic speech recognition (ASR) models make fewer errors when more surrounding speech information is presented as context. Unfortunately, acquiring a larger future context leads to higher latency. There exists an inevitable trade-off…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Kwangyoun Kim , Felix Wu , Prashant Sridhar , Kyu J. Han , Shinji Watanabe

Code-switching (CS) occurs when a speaker alternates words of two or more languages within a single sentence or across sentences. Automatic speech recognition (ASR) of CS speech has to deal with two or more languages at the same time. In…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-19 Xinyuan Zhou , Emre Yılmaz , Yanhua Long , Yijie Li , Haizhou Li

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

Computation and Language · Computer Science 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

Sound · Computer Science 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

Recently, online end-to-end ASR has gained increasing attention. However, the performance of online systems still lags far behind that of offline systems, with a large gap in quality of recognition. For specific scenarios, we can trade-off…

Sound · Computer Science 2020-10-28 Zhifu Gao , Shiliang Zhang , Ming Lei , Ian McLoughlin

Streaming ASR with strict latency constraints is required in many speech recognition applications. In order to achieve the required latency, streaming ASR models sacrifice accuracy compared to non-streaming ASR models due to lack of future…

Computation and Language · Computer Science 2022-03-30 Jay Mahadeokar , Yangyang Shi , Ke Li , Duc Le , Jiedan Zhu , Vikas Chandra , Ozlem Kalinli , Michael L Seltzer

Streaming speech recognition architectures are employed for low-latency, real-time applications. Such architectures are often characterized by their causality. Causal architectures emit tokens at each frame, relying only on current and past…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-11 Grant P. Strimel , Yi Xie , Brian King , Martin Radfar , Ariya Rastrow , Athanasios Mouchtaris

Conversational automatic speech recognition (ASR) is a task to recognize conversational speech including multiple speakers. Unlike sentence-level ASR, conversational ASR can naturally take advantages from specific characteristics of…

Sound · Computer Science 2022-02-18 Kun Wei , Yike Zhang , Sining Sun , Lei Xie , Long Ma

Decoder-only language models (LMs) have been successfully adopted for speech-processing tasks including automatic speech recognition (ASR). The LMs have ample expressiveness and perform efficiently. This efficiency is a suitable…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-02 Emiru Tsunoo , Hayato Futami , Yosuke Kashiwagi , Siddhant Arora , Shinji Watanabe

Online Transformer-based automatic speech recognition (ASR) systems have been extensively studied due to the increasing demand for streaming applications. Recently proposed Decoder-end Adaptive Computation Steps (DACS) algorithm for online…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Mohan Li , Catalin Zorila , Rama Doddipatla

Despite the close relationship between speech perception and production, research in automatic speech recognition (ASR) and text-to-speech synthesis (TTS) has progressed more or less independently without exerting much mutual influence on…

Computation and Language · Computer Science 2017-07-18 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Attention-based end-to-end automatic speech recognition (ASR) systems have recently demonstrated state-of-the-art results for numerous tasks. However, the application of self-attention and attention-based encoder-decoder models remains…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-06 Niko Moritz , Takaaki Hori , Jonathan Le Roux

There is often a trade-off between performance and latency in streaming automatic speech recognition (ASR). Traditional methods such as look-ahead and chunk-based methods, usually require information from future frames to advance…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehan Li , Haoran Miao , Keqi Deng , Gaofeng Cheng , Sanli Tian , Ta Li , Yonghong Yan

Automatic speech recognition (ASR) systems generate real-time transcriptions but often miss nuances that human interpreters capture. While ASR is useful in many contexts, interpreters-who already use ASR tools such as Dragon-add critical…

Sound · Computer Science 2025-10-15 Carlos Arriaga , Alejandro Pozo , Javier Conde , Alvaro Alonso

Neural sequence-to-sequence systems deliver state-of-the-art performance for automatic speech recognition (ASR). When using appropriate modeling units, e.g., byte-pair encoded characters, these systems are in principal open vocabulary…

Computation and Language · Computer Science 2021-07-07 Christian Huber , Juan Hussain , Sebastian Stüker , Alexander Waibel