English
Related papers

Related papers: Improving CTC-based ASR Models with Gated Interlay…

200 papers

There has been an increasing interest in large speech models that can perform multiple tasks in a single model. Such models usually adopt an encoder-decoder or decoder-only architecture due to their popularity and good performance in many…

Computation and Language · Computer Science 2024-08-28 Yifan Peng , Yui Sudo , Muhammad Shakeel , Shinji Watanabe

The pervasiveness of intra-utterance code-switching (CS) in spoken content requires that speech recognition (ASR) systems handle mixed language. Designing a CS-ASR system has many challenges, mainly due to data scarcity, grammatical…

Computation and Language · Computer Science 2023-01-12 Amir Hussein , Shammur Absar Chowdhury , Ahmed Abdelali , Najim Dehak , Ahmed Ali , Sanjeev Khudanpur

It is a big challenge of computer vision to make machine automatically describe the content of an image with a natural language sentence. Previous works have made great progress on this task, but they only use the global or local image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Aihong Yuan , Xuelong Li , Xiaoqiang Lu

Automatic Audio Captioning (AAC) refers to the task of translating audio into a natural language that describes the audio events, source of the events and their relationships. The limited samples in AAC datasets at present, has set up a…

Sound · Computer Science 2022-02-01 Swapnil Bhosale , Rupayan Chakraborty , Sunil Kumar Kopparapu

In this paper, we present a new open source toolkit for automatic speech recognition (ASR), named CAT (CRF-based ASR Toolkit). A key feature of CAT is discriminative training in the framework of conditional random field (CRF), particularly…

Machine Learning · Computer Science 2019-11-21 Keyu An , Hongyu Xiang , Zhijian Ou

Neural contextual biasing effectively improves automatic speech recognition (ASR) for crucial phrases within a speaker's context, particularly those that are infrequent in the training data. This work proposes contextual text injection…

Computation and Language · Computer Science 2024-06-12 Zhong Meng , Zelin Wu , Rohit Prabhavalkar , Cal Peyser , Weiran Wang , Nanxin Chen , Tara N. Sainath , Bhuvana Ramabhadran

This paper presents novel Weighted Finite-State Transducer (WFST) topologies to implement Connectionist Temporal Classification (CTC)-like algorithms for automatic speech recognition. Three new CTC variants are proposed: (1) the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-27 Aleksandr Laptev , Somshubra Majumdar , Boris Ginsburg

In this work, we compare from-scratch sequence-level cross-entropy (full-sum) training of Hidden Markov Model (HMM) and Connectionist Temporal Classification (CTC) topologies for automatic speech recognition (ASR). Besides accuracy, we…

Sound · Computer Science 2022-10-19 Tina Raissi , Wei Zhou , Simon Berger , Ralf Schlüter , Hermann Ney

Generative recommendation (GR) has emerged as a promising paradigm that predicts target items by autoregressively generating their semantic identifiers (SID). Most GR methods follow a quantization-representation-generation pipeline, first…

Information Retrieval · Computer Science 2026-05-13 Ziwei Liu , Yejing Wang , Shengyu Zhou , Xinhang Li , Xiangyu Zhao

This work provides a feasible solution to the existing airport surface safety monitoring capabilities (i.e., Airport Surface Surveillance Capability (ASSC)), namely language AI-based voice communication understanding for collision risk…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-01 Yutian Pang , Andrew Paul Kendall , Alex Porcayo , Mariah Barsotti , Anahita Jain , John-Paul Clarke

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy

Previous research has proposed a machine speech chain to enable automatic speech recognition (ASR) and text-to-speech synthesis (TTS) to assist each other in semi-supervised learning and to avoid the need for a large amount of paired speech…

Computation and Language · Computer Science 2020-11-05 Johanes Effendi , Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Speech samples recorded in both indoor and outdoor environments are often contaminated with secondary audio sources. Most end-to-end monaural speech recognition systems either remove these background sounds using speech enhancement or train…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-04 Chaitanya Narisetty , Emiru Tsunoo , Xuankai Chang , Yosuke Kashiwagi , Michael Hentschel , Shinji Watanabe

This paper presents BERT-CTC, a novel formulation of end-to-end speech recognition that adapts BERT for connectionist temporal classification (CTC). Our formulation relaxes the conditional independence assumptions used in conventional CTC…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-21 Yosuke Higuchi , Brian Yan , Siddhant Arora , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

Automated audio captioning (AAC) is the task of automatically generating textual descriptions for general audio signals. A captioning system has to identify various information from the input signal and express it with natural language.…

Machine Learning · Computer Science 2021-10-15 Benno Weck , Xavier Favory , Konstantinos Drossos , Xavier Serra

Recent work has shown that it is possible to train a single model to perform joint acoustic echo cancellation (AEC), speech enhancement, and voice separation, thereby serving as a unified frontend for robust automatic speech recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-15 Tom O'Malley , Arun Narayanan , Quan Wang

Effectively distinguishing the pronunciation correlations between different written texts is a significant issue in linguistic acoustics. Traditionally, such pronunciation correlations are obtained through manually designed pronunciation…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-03 Gaofeng Cheng , Haitian Lu , Chengxu Yang , Xuyang Wang , Ta Li , Yonghong Yan

Integrated sensing and communication (ISAC) aims to unify radar and communication systems through a combination of joint hardware, joint waveforms, joint signal design, and joint signal processing. At high carrier frequencies, where ISAC is…

Signal Processing · Electrical Eng. & Systems 2021-11-04 José Miguel Mateos-Ramos , Jinxiang Song , Yibo Wu , Christian Häger , Musa Furkan Keskin , Vijaya Yajnanarayana , Henk Wymeersch

Goal-oriented semantic communication (SC) aims to revolutionize communication systems by transmitting only task-essential information. However, current approaches face challenges such as joint training at transceivers, leading to redundant…

Multilingual Automatic Speech Recognition (ASR) aims to recognize and transcribe speech from multiple languages within a single system. Whisper, one of the most advanced ASR models, excels in this domain by handling 99 languages…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-24 Shao-Syuan Huang , Kuan-Po Huang , Andy T. Liu , Hung-yi Lee