English
Related papers

Related papers: Exploring SSL Discrete Tokens for Multilingual ASR

200 papers

Language models (LMs) have shown superior performances in various speech generation tasks recently, demonstrating their powerful ability for semantic context modeling. Given the intrinsic similarity between speech generation and speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Ziqian Wang , Xinfa Zhu , Zihan Zhang , YuanJun Lv , Ning Jiang , Guoqing Zhao , Lei Xie

Self-supervised learning (SSL) has achieved great success in various areas including speech processing. Recently, it is proven that speech based SSL models are able to extract superior universal representations on a range of downstream…

Sound · Computer Science 2022-12-21 Changli Tang , Yujin Wang , Xie Chen , Wei-Qiang Zhang

Neural speech separation has made remarkable progress and its integration with automatic speech recognition (ASR) is an important direction towards realizing multi-speaker ASR. This work provides an insightful investigation of speech…

Automatic Speech Recognition (ASR) offers significant potential to reduce the workload of medical personnel, for example, through the automation of documentation tasks. While numerous benchmarks exist for the English language, specific…

Computation and Language · Computer Science 2026-01-29 Thomas Schuster , Julius Trögele , Nico Döring , Robin Krüger , Matthieu Hoffmann , Holger Friedrich

Self-supervised learning (SSL) speech representations learned from large amounts of diverse, mixed-quality speech data without transcriptions are gaining ground in many speech technology applications. Prior work has shown that SSL is an…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-12 Siyang Wang , Gustav Eje Henter , Joakim Gustafson , Éva Székely

Despite recent advancements in deep learning technologies, Child Speech Recognition remains a challenging task. Current Automatic Speech Recognition (ASR) models require substantial amounts of annotated data for training, which is scarce.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-14 Rishabh Jain , Andrei Barcovschi , Mariam Yiwere , Dan Bigioi , Peter Corcoran , Horia Cucu

Automatic speech recognition (ASR) systems, increasingly prevalent in education, healthcare, employment, and mobile technology, face significant challenges in inclusivity, particularly for the 80 million-strong global community of people…

Computation and Language · Computer Science 2024-05-13 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Hope Gerlach-Houck , Caryn Herring , Jia Bin

Whisper is a multitask and multilingual speech model covering 99 languages. It yields commendable automatic speech recognition (ASR) results in a subset of its covered languages, but the model still underperforms on a non-negligible number…

Computation and Language · Computer Science 2025-12-02 Thomas Palmeira Ferraz , Marcely Zanon Boito , Caroline Brun , Vassilina Nikoulina

Self-supervised learning (SSL) based models have been shown to generate powerful representations that can be used to improve the performance of downstream speech tasks. Several state-of-the-art SSL models are available, and each of these…

Computation and Language · Computer Science 2023-02-21 A Arunkumar , Vrunda N Sukhadia , S. Umesh

This paper conducts a comprehensive layer-wise analysis of self-supervised learning (SSL) models for audio deepfake detection across diverse contexts, including multilingual datasets (English, Chinese, Spanish), partial, song, and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-10 Yassine El Kheir , Youness Samih , Suraj Maharjan , Tim Polzehl , Sebastian Möller

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

Although many Automatic Speech Recognition (ASR) systems have been developed for Modern Standard Arabic (MSA) and Dialectal Arabic (DA), few studies have focused on dialect-specific implementations, particularly for low-resource Arabic…

Computation and Language · Computer Science 2026-01-13 Ayman Mansour

Recent techniques for speech deepfake detection often rely on pre-trained self-supervised models. These systems, initially developed for Automatic Speech Recognition (ASR), have proved their ability to offer a meaningful representation of…

Source separation can improve automatic speech recognition (ASR) under multi-party meeting scenarios by extracting single-speaker signals from overlapped speech. Despite the success of self-supervised learning models in single-channel…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Yuang Li , Xianrui Zheng , Philip C. Woodland

Dialog systems, such as voice assistants, are expected to engage with users in complex, evolving conversations. Unfortunately, traditional automatic speech recognition (ASR) systems deployed in such applications are usually trained to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Hitesh Tulsiani , David M. Chan , Shalini Ghosh , Garima Lalwani , Prabhat Pandey , Ankish Bansal , Sri Garimella , Ariya Rastrow , Björn Hoffmeister

Although Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, the majority of the world's languages do not have usable systems due to the lack of large speech datasets to train these models.…

Computation and Language · Computer Science 2022-02-28 Hemant Yadav , Sunayana Sitaram

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

Computation and Language · Computer Science 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

Recent advancements in supervised automatic speech recognition (ASR) have achieved remarkable performance, largely due to the growing availability of large transcribed speech corpora. However, most languages lack sufficient paired speech…

Computation and Language · Computer Science 2025-01-10 Junrui Ni , Liming Wang , Yang Zhang , Kaizhi Qian , Heting Gao , Mark Hasegawa-Johnson , Chang D. Yoo

Automatic speech recognition (ASR) systems have dramatically improved over the last few years. ASR systems are most often trained from 'typical' speech, which means that underrepresented groups don't experience the same level of…

The rapid development of neural text-to-speech (TTS) systems enabled its usage in other areas of natural language processing such as automatic speech recognition (ASR) or spoken language translation (SLT). Due to the large number of…

Computation and Language · Computer Science 2024-08-01 Nick Rossenbach , Ralf Schlüter , Sakriani Sakti