English
Related papers

Related papers: Improving Language Identification of Accented Spee…

200 papers

Accent conversion (AC) transforms a non-native speaker's accent into a native accent while maintaining the speaker's voice timbre. In this paper, we propose approaches to improving accent conversion applicability, as well as quality. First…

Computation and Language · Computer Science 2020-05-20 Wenjie Li , Benlai Tang , Xiang Yin , Yushi Zhao , Wei Li , Kang Wang , Hao Huang , Yuxuan Wang , Zejun Ma

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

Speech accents pose a significant challenge to state-of-the-art automatic speech recognition (ASR) systems. Degradation in performance across underrepresented accents is a severe deterrent to the inclusive adoption of ASR. In this work, we…

Computation and Language · Computer Science 2023-10-30 Darshan Prabhu , Preethi Jyothi , Sriram Ganapathy , Vinit Unni

The performance of automatic speech recognition systems degrades with increasing mismatch between the training and testing scenarios. Differences in speaker accents are a significant source of such mismatch. The traditional approach to deal…

Computation and Language · Computer Science 2018-02-09 Xuesong Yang , Kartik Audhkhasi , Andrew Rosenberg , Samuel Thomas , Bhuvana Ramabhadran , Mark Hasegawa-Johnson

Contextualized end-to-end automatic speech recognition has been an active research area, with recent efforts focusing on the implicit learning of contextual phrases based on the final loss objective. However, these approaches ignore the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-12 Muhammad Shakeel , Yui Sudo , Yifan Peng , Shinji Watanabe

Spoken language recognition (SLR) is the task of automatically identifying the language present in a speech signal. Existing SLR models are either too computationally expensive or too large to run effectively on devices with limited…

Computation and Language · Computer Science 2023-06-06 Oriol Nieto , Zeyu Jin , Franck Dernoncourt , Justin Salamon

Acoustical mismatch among training and testing phases degrades outstandingly speech recognition results. This problem has limited the development of real-world nonspecific applications, as testing conditions are highly variant or even…

Sound · Computer Science 2013-05-13 Rashmi Makhijani , Urmila Shrawankar , V M Thakare

In this paper, we extend previous self-supervised approaches for language identification by experimenting with Conformer based architecture in a multilingual pre-training paradigm. We find that pre-trained speech models optimally encode…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Travis M. Bartley , Fei Jia , Krishna C. Puvvada , Samuel Kriman , Boris Ginsburg

In this paper, we explore the use of pre-trained language models to learn sentiment information of written texts for speech sentiment analysis. First, we investigate how useful a pre-trained language model would be in a 2-step pipeline…

Computation and Language · Computer Science 2021-06-15 Suwon Shon , Pablo Brusco , Jing Pan , Kyu J. Han , Shinji Watanabe

Nowadays, research in speech technologies has gotten a lot out thanks to recently created public domain corpora that contain thousands of recording hours. These large amounts of data are very helpful for training the new complex models…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-12 Guillermo Cámbara , Alex Peiró-Lilja , Mireia Farrús , Jordi Luque

Multimodal speech recognition aims to improve the performance of automatic speech recognition (ASR) systems by leveraging additional visual information that is usually associated to the audio input. While previous approaches make crucial…

Sound · Computer Science 2022-04-29 Dan Oneata , Horia Cucu

Pre-emphasis filtering, compensating for the natural energy decay of speech at higher frequencies, has been considered as a common pre-processing step in a number of speech processing tasks over the years. In this work, we demonstrate, for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-18 Iván López-Espejo , Aditya Joglekar , Antonio M. Peinado , Jesper Jensen

This study propose a fully automated system for speech correction and accent reduction. Consider the application scenario that a recorded speech audio contains certain errors, e.g., inappropriate words, mispronunciations, that need to be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-17 Daxin Tan , Liqun Deng , Nianzu Zheng , Yu Ting Yeung , Xin Jiang , Xiao Chen , Tan Lee

Conversion of non-native accented speech to native (American) English has a wide range of applications such as improving intelligibility of non-native speech. Previous work on this domain has used phonetic posteriograms as the target speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Yashish M. Siriwardena , Nathan Swedlow , Audrey Howard , Evan Gitterman , Dan Darcy , Carol Espy-Wilson , Andrea Fanelli

Existing research suggests that automatic speech recognition (ASR) models can benefit from additional contexts (e.g., contact lists, user specified vocabulary). Rare words and named entities can be better recognized with contexts. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-16 Ruizhe Huang , Mahsa Yarmohammadi , Sanjeev Khudanpur , Daniel Povey

Running automatic speech recognition (ASR) on edge devices is non-trivial due to resource constraints, especially in scenarios that require supporting multiple languages. We propose a new approach to enable multilingual speech recognition…

Computation and Language · Computer Science 2021-08-05 Sangeeta Ghangam , Daniel Whitenack , Joshua Nemecek

Automatic accent identification (AID) remains a challenging task due to the complex variability of accents, the entanglement of accent cues with speaker traits, and the scarcity of reliable accentlabelled data. To address these challenges,…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Rayane Bakari , Olivier Le Blouch , Nicolas Gengembre , Nicholas Evans

In this paper, we present our initial efforts for building a code-switching (CS) speech recognition system leveraging existing acoustic models (AMs) and language models (LMs), i.e., no training required, and specifically targeting…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-03 Zhen Huang , Xiaodan Zhuang , Daben Liu , Xiaoqiang Xiao , Yuchen Zhang , Sabato Marco Siniscalchi

Automatic spoken language assessment systems are becoming more popular in order to handle increasing interests in second language learning. One challenge for these systems is to detect malpractice. Malpractice can take a range of forms,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-01 Linlin Wang , Yu Wang , Mark J. F. Gales

Accent recognition with deep learning framework is a similar work to deep speaker identification, they're both expected to give the input speech an identifiable representation. Compared with the individual-level features learned by speaker…

Sound · Computer Science 2021-08-26 Wei Wang , Chao Zhang , Xiaopei Wu