English
Related papers

Related papers: WenetSpeech: A 10000+ Hours Multi-domain Mandarin …

200 papers

In this paper, we construct a new Japanese speech corpus called "JTubeSpeech." Although recent end-to-end learning requires large-size speech corpora, open-sourced such corpora for languages other than English have not yet been established.…

The performance of automated speech recognition (ASR) systems is well known to differ for varied application domains. At the same time, vendors and research groups typically report ASR quality results either for limited use simplistic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-31 Rostislav Kolobov , Olga Okhapkina , Olga Omelchishina , Andrey Platunov , Roman Bedyakin , Vyacheslav Moshkin , Dmitry Menshikov , Nikolay Mikhaylovskiy

This work presents a large-scale audio-visual speech recognition system based on a recurrent neural network transducer (RNN-T) architecture. To support the development of such a system, we built a large audio-visual (A/V) dataset of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-13 Takaki Makino , Hank Liao , Yannis Assael , Brendan Shillingford , Basilio Garcia , Otavio Braga , Olivier Siohan

Due to privacy restrictions, there's a shortage of publicly available speech recognition datasets in the medical domain. In this work, we present VietMed - a Vietnamese speech recognition dataset in the medical domain comprising 16h of…

Computation and Language · Computer Science 2025-04-07 Khai Le-Duc

The StutteringSpeech Challenge focuses on advancing speech technologies for people who stutter, specifically targeting Stuttering Event Detection (SED) and Automatic Speech Recognition (ASR) in Mandarin. The challenge comprises three…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Hongfei Xue , Rong Gong , Mingchen Shao , Xin Xu , Lezhi Wang , Lei Xie , Hui Bu , Jiaming Zhou , Yong Qin , Jun Du , Ming Li , Binbin Zhang , Bin Jia

We present a new large-scale multilingual video description dataset, VATEX, which contains over 41,250 videos and 825,000 captions in both English and Chinese. Among the captions, there are over 206,000 English-Chinese parallel translation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Xin Wang , Jiawei Wu , Junkun Chen , Lei Li , Yuan-Fang Wang , William Yang Wang

Code-switching (CS), the alternation between two or more languages within a single conversation, presents significant challenges for automatic speech recognition (ASR) systems. Existing Mandarin-English code-switching datasets often suffer…

Computation and Language · Computer Science 2025-03-13 Jiaming Zhou , Yujie Guo , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiabei He , Aobo Kong , Shiyao Wang , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

In this study, we introduce YODAS (YouTube-Oriented Dataset for Audio and Speech), a large-scale, multilingual dataset comprising currently over 500k hours of speech data in more than 100 languages, sourced from both labeled and unlabeled…

Computation and Language · Computer Science 2024-06-04 Xinjian Li , Shinnosuke Takamichi , Takaaki Saeki , William Chen , Sayaka Shiota , Shinji Watanabe

Code-switching (CS) is a common phenomenon and recognizing CS speech is challenging. But CS speech data is scarce and there' s no common testbed in relevant research. This paper describes the design and main outcomes of the ASRU 2019…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-14 Xian Shi , Qiangze Feng , Lei Xie

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…

Recent development of speech processing, such as speech recognition, speaker diarization, etc., has inspired numerous applications of speech technologies. The meeting scenario is one of the most valuable and, at the same time, most…

Sound · Computer Science 2022-02-28 Fan Yu , Shiliang Zhang , Yihui Fu , Lei Xie , Siqi Zheng , Zhihao Du , Weilong Huang , Pengcheng Guo , Zhijie Yan , Bin Ma , Xin Xu , Hui Bu

Singing accent research is underexplored compared to speech accent studies, primarily due to the scarcity of suitable datasets. Existing singing datasets often suffer from detail loss, frequently resulting from the vocal-instrumental…

We investigate a novel cross-lingual multi-speaker text-to-speech synthesis approach for generating high-quality native or accented speech for native/foreign seen/unseen speakers in English and Mandarin. The system consists of three…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-27 Zhaoyu Liu , Brian Mak

Speech processing systems face a fundamental challenge: the human voice changes with age, yet few datasets support rigorous longitudinal evaluation. We introduce VoxKnesset, an open-access dataset of ~2,300 hours of Hebrew parliamentary…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-06 Yanir Marmor , Arad Zulti , David Krongauz , Adam Gabet , Yoad Snapir , Yair Lifshitz , Eran Segal

In this paper, we present AISHELL-4, a sizable real-recorded Mandarin speech dataset collected by 8-channel circular microphone array for speech processing in conference scenario. The dataset consists of 211 recorded meeting sessions, each…

Sound · Computer Science 2021-08-11 Yihui Fu , Luyao Cheng , Shubo Lv , Yukai Jv , Yuxiang Kong , Zhuo Chen , Yanxin Hu , Lei Xie , Jian Wu , Hui Bu , Xin Xu , Jun Du , Jingdong Chen

With the emergence of audio-language models, constructing large-scale paired audio-language datasets has become essential yet challenging for model development, primarily due to the time-intensive and labour-heavy demands involved. While…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-02 Jisheng Bai , Haohe Liu , Mou Wang , Dongyuan Shi , Wenwu Wang , Mark D. Plumbley , Woon-Seng Gan , Jianfeng Chen

Recently, multilingual artificial intelligence assistants, exemplified by ChatGPT, have gained immense popularity. As a crucial gateway to human-computer interaction, multilingual automatic speech recognition (ASR) has also garnered…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-27 Song Li , Yongbin You , Xuezhi Wang , Zhengkun Tian , Ke Ding , Guanglu Wan

Thanks to improvements in machine learning techniques, including deep learning, speech synthesis is becoming a machine learning task. To accelerate speech synthesis research, we are developing Japanese voice corpora reasonably accessible…

We present Voxlect, a novel benchmark for modeling dialects and regional languages worldwide using speech foundation models. Specifically, we report comprehensive benchmark evaluations on dialects and regional language varieties in English,…

The Common Voice corpus is a massively-multilingual collection of transcribed speech intended for speech technology research and development. Common Voice is designed for Automatic Speech Recognition purposes but can be useful in other…