中文
相关论文

相关论文: WhisperPipe: A Resource-Efficient Streaming Archit…

200 篇论文

Multi-Modal automatic speech recognition (ASR) techniques aim to leverage additional modalities to improve the performance of speech recognition systems. While existing approaches primarily focus on video or contextual information, the…

声音 · 计算机科学 2023-12-27 Haoxu Wang , Fan Yu , Xian Shi , Yuezhang Wang , Shiliang Zhang , Ming Li

Dysarthric speech recognition (DSR) enhances the accessibility of smart devices for dysarthric speakers with limited mobility. Previously, DSR research was constrained by the fact that existing datasets typically consisted of isolated…

声音 · 计算机科学 2025-07-01 Shiyao Wang , Jiaming Zhou , Shiwan Zhao , Yong Qin

This paper presents a novel streaming automatic speech recognition (ASR) framework for multi-talker overlapping speech captured by a distant microphone array with an arbitrary geometry. Our framework, named t-SOT-VA, capitalizes on…

音频与语音处理 · 电气工程与系统科学 2022-10-05 Naoyuki Kanda , Jian Wu , Xiaofei Wang , Zhuo Chen , Jinyu Li , Takuya Yoshioka

The prevalence of the powerful multilingual models, such as Whisper, has significantly advanced the researches on speech recognition. However, these models often struggle with handling the code-switching setting, which is essential in…

音频与语音处理 · 电气工程与系统科学 2024-01-15 Bobbi Aditya , Mahdin Rohmatillah , Liang-Hsuan Tai , Jen-Tzung Chien

Multilingual Automatic Speech Recognition (ASR) aims to recognize and transcribe speech from multiple languages within a single system. Whisper, one of the most advanced ASR models, excels in this domain by handling 99 languages…

音频与语音处理 · 电气工程与系统科学 2024-12-24 Shao-Syuan Huang , Kuan-Po Huang , Andy T. Liu , Hung-yi Lee

We investigate the efficiency of two very different spoken term detection approaches for transcription when the available data is insufficient to train a robust ASR system. This work is grounded in very low-resource language documentation…

计算与语言 · 计算机科学 2021-06-14 Éric Le Ferrand , Steven Bird , Laurent Besacier

Serving Large Language Models (LLMs) in production faces significant challenges from highly variable request patterns and severe resource fragmentation in serverless clusters. Current systems rely on static pipeline configurations that…

分布式、并行与集群计算 · 计算机科学 2026-05-12 Yanying Lin , Shijie Peng , Chengzhi Lu , Chengzhong Xu , Kejiang Ye

In recent years, much speech separation research has focused primarily on improving model performance. However, for low-latency speech processing systems, high efficiency is equally important. Therefore, we propose a speech separation model…

声音 · 计算机科学 2026-03-02 Mohan Xu , Kai Li , Guo Chen , Xiaolin Hu

Automatic speech recognition (ASR) systems are primarily evaluated on transcription accuracy. However, in some use cases such as subtitling, verbatim transcription would reduce output readability given limited screen size and reading time.…

计算与语言 · 计算机科学 2020-05-26 Danni Liu , Jan Niehues , Gerasimos Spanakis

Automatic speech recognition (ASR) has the potential to substantially reduce manual annotation effort in child speech research by generating automatic transcriptions. However, obtaining reliably high-quality ASR transcriptions for child…

计算与语言 · 计算机科学 2026-05-29 Gus Lathouwers , Lingyun Gao , Catia Cucchiarini , Helmer Strik

Automatic speech recognition (ASR) for African languages remains constrained by limited labeled data and the lack of systematic guidance on model selection, data scaling, and decoding strategies. Large pre-trained systems such as Whisper,…

A random sample of nearly 10 hours of speech from PennSound, the world's largest online collection of poetry readings and discussions, was used as a benchmark to evaluate several commercial and open-source speech-to-text systems.…

计算与语言 · 计算机科学 2025-04-09 Jonathan Wright , Mark Liberman , Neville Ryant , James Fiumara

This paper presents the system developed to address the MISP 2025 Challenge. For the diarization system, we proposed a hybrid approach combining a WavLM end-to-end segmentation method with a traditional multi-module clustering technique to…

声音 · 计算机科学 2025-05-29 Shangkun Huang , Yuxuan Du , Jingwen Yang , Dejun Zhang , Xupeng Jia , Jing Deng , Jintao Kang , Rong Zheng

End-to-end automatic speech recognition systems represent the state of the art, but they rely on thousands of hours of manually annotated speech for training, as well as heavyweight computation for inference. Of course, this impedes…

Attention-based models have been gaining popularity recently for their strong performance demonstrated in fields such as machine translation and automatic speech recognition. One major challenge of attention-based models is the need of…

计算与语言 · 计算机科学 2020-11-17 Ching-Feng Yeh , Yongqiang Wang , Yangyang Shi , Chunyang Wu , Frank Zhang , Julian Chan , Michael L. Seltzer

Automatic speech recognition (ASR) has reached a level of accuracy in recent years, that even outperforms humans in transcribing speech to text. Nevertheless, all current ASR approaches show a certain weakness against ambient noise. To…

声音 · 计算机科学 2023-12-22 Christopher Simic , Tobias Bocklet

Generating spoken dialogue is inherently more complex than monologue text-to-speech (TTS), as it demands both realistic turn-taking and the maintenance of distinct speaker timbres. While existing autoregressive (AR) models have made…

音频与语音处理 · 电气工程与系统科学 2026-04-15 Han Zhu , Wei Kang , Liyong Guo , Zengwei Yao , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Dong Zhang , Xin Zhang , Xingchen Song , Lingxuan Ye , Long Lin , Daniel Povey

Streaming automatic speech recognition (ASR) aims to emit each hypothesized word as quickly and accurately as possible. However, emitting fast without degrading quality, as measured by word error rate (WER), is highly challenging. Existing…

音频与语音处理 · 电气工程与系统科学 2021-02-05 Jiahui Yu , Chung-Cheng Chiu , Bo Li , Shuo-yiin Chang , Tara N. Sainath , Yanzhang He , Arun Narayanan , Wei Han , Anmol Gulati , Yonghui Wu , Ruoming Pang

Recent developments in large speech foundation models like Whisper have led to their widespread use in many automatic speech recognition (ASR) applications. These systems incorporate `special tokens' in their vocabulary, such as…

计算与语言 · 计算机科学 2024-07-18 Vyas Raina , Rao Ma , Charles McGhee , Kate Knill , Mark Gales

Speaker adaptation techniques provide a powerful solution to customise automatic speech recognition (ASR) systems for individual users. Practical application of unsupervised model-based speaker adaptation techniques to data intensive…

音频与语音处理 · 电气工程与系统科学 2023-02-16 Jiajun Deng , Xurong Xie , Tianzi Wang , Mingyu Cui , Boyang Xue , Zengrui Jin , Guinan Li , Shujie Hu , Xunying Liu