中文
相关论文

相关论文: Disentangling Speakers in Multi-Talker Speech Reco…

200 篇论文

Automatic speech recognition (ASR) for conversational speech remains challenging due to the limited availability of large-scale, well-annotated multi-speaker dialogue data and the complex temporal dynamics of natural interactions.…

声音 · 计算机科学 2026-02-05 Máté Gedeon , Péter Mihajlik

Accents, as variations from standard pronunciation, pose significant challenges for speech recognition systems. Although joint automatic speech recognition (ASR) and accent recognition (AR) training has been proven effective in handling…

声音 · 计算机科学 2023-11-20 Qijie Shao , Pengcheng Guo , Jinghao Yan , Pengfei Hu , Lei Xie

This paper presents a streaming speaker-attributed automatic speech recognition (SA-ASR) model that can recognize ``who spoke what'' with low latency even when multiple people are speaking simultaneously. Our model is based on token-level…

音频与语音处理 · 电气工程与系统科学 2022-07-18 Naoyuki Kanda , Jian Wu , Yu Wu , Xiong Xiao , Zhong Meng , Xiaofei Wang , Yashesh Gaur , Zhuo Chen , Jinyu Li , Takuya Yoshioka

Connectionist temporal classification (CTC) -based models are attractive because of their fast inference in automatic speech recognition (ASR). Language model (LM) integration approaches such as shallow fusion and rescoring can improve the…

计算与语言 · 计算机科学 2022-09-07 Hayato Futami , Hirofumi Inaguma , Masato Mimura , Shinsuke Sakai , Tatsuya Kawahara

This paper introduces a novel approach to speaker-attributed ASR transcription using a neural clustering method. With a parallel processing mechanism, diarisation and ASR can be applied simultaneously, helping to prevent the accumulation of…

音频与语音处理 · 电气工程与系统科学 2024-09-04 Xianrui Zheng , Guangzhi Sun , Chao Zhang , Philip C. Woodland

Speaker change detection (SCD) is an important feature that improves the readability of the recognized words from an automatic speech recognition (ASR) system by breaking the word sequence into paragraphs at speaker change points. Existing…

音频与语音处理 · 电气工程与系统科学 2023-02-20 Jian Wu , Zhuo Chen , Min Hu , Xiong Xiao , Jinyu Li

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

音频与语音处理 · 电气工程与系统科学 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Several recently proposed text-to-speech (TTS) models achieved to generate the speech samples with the human-level quality in the single-speaker and multi-speaker TTS scenarios with a set of pre-defined speakers. However, synthesizing a new…

音频与语音处理 · 电气工程与系统科学 2022-11-23 Byoung Jin Choi , Myeonghun Jeong , Minchan Kim , Sung Hwan Mun , Nam Soo Kim

For speaker recognition, it is difficult to extract an accurate speaker representation from speech because of its mixture of speaker traits and content. This paper proposes a disentanglement framework that simultaneously models speaker…

音频与语音处理 · 电气工程与系统科学 2023-11-02 Tianchi Liu , Kong Aik Lee , Qiongqiong Wang , Haizhou Li

This article describes an efficient training method for online streaming attention-based encoder-decoder (AED) automatic speech recognition (ASR) systems. AED models have achieved competitive performance in offline scenarios by jointly…

音频与语音处理 · 电气工程与系统科学 2021-08-24 Hirofumi Inaguma , Tatsuya Kawahara

Multi-stage learning is an effective technique to invoke multiple deep-learning modules sequentially. This paper applies multi-stage learning to speech enhancement by using a multi-stage structure, where each stage comprises a…

音频与语音处理 · 电气工程与系统科学 2021-02-25 Ju Lin , Adriaan J. van Wijngaarden , Kuang-Ching Wang , Melissa C. Smith

Since the first speech recognition systems were built more than 30 years ago, improvement in voice technology has enabled applications such as smart assistants and automated customer support. However, conversation intelligence of the future…

音频与语音处理 · 电气工程与系统科学 2024-02-15 Desh Raj

It is challenging to extract semantic meanings directly from audio signals in spoken language understanding (SLU), due to the lack of textual information. Popular end-to-end (E2E) SLU models utilize sequence-to-sequence automatic speech…

计算与语言 · 计算机科学 2023-06-05 Jixuan Wang , Martin Radfar , Kai Wei , Clement Chung

Target speech separation is the process of filtering a certain speaker's voice out of speech mixtures according to the additional speaker identity information provided. Recent works have made considerable improvement by processing signals…

声音 · 计算机科学 2021-09-28 Qingjian Lin , Lin Yang , Xuyang Wang , Luyuan Xie , Chen Jia , Junjie Wang

Recently, various neural models for multi-party conversation (MPC) have achieved impressive improvements on a variety of tasks such as addressee recognition, speaker identification and response prediction. However, these existing methods on…

计算与语言 · 计算机科学 2021-06-04 Jia-Chen Gu , Chongyang Tao , Zhen-Hua Ling , Can Xu , Xiubo Geng , Daxin Jiang

One-shot voice conversion (VC) aims to convert speech from any source speaker to an arbitrary target speaker with only a few seconds of reference speech from the target speaker. This relies heavily on disentangling the speaker's identity…

音频与语音处理 · 电气工程与系统科学 2023-01-02 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Voice conversion (VC) aims to modify the speaker's identity while preserving the linguistic content. Commonly, VC methods use an encoder-decoder architecture, where disentangling the speaker's identity from linguistic information is…

音频与语音处理 · 电气工程与系统科学 2024-09-19 Philip H. Lee , Ismail Rasim Ulgen , Berrak Sisman

Transcription or sub-titling of open-domain videos is still a challenging domain for Automatic Speech Recognition (ASR) due to the data's challenging acoustics, variable signal processing and the essentially unrestricted domain of the data.…

音频与语音处理 · 电气工程与系统科学 2018-04-27 Shruti Palaskar , Ramon Sanabria , Florian Metze

Single-channel, speaker-independent speech separation methods have recently seen great progress. However, the accuracy, latency, and computational cost of such methods remain insufficient. The majority of the previous methods have…

声音 · 计算机科学 2019-05-16 Yi Luo , Nima Mesgarani

Recently, there has been increasing progress in end-to-end automatic speech recognition (ASR) architecture, which transcribes speech to text without any pre-trained alignments. One popular end-to-end approach is the hybrid Connectionist…

音频与语音处理 · 电气工程与系统科学 2023-07-06 Haoran Miao , Gaofeng Cheng , Pengyuan Zhang , Yonghong Yan