中文
相关论文

相关论文: 3S-TSE: Efficient Three-Stage Target Speaker Extra…

200 篇论文

Recently, attention-based transformers have become a de facto standard in many deep learning applications including natural language processing, computer vision, signal processing, etc.. In this paper, we propose a transformer-based…

声音 · 计算机科学 2024-09-04 Tathagata Bandyopadhyay

Aspect Sentiment Triplet Extraction (ASTE) aims to recognize targets, their sentiment polarities and opinions explaining the sentiment from a sentence. ASTE could be naturally divided into 3 atom subtasks, namely target detection, opinion…

计算与语言 · 计算机科学 2021-11-18 Peiyi Wang , Tianyu Liu , Damai Dai , Runxin Xu , Baobao Chang , Zhifang Sui

Target speaker extraction aims at extracting the target speaker from a mixture of multiple speakers exploiting auxiliary information about the target speaker. In this paper, we consider a complete time-domain target speaker extraction…

音频与语音处理 · 电气工程与系统科学 2022-05-30 Ragini Sinha , Marvin Tammen , Christian Rollwage , Simon Doclo

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. To improve robustness of speaker recognition system performance in…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Yanpei Shi , Qiang Huang , Thomas Hain

Time-domain single-channel speech enhancement (SE) still remains challenging to extract the target speaker without any prior information on multi-talker conditions. It has been shown via auditory attention decoding that the brain activity…

音频与语音处理 · 电气工程与系统科学 2023-05-18 Jie Zhang , Qing-Tian Xu , Qiu-Shi Zhu , Zhen-Hua Ling

Speaker extraction algorithm relies on the speech sample from the target speaker as the reference point to focus its attention. Such a reference speech is typically pre-recorded. On the other hand, the temporal synchronization between…

音频与语音处理 · 电气工程与系统科学 2021-02-11 Zexu Pan , Ruijie Tao , Chenglin Xu , Haizhou Li

This paper introduces an improved target speaker extractor, referred to as Speakerfilter-Pro, based on our previous Speakerfilter model. The Speakerfilter uses a bi-direction gated recurrent unit (BGRU) module to characterize the target…

声音 · 计算机科学 2020-10-27 Shulin He , Hao Li , Xueliang Zhang

We present a meta-learning approach for adaptive text-to-speech (TTS) with few data. During training, we learn a multi-speaker model using a shared conditional WaveNet core and independent learned embeddings for each speaker. The aim of…

Target speaker extraction aims to isolate a specific speaker's voice from a composite of multiple sound sources, guided by an enrollment utterance or called anchor. Current methods predominantly derive speaker embeddings from the anchor and…

声音 · 计算机科学 2024-01-08 Shulin He , Huaiwen Zhang , Wei Rao , Kanghao Zhang , Yukai Ju , Yang Yang , Xueliang Zhang

In this paper, we present a novel system that separates the voice of a target speaker from multi-speaker signals, by making use of a reference signal from the target speaker. We achieve this by training two separate neural networks: (1) A…

音频与语音处理 · 电气工程与系统科学 2019-06-20 Quan Wang , Hannah Muckenhirn , Kevin Wilson , Prashant Sridhar , Zelin Wu , John Hershey , Rif A. Saurous , Ron J. Weiss , Ye Jia , Ignacio Lopez Moreno

Speaker extraction seeks to extract the clean speech of a target speaker from a multi-talker mixture speech. There have been studies to use a pre-recorded speech sample or face image of the target speaker as the speaker cue. In human…

音频与语音处理 · 电气工程与系统科学 2022-07-20 Zexu Pan , Xinyuan Qian , Haizhou Li

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

音频与语音处理 · 电气工程与系统科学 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

This document provides a brief description of the National Institute of Standards and Technology (NIST) speaker recognition evaluation (SRE) conversational telephone speech (CTS) Superset. The CTS Superset has been created in an attempt to…

声音 · 计算机科学 2021-08-17 Seyed Omid Sadjadi

This paper describes our submission to the Second Clarity Enhancement Challenge (CEC2), which consists of target speech enhancement for hearing-aid (HA) devices in noisy-reverberant environments with multiple interferers such as music and…

音频与语音处理 · 电气工程与系统科学 2023-02-17 Samuele Cornell , Zhong-Qiu Wang , Yoshiki Masuyama , Shinji Watanabe , Manuel Pariente , Nobutaka Ono

In this paper, we present a novel multi-channel speech extraction system to simultaneously extract multiple clean individual sources from a mixture in noisy and reverberant environments. The proposed method is built on an improved…

音频与语音处理 · 电气工程与系统科学 2021-06-17 Jisi Zhang , Catalin Zorila , Rama Doddipatla , Jon Barker

In recent years, a number of time-domain speech separation methods have been proposed. However, most of them are very sensitive to the environments and wide domain coverage tasks. In this paper, from the time-frequency domain perspective,…

音频与语音处理 · 电气工程与系统科学 2022-02-01 Jiangyu Han , Yanhua Long , Lukas Burget , Jan Cernocky

A speaker extraction algorithm seeks to extract the target speaker's speech from a multi-talker speech mixture. The prior studies focus mostly on speaker extraction from a highly overlapped multi-talker speech mixture. However, the…

音频与语音处理 · 电气工程与系统科学 2022-09-01 Zexu Pan , Meng Ge , Haizhou Li

The presence of multiple talkers in the surrounding environment poses a difficult challenge for real-time speech communication systems considering the constraints on network size and complexity. In this paper, we present Personalized…

音频与语音处理 · 电气工程与系统科学 2021-06-09 Ritwik Giri , Shrikant Venkataramani , Jean-Marc Valin , Umut Isik , Arvindh Krishnaswamy

Speech separation seeks to isolate individual speech signals from a multi-talk speech mixture. Despite much progress, a system well-trained on synthetic data often experiences performance degradation on out-of-domain data, such as…

声音 · 计算机科学 2025-03-18 Wupeng Wang , Zexu Pan , Jingru Lin , Shuai Wang , Haizhou Li

End-to-end simultaneous speech translation (SimulST) outputs translation while receiving the streaming speech inputs (a.k.a. streaming speech translation), and hence needs to segment the speech inputs and then translate based on the current…

计算与语言 · 计算机科学 2023-11-13 Shaolei Zhang , Yang Feng