中文
相关论文

相关论文: Target Speaker Extraction by Directly Exploiting C…

200 篇论文

Traditional speech separation and speaker diarization approaches rely on prior knowledge of target speakers or a predetermined number of participants in audio signals. To address these limitations, recent advances focus on developing…

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker…

声音 · 计算机科学 2024-12-25 Xuechen Liu , Junichi Yamagishi , Md Sahidullah , Tomi kinnunen

Target Sound Extraction (TSE) focuses on the problem of separating sources of interest, indicated by a user's cue, from the input mixture. Most existing solutions operate in an offline fashion and are not suited to the low-latency causal…

音频与语音处理 · 电气工程与系统科学 2024-03-22 Shrishail Baligar , Mikolaj Kegler , Bryce Irvin , Marko Stamenovic , Shawn Newsam

Recent years have seen a surge in the number of available frameworks for speech enhancement (SE) and recognition. Whether model-based or constructed via deep learning, these frameworks often rely in isolation on either time-domain signals…

声音 · 计算机科学 2021-06-01 Sherif Abdulatif , Karim Armanious , Jayasankar T. Sajeev , Karim Guirguis , Bin Yang

We propose a novel framework for target speech extraction based on semantic information, called ConceptBeam. Target speech extraction means extracting the speech of a target speaker in a mixture. Typical approaches have been exploiting…

音频与语音处理 · 电气工程与系统科学 2022-07-26 Yasunori Ohishi , Marc Delcroix , Tsubasa Ochiai , Shoko Araki , Daiki Takeuchi , Daisuke Niizumi , Akisato Kimura , Noboru Harada , Kunio Kashino

Most studies on speech enhancement generally don't consider the energy distribution of speech in time-frequency (T-F) representation, which is important for accurate prediction of mask or spectra. In this paper, we present a simple yet…

声音 · 计算机科学 2022-03-10 Qiquan Zhang , Qi Song , Zhaoheng Ni , Aaron Nicolson , Haizhou Li

This paper presents an experimental study on deep speaker embedding with an attention mechanism that has been found to be a powerful representation learning technique in speaker recognition. In this framework, an attention model works as a…

声音 · 计算机科学 2018-09-26 Qiongqiong Wang , Koji Okabe , Kong Aik Lee , Hitoshi Yamamoto , Takafumi Koshinaka

This paper introduces an improved target speaker extractor, referred to as Speakerfilter-Pro, based on our previous Speakerfilter model. The Speakerfilter uses a bi-direction gated recurrent unit (BGRU) module to characterize the target…

声音 · 计算机科学 2020-10-27 Shulin He , Hao Li , Xueliang Zhang

Speaker extraction and diarization are two enabling techniques for real-world speech applications. Speaker extraction aims to extract a target speaker's voice from a speech mixture, while speaker diarization demarcates speech segments by…

声音 · 计算机科学 2025-01-17 Junyi Ao , Mehmet Sinan Yıldırım , Ruijie Tao , Meng Ge , Shuai Wang , Yanmin Qian , Haizhou Li

The recent rapid development of auditory attention decoding (AAD) offers the possibility of using electroencephalography (EEG) as auxiliary information for target speaker extraction. However, effectively modeling long sequences of speech…

声音 · 计算机科学 2025-01-06 Cunhang Fan , Youdian Gao , Zexu Pan , Jingjing Zhang , Hongyu Zhang , Jie Zhang , Zhao Lv

Target speaker extraction aims to extract the speech of a specific speaker from a multi-talker mixture as specified by an auxiliary reference. Most studies focus on the scenario where the target speech is highly overlapped with the…

声音 · 计算机科学 2023-09-18 Junjie Li , Ruijie Tao , Zexu Pan , Meng Ge , Shuai Wang , Haizhou Li

Leveraging context information is an intuitive idea to improve performance on conversational automatic speech recognition(ASR). Previous works usually adopt recognized hypotheses of historical utterances as preceding context, which may bias…

音频与语音处理 · 电气工程与系统科学 2022-07-05 Kun Wei , Yike Zhang , Sining Sun , Lei Xie , Long Ma

In this study, we present an innovative technique for speaker adaptation in order to improve the accuracy of segmentation with application to unit-selection Text-To-Speech (TTS) systems. Unlike conventional techniques for speaker…

音频与语音处理 · 电气工程与系统科学 2020-05-01 Claudio Zito , Fabio Tesser , Mauro Nicolao , Piero Cosi

The Chinese numerical string corpus, serves as a valuable resource for speaker verification, particularly in financial transactions. Researches indicate that in short speech scenarios, text-dependent speaker verification (TD-SV)…

声音 · 计算机科学 2024-05-22 Litong Zheng , Feng Hong , Weijie Xu , Wan Zheng

An onomatopoeic word, which is a character sequence that phonetically imitates a sound, is effective in expressing characteristics of sound such as duration, pitch, and timbre. We propose an environmental-sound-extraction method using…

声音 · 计算机科学 2022-02-18 Yuki Okamoto , Shota Horiguchi , Masaaki Yamamoto , Keisuke Imoto , Yohei Kawaguchi

The objective of deep learning methods based on encoder-decoder architectures for music source separation is to approximate either ideal time-frequency masks or spectral representations of the target music source(s). The spectral…

In recent years, the impact of self-supervised speech Transformers has extended to speaker-related applications. However, little research has explored how these models encode speaker information. In this work, we address this gap by…

计算与语言 · 计算机科学 2025-06-30 Tzu-Quan Lin , Hsi-Chun Cheng , Hung-yi Lee , Hao Tang

This paper proposes a speech rhythm-based method for speaker embeddings to model phoneme duration using a few utterances by the target speaker. Speech rhythm is one of the essential factors among speaker characteristics, along with acoustic…

声音 · 计算机科学 2024-02-13 Kenichi Fujita , Atsushi Ando , Yusuke Ijima

In this paper, we investigate a novel approach for Target Speech Extraction (TSE), which relies solely on textual context to extract the target speech. We refer to this task as Contextual Speech Extraction (CSE). Unlike traditional TSE…

声音 · 计算机科学 2025-03-13 Minsu Kim , Rodrigo Mira , Honglie Chen , Stavros Petridis , Maja Pantic

The brain-assisted target speaker extraction (TSE) aims to extract the attended speech from mixed speech by utilizing the brain neural activities, for example Electroencephalography (EEG). However, existing models overlook the issue of…

音频与语音处理 · 电气工程与系统科学 2025-06-03 Cunhang Fan , Ying Chen , Jian Zhou , Zexu Pan , Jingjing Zhang , Youdian Gao , Xiaoke Yang , Zhengqi Wen , Zhao Lv