中文
相关论文

相关论文: Analysis of the BUT Diarization System for VoxConv…

200 篇论文

The aim of this paper is to investigate the benefit of combining both language and acoustic modelling for speaker diarization. Although conventional systems only use acoustic features, in some scenarios linguistic data contain high…

音频与语音处理 · 电气工程与系统科学 2025-01-31 Miquel India , Javier Hernando , José A. R. Fonollosa

Combining end-to-end neural speaker diarization (EEND) with vector clustering (VC), known as EEND-VC, has gained interest for leveraging the strengths of both methods. EEND-VC estimates activities and speaker embeddings for all speakers…

音频与语音处理 · 电气工程与系统科学 2023-05-24 Marc Delcroix , Naohiro Tawara , Mireia Diez , Federico Landini , Anna Silnova , Atsunori Ogawa , Tomohiro Nakatani , Lukas Burget , Shoko Araki

This paper presents the system developed to address the MISP 2025 Challenge. For the diarization system, we proposed a hybrid approach combining a WavLM end-to-end segmentation method with a traditional multi-module clustering technique to…

声音 · 计算机科学 2025-05-29 Shangkun Huang , Yuxuan Du , Jingwen Yang , Dejun Zhang , Xupeng Jia , Jing Deng , Jintao Kang , Rong Zheng

Speaker embedding extractors (EEs), which map input audio to a speaker discriminant latent space, are of paramount importance in speaker diarisation. However, there are several challenges when adopting EEs for diarisation, from which we…

We propose two improvements to target-speaker voice activity detection (TS-VAD), the core component in our proposed speaker diarization system that was submitted to the 2022 Multi-Channel Multi-Party Meeting Transcription (M2MeT) challenge.…

音频与语音处理 · 电气工程与系统科学 2022-02-11 Maokui He , Xiang Lv , Weilin Zhou , JingJing Yin , Xiaoqi Zhang , Yuxuan Wang , Shutong Niu , Yuhang Cao , Heng Lu , Jun Du , Chin-Hui Lee

Since diarization and source separation of meeting data are closely related tasks, we here propose an approach to perform the two objectives jointly. It builds upon the target-speaker voice activity detection (TS-VAD) diarization approach,…

音频与语音处理 · 电气工程与系统科学 2025-01-23 Christoph Boeddeker , Aswin Shanmugam Subramanian , Gordon Wichern , Reinhold Haeb-Umbach , Jonathan Le Roux

This paper investigates the use of target-speaker automatic speech recognition (TS-ASR) for simultaneous speech recognition and speaker diarization of single-channel dialogue recordings. TS-ASR is a technique to automatically extract and…

计算与语言 · 计算机科学 2019-09-19 Naoyuki Kanda , Shota Horiguchi , Yusuke Fujita , Yawen Xue , Kenji Nagamatsu , Shinji Watanabe

This paper investigates the utilization of an end-to-end diarization model as post-processing of conventional clustering-based diarization. Clustering-based diarization methods partition frames into clusters of the number of speakers; thus,…

音频与语音处理 · 电气工程与系统科学 2020-12-24 Shota Horiguchi , Paola Garcia , Yusuke Fujita , Shinji Watanabe , Kenji Nagamatsu

Speech applications dealing with conversations require not only recognizing the spoken words but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate systems,…

计算与语言 · 计算机科学 2024-09-04 Grigor Kirakosyan , Davit Karamyan

In this report, we describe the Beijing ZKJ-NPU team submission to the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). We participated in the fully supervised speaker verification track 1 and track 2. In the challenge, we explored…

声音 · 计算机科学 2021-11-19 Li Zhang , Huan Zhao , Qinling Meng , Yanli Chen , Min Liu , Lei Xie

With the rise in multimedia content over the years, more variety is observed in the recording environments of audio. An audio processing system might benefit when it has a module to identify the acoustic domain at its front-end. In this…

声音 · 计算机科学 2022-08-09 A Kishore Kumar , Shefali Waldekar , Md Sahidullah , Goutam Saha

Target-speaker voice activity detection is currently a promising approach for speaker diarization in complex acoustic environments. This paper presents a novel Sequence-to-Sequence Target-Speaker Voice Activity Detection (Seq2Seq-TSVAD)…

音频与语音处理 · 电气工程与系统科学 2023-02-21 Ming Cheng , Weiqing Wang , Yucong Zhang , Xiaoyi Qin , Ming Li

Speaker modeling is essential for many related tasks, such as speaker recognition and speaker diarization. The dominant modeling approach is fixed-dimensional vector representation, i.e., speaker embedding. This paper introduces a research…

Speaker diarization remains challenging due to the need for structured speaker representations, efficient modeling, and robustness to varying conditions. We propose a performant, compact diarization framework that integrates conformer…

声音 · 计算机科学 2025-06-16 David Palzer , Matthew Maciejewski , Eric Fosler-Lussier

This paper describes the speaker diarization system developed for the Multimodal Information-Based Speech Processing (MISP) 2025 Challenge. First, we utilize the Sequence-to-Sequence Neural Diarization (S2SND) framework to generate initial…

音频与语音处理 · 电气工程与系统科学 2025-05-23 Ming Cheng , Fei Su , Cancan Li , Juan Liu , Ming Li

In this paper, we provide a large audio-visual speaker recognition dataset, VoxBlink2, which includes approximately 10M utterances with videos from 110K+ speakers in the wild. This dataset represents a significant expansion over the…

音频与语音处理 · 电气工程与系统科学 2024-07-17 Yuke Lin , Ming Cheng , Fulin Zhang , Yingying Gao , Shilei Zhang , Ming Li

The goal of this paper is to learn robust speaker representation for bilingual speaking scenario. The majority of the world's population speak at least two languages; however, most speaker recognition systems fail to recognise the same…

音频与语音处理 · 电气工程与系统科学 2023-06-08 Kihyun Nam , Youkyum Kim , Jaesung Huh , Hee Soo Heo , Jee-weon Jung , Joon Son Chung

Speaker diarization(SD) is a classic task in speech processing and is crucial in multi-party scenarios such as meetings and conversations. Current mainstream speaker diarization approaches consider acoustic information only, which result in…

计算与语言 · 计算机科学 2023-05-23 Luyao Cheng , Siqi Zheng , Zhang Qinglin , Hui Wang , Yafeng Chen , Qian Chen

Using a Teacher-Student training approach we developed a speaker embedding extraction system that outputs embeddings at frame rate. Given this high temporal resolution and the fact that the student produces sensible speaker embeddings even…

音频与语音处理 · 电气工程与系统科学 2023-06-02 Tobias Cord-Landwehr , Christoph Boeddeker , Cătălin Zorilă , Rama Doddipatla , Reinhold Haeb-Umbach

This report describes the submission of the DKU-DukeECE team to the self-supervision speaker verification task of the 2021 VoxCeleb Speaker Recognition Challenge (VoxSRC). Our method employs an iterative labeling framework to learn…

音频与语音处理 · 电气工程与系统科学 2021-09-08 Danwei Cai , Ming Li