中文
相关论文

相关论文: Low-Latency Online Speaker Diarization with Graph-…

200 篇论文

This work proposes a frame-wise online/streaming end-to-end neural diarization (EEND) method, which detects speaker activities in a frame-in-frame-out fashion. The proposed model mainly consists of a causal embedding encoder and an online…

音频与语音处理 · 电气工程与系统科学 2025-09-09 Di Liang , Xiaofei Li

A method to perform offline and online speaker diarization for an unlimited number of speakers is described in this paper. End-to-end neural diarization (EEND) has achieved overlap-aware speaker diarization by formulating it as a…

音频与语音处理 · 电气工程与系统科学 2023-05-29 Shota Horiguchi , Shinji Watanabe , Paola Garcia , Yuki Takashima , Yohei Kawaguchi

Current speaker diarization systems rely on an external voice activity detection model prior to speaker embedding extraction on the detected speech segments. In this paper, we establish that the attention system of a speaker embedding…

音频与语音处理 · 电气工程与系统科学 2024-05-16 Jenthe Thienpondt , Kris Demuynck

For many years, i-vector based audio embedding techniques were the dominant approach for speaker verification and speaker diarization applications. However, mirroring the rise of deep learning in various domains, neural network based audio…

音频与语音处理 · 电气工程与系统科学 2022-01-25 Quan Wang , Carlton Downey , Li Wan , Philip Andrew Mansfield , Ignacio Lopez Moreno

A robust multichannel speaker diarization and separation system is proposed by exploiting the spatio-temporal activity of the speakers. The system is realized in a hybrid architecture that combines the array signal processing units and the…

音频与语音处理 · 电气工程与系统科学 2024-01-31 Yicheng Hsu , Ssuhan Chen , Mingsian R. Bai

Speaker verification based on ad-hoc microphone arrays has the potential of reducing the error significantly in adverse acoustic environments. However, existing approaches extract utterance-level speaker embeddings from each channel of an…

声音 · 计算机科学 2022-03-29 Chengdong Liang , Yijiang Chen , Jiadi Yao , Xiao-Lei Zhang

Speaker diarization(SD) is a classic task in speech processing and is crucial in multi-party scenarios such as meetings and conversations. Current mainstream speaker diarization approaches consider acoustic information only, which result in…

计算与语言 · 计算机科学 2023-05-23 Luyao Cheng , Siqi Zheng , Zhang Qinglin , Hui Wang , Yafeng Chen , Qian Chen

Attributed networks containing entity-specific information in node attributes are ubiquitous in modeling social networks, e-commerce, bioinformatics, etc. Their inherent network topology ranges from simple graphs to hypergraphs with…

社会与信息网络 · 计算机科学 2024-10-08 Yiran Li , Gongyao Guo , Jieming Shi , Renchi Yang , Shiqi Shen , Qing Li , Jun Luo

This paper describes the submission to the speaker diarization track of VoxCeleb Speaker Recognition Challenge 2021 done by North America Bixby Lab of Samsung Research America. Our speaker diarization system consists of four main components…

音频与语音处理 · 电气工程与系统科学 2021-09-29 Myungjong Kim , Taeyeon Ki , Aviral Anshu , Vijendra Raj Apsingekar

Graph-based temporal classification (GTC), a generalized form of the connectionist temporal classification loss, was recently proposed to improve automatic speech recognition (ASR) systems using graph-based supervision. For example, GTC was…

声音 · 计算机科学 2022-03-02 Xuankai Chang , Niko Moritz , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux

Speaker diarization, the process of segmenting an audio stream or transcribed speech content into homogenous partitions based on speaker identity, plays a crucial role in the interpretation and analysis of human speech. Most existing…

机器学习 · 计算机科学 2024-08-23 Luyao Cheng , Hui Wang , Siqi Zheng , Yafeng Chen , Rongjie Huang , Qinglin Zhang , Qian Chen , Xihao Li

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

音频与语音处理 · 电气工程与系统科学 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy

This paper describes the submissions of team TalTech-IRIT-LIS to the DISPLACE 2024 challenge. Our team participated in the speaker diarization and language diarization tracks of the challenge. In the speaker diarization track, our best…

音频与语音处理 · 电气工程与系统科学 2024-07-18 Joonas Kalda , Tanel Alumäe , Martin Lebourdais , Hervé Bredin , Séverin Baroudi , Ricard Marxer

Data labeling is a necessary but often slow process that impedes the development of interactive systems for modern data analysis. Despite rising demand for manual data labeling, there is a surprising lack of work addressing its high and…

数据库 · 计算机科学 2015-09-22 Daniel Haas , Jiannan Wang , Eugene Wu , Michael J. Franklin

In this paper, we introduce DiarizationLM, a framework to leverage large language models (LLM) to post-process the outputs from a speaker diarization system. Various goals can be achieved with the proposed framework, such as improving the…

音频与语音处理 · 电气工程与系统科学 2025-01-10 Quan Wang , Yiling Huang , Guanlong Zhao , Evan Clark , Wei Xia , Hank Liao

In this paper, we propose a speaker verification method by an Attentive Multi-scale Convolutional Recurrent Network (AMCRN). The proposed AMCRN can acquire both local spatial information and global sequential information from the input…

音频与语音处理 · 电气工程与系统科学 2023-06-02 Yanxiong Li , Zhongjie Jiang , Wenchang Cao , Qisheng Huang

This paper presents the system developed for Task 1 of the Multi-modal Information-based Speech Processing (MISP) 2025 Challenge. We introduce CASA-Net, an embedding fusion method designed for end-to-end audio-visual speaker diarization…

声音 · 计算机科学 2025-06-04 Zhaoyang Li , Haodong Zhou , Longjie Luo , Xiaoxiao Li , Yongxin Chen , Lin Li , Qingyang Hong

Knowledge distillation (KD) is used to enhance automatic speaker verification performance by ensuring consistency between large teacher networks and lightweight student networks at the embedding level or label level. However, the…

声音 · 计算机科学 2024-06-28 Duc-Tuan Truong , Ruijie Tao , Jia Qi Yip , Kong Aik Lee , Eng Siong Chng

As deep neural networks can easily overfit noisy labels, robust training in the presence of noisy labels is becoming an important challenge in modern deep learning. While existing methods address this problem in various directions, they…

机器学习 · 计算机科学 2022-11-30 Jongwoo Ko , Bongsoo Yi , Se-Young Yun

CTC-based streaming ASR has gained significant attention in real-world applications but faces two main challenges: accuracy degradation in small chunks and token emission latency. To mitigate these challenges, we propose Delayed-KD, which…

声音 · 计算机科学 2025-05-29 Longhao Li , Yangze Li , Hongfei Xue , Jie Liu , Shuai Fang , Kai Wang , Lei Xie