中文
相关论文

相关论文: Spatial-Temporal Activity-Informed Diarization and…

200 篇论文

Audio-visual speech separation aims to isolate each speaker's clean voice from mixtures by leveraging visual cues such as lip movements and facial features. While visual information provides complementary semantic guidance, existing methods…

声音 · 计算机科学 2025-10-13 Ke Xue , Rongfei Fan , Lixin , Dawei Zhao , Chao Zhu , Han Hu

We propose an approach for simultaneous diarization and separation of meeting data. It consists of a complex Angular Central Gaussian Mixture Model (cACGMM) for speech source separation, and a von-Mises-Fisher Mixture Model (VMFMM) for…

音频与语音处理 · 电气工程与系统科学 2025-02-25 Tobias Cord-Landwehr , Christoph Boeddeker , Reinhold Haeb-Umbach

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and…

音频与语音处理 · 电气工程与系统科学 2020-11-05 Desh Raj , Pavel Denisov , Zhuo Chen , Hakan Erdogan , Zili Huang , Maokui He , Shinji Watanabe , Jun Du , Takuya Yoshioka , Yi Luo , Naoyuki Kanda , Jinyu Li , Scott Wisdom , John R. Hershey

Speaker diarization, the process of identifying "who spoke when" in audio recordings, is essential for understanding classroom dynamics. However, classroom settings present distinct challenges, including poor recording quality, high levels…

声音 · 计算机科学 2025-05-28 Ali Sartaz Khan , Tolulope Ogunremi , Ahmed Adel Attia , Dorottya Demszky

The rapid population aging has stimulated the development of assistive devices that provide personalized medical support to the needies suffering from various etiologies. One prominent clinical application is a computer-assisted speech…

计算与语言 · 计算机科学 2019-05-22 Emre Yılmaz , Vikramjit Mitra , Ganesh Sivaraman , Horacio Franco

The objective of this work is effective speaker diarisation using multi-scale speaker embeddings. Typically, there is a trade-off between the ability to recognise short speaker segments and the discriminative power of the embedding,…

音频与语音处理 · 电气工程与系统科学 2021-10-11 Youngki Kwon , Hee-Soo Heo , Jee-weon Jung , You Jin Kim , Bong-Jin Lee , Joon Son Chung

Encouraged by the success of deep neural networks on a variety of visual tasks, much theoretical and experimental work has been aimed at understanding and interpreting how vision networks operate. Meanwhile, deep neural networks have also…

Speaker diarization relies on the assumption that speech segments corresponding to a particular speaker are concentrated in a specific region of the speaker space; a region which represents that speaker's identity. These identities are not…

音频与语音处理 · 电气工程与系统科学 2021-02-09 Nikolaos Flemotomos , Panayiotis Georgiou , Shrikanth Narayanan

In daily listening environments, speech is always distorted by background noise, room reverberation and interference speakers. With the developing of deep learning approaches, much progress has been performed on monaural multi-speaker…

音频与语音处理 · 电气工程与系统科学 2020-08-04 Chao Ma , Dongmei Li , Xupeng Jia

Speaker diarization aims to segment audio recordings into regions corresponding to individual speakers. Although unsupervised speaker diarization is inherently challenging, the prospect of identifying speaker regions without pretraining or…

音频与语音处理 · 电气工程与系统科学 2026-01-30 Nikhil Raghav , Avisek Gupta , Swagatam Das , Md Sahidullah

Recently, hybrid systems of clustering and neural diarization models have been successfully applied in multi-party meeting analysis. However, current models always treat overlapped speaker diarization as a multi-label classification…

声音 · 计算机科学 2022-11-21 Zhihao Du , Shiliang Zhang , Siqi Zheng , Zhijie Yan

This paper describes system setup of our submission to speaker diarisation track (Track 4) of VoxCeleb Speaker Recognition Challenge 2020. Our diarisation system consists of a well-trained neural network based speech enhancement model as…

声音 · 计算机科学 2020-10-26 Renyu Wang , Ruilin Tong , Yu Ting Yeung , Xiao Chen

One of the leading single-channel speech separation (SS) models is based on a TasNet with a dual-path segmentation technique, where the size of each segment remains unchanged throughout all layers. In contrast, our key finding is that…

音频与语音处理 · 电气工程与系统科学 2021-03-09 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

This study describes a binaural machine hearing system that is capable of performing auditory stream segregation in scenarios where multiple sound sources are present. The process of stream segregation refers to the capability of human…

声音 · 计算机科学 2016-06-27 Christopher Schymura , Thomas Walther , Dorothea Kolossa

Single-channel, speaker-independent speech separation methods have recently seen great progress. However, the accuracy, latency, and computational cost of such methods remain insufficient. The majority of the previous methods have…

声音 · 计算机科学 2019-05-16 Yi Luo , Nima Mesgarani

Current deep neural network (DNN) based speech separation faces a fundamental challenge -- while the models need to be trained on short segments due to computational constraints, real-world applications typically require processing…

音频与语音处理 · 电气工程与系统科学 2025-07-04 Yuzhu Wang , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

Current multichannel speech enhancement algorithms typically assume a stationary sound source, a common mismatch with reality that limits their performance in real-world scenarios. This paper focuses on attention-driven spatial filtering…

音频与语音处理 · 电气工程与系统科学 2023-12-19 Yuzhu Wang , Archontis Politis , Tuomas Virtanen

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detection, and overlapped…

音频与语音处理 · 电气工程与系统科学 2021-06-11 Hervé Bredin , Antoine Laurent

Recently, deep learning-based beamforming algorithms have shown promising performance in target speech extraction tasks. However, most systems do not fully utilize spatial information. In this paper, we propose a target speech extraction…

声音 · 计算机科学 2023-06-29 Aoqi Guo , Junnan Wu , Peng Gao , Wenbo Zhu , Qinwen Guo , Dazhi Gao , Yujun Wang

Despite achieving satisfactory performance in speaker verification using deep neural networks, variable-duration utterances remain a challenge that threatens the robustness of systems. To deal with this issue, we propose a speaker…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Ju-ho Kim , Hye-jin Shim , Jungwoo Heo , Ha-Jin Yu