中文
相关论文

相关论文: Multichannel Audio Source Separation with Independ…

200 篇论文

A promising approach for multi-microphone speech separation involves two deep neural networks (DNN), where the predicted target speech from the first DNN is used to compute signal statistics for time-invariant minimum variance…

声音 · 计算机科学 2021-10-04 Zhong-Qiu Wang , Gordon Wichern , Jonathan Le Roux

Sound processing in the human auditory system is complex and highly non-linear, whereas hearing aids (HAs) still rely on simplified descriptions of auditory processing or hearing loss to restore hearing. Even though standard HA…

音频与语音处理 · 电气工程与系统科学 2023-06-21 Fotios Drakopoulos , Sarah Verhulst

This paper presents a speech intelligibility model based on automatic speech recognition (ASR), combining phoneme probabilities from deep neural networks (DNN) and a performance measure that estimates the word error rate from these…

While traditional statistical signal processing model-based methods can derive the optimal estimators relying on specific statistical assumptions, current learning-based methods further promote the performance upper bound via deep neural…

声音 · 计算机科学 2022-03-17 Andong Li , Chengshi Zheng , Ziyang Zhang , Xiaodong Li

We study the problem of source separation for music using deep learning with four known sources: drums, bass, vocals and other accompaniments. State-of-the-art approaches predict soft masks over mixture spectrograms while methods working on…

声音 · 计算机科学 2019-09-04 Alexandre Défossez , Nicolas Usunier , Léon Bottou , Francis Bach

Conventional NMF methods for source separation factorize the matrix of spectral magnitudes. Spectral Phase is not included in the decomposition process of these methods. However, phase of the speech mixture is generally used in…

声音 · 计算机科学 2014-11-26 Chaitanya Ahuja , Karan Nathwani , Rajesh M. Hegde

The task of estimating the maximum number of concurrent speakers from single channel mixtures is important for various audio-based applications, such as blind source separation, speaker diarisation, audio surveillance or auditory scene…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Fabian-Robert Stöter , Soumitro Chakrabarty , Bernd Edler , Emanuël A. P. Habets

Time-frequency masking or spectrum prediction computed via short symmetric windows are commonly used in low-latency deep neural network (DNN) based source separation. In this paper, we propose the usage of an asymmetric analysis-synthesis…

音频与语音处理 · 电气工程与系统科学 2021-06-23 Shanshan Wang , Gaurav Naithani , Archontis Politis , Tuomas Virtanen

Noise reduction techniques based on deep learning have demonstrated impressive performance in enhancing the overall quality of recorded speech. While these approaches are highly performant, their application in audio engineering can be…

声音 · 计算机科学 2023-10-18 Christian J. Steinmetz , Thomas Walther , Joshua D. Reiss

Music source separation in the time-frequency domain is commonly achieved by applying a soft or binary mask to the magnitude component of (complex) spectrograms. The phase component is usually not estimated, but instead copied from the…

声音 · 计算机科学 2021-03-25 Andreas Jansson , Rachel M. Bittner , Nicola Montecchio , Tillman Weyde

Extracting direct-path spatial feature is crucial for sound source localization in adverse acoustic environments. This paper proposes the IPDnet, a neural network that estimates direct-path inter-channel phase difference (DP-IPD) of sound…

音频与语音处理 · 电气工程与系统科学 2024-05-14 Yabo Wang , Bing Yang , Xiaofei Li

In Gaussian model-based multichannel audio source separation, the likelihood of observed mixtures of source signals is parametrized by source spectral variances and by associated spatial covariance matrices. These parameters are estimated…

声音 · 计算机科学 2026-04-15 Mahmoud Fakhry , Piergiorgio Svaizer , Maurizio Omologo

Many purely neural network based speech separation approaches have been proposed to improve objective assessment scores, but they often introduce nonlinear distortions that are harmful to modern automatic speech recognition (ASR) systems.…

音频与语音处理 · 电气工程与系统科学 2021-11-17 Zhuohuang Zhang , Yong Xu , Meng Yu , Shi-Xiong Zhang , Lianwu Chen , Donald S. Williamson , Dong Yu

Many audio processing tasks require perceptual assessment. The ``gold standard`` of obtaining human judgments is time-consuming, expensive, and cannot be used as an optimization criterion. On the other hand, automated metrics are efficient…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Pranay Manocha , Adam Finkelstein , Richard Zhang , Nicholas J. Bryan , Gautham J. Mysore , Zeyu Jin

We introduce a new information maximization (infomax) approach for the blind source separation problem. The proposed framework provides an information-theoretic perspective for determinant maximization-based structured matrix factorization…

信息论 · 计算机科学 2022-05-03 Alper T. Erdogan

In a multi-channel separation task with multiple speakers, we aim to recover all individual speech signals from the mixture. In contrast to single-channel approaches, which rely on the different spectro-temporal characteristics of the…

音频与语音处理 · 电气工程与系统科学 2024-01-11 Kristina Tesch , Timo Gerkmann

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

音频与语音处理 · 电气工程与系统科学 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu

Major Depressive Disorder (MDD) is a severe illness that affects millions of people, and it is critical to diagnose this disorder as early as possible. Detecting depression from voice signals can be of great help to physicians and can be…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Jinhan Wang , Vijay Ravi , Jonathan Flint , Abeer Alwan

Noisy labels are commonly found in real-world data, which cause performance degradation of deep neural networks. Cleaning data manually is labour-intensive and time-consuming. Previous research mostly focuses on enhancing classification…

机器学习 · 计算机科学 2021-12-20 Chang Liu , Han Yu , Boyang Li , Zhiqi Shen , Zhanning Gao , Peiran Ren , Xuansong Xie , Lizhen Cui , Chunyan Miao

Source separation is the process of isolating individual sounds in an auditory mixture of multiple sounds [1], and has a variety of applications ranging from speech enhancement and lyric transcription [2] to digital audio production for…

声音 · 计算机科学 2024-12-10 Bradford Derby , Lucas Dunker , Samarth Galchar , Shashank Jarmale , Akash Setti