English
Related papers

Related papers: Do Music Source Separation Models Preserve Spatial…

200 papers

Immersive communication has made significant advancements, especially with the release of the codec for Immersive Voice and Audio Services. Aiming at its further realization, the DCASE 2025 Challenge has recently introduced a task for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-10 Binh Thien Nguyen , Masahiro Yasuda , Daiki Takeuchi , Daisuke Niizumi , Yasunori Ohishi , Noboru Harada

Spatial audio enhances immersion in applications such as virtual reality, augmented reality, gaming, and cinema by creating a three-dimensional auditory experience. Ensuring the spatial fidelity of binaural audio is crucial, given that…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Davoud Shariat Panah , Dan Barry , Alessandro Ragano , Jan Skoglund , Andrew Hines

Machine learning techniques, such as Transformers and Long Short-Term Memory (LSTM) networks, play a crucial role in Symbolic Music Generation (SMG). Existing literature indicates a difference between LSTMs and Transformers regarding their…

Machine Learning · Computer Science 2026-03-24 Soudeep Ghoshal , Sandipan Chakraborty , Pradipto Chowdhury , Himanshu Buckchash

We propose multi-microphone complex spectral mapping, a simple way of applying deep learning for time-varying non-linear beamforming, for speaker separation in reverberant conditions. We aim at both speaker separation and dereverberation.…

Sound · Computer Science 2021-05-25 Zhong-Qiu Wang , Peidong Wang , DeLiang Wang

Blind source separation (BSS) techniques aims at joint estimation of source signals and a mixing matrix from observations of mixtures. This paper addresses a doubly nonstationary BSS problem, where the mixing matrix is time dependent and…

Signal Processing · Electrical Eng. & Systems 2019-06-25 Adrien Meynard

In recent years, significant advances have been made in music source separation, with model architectures such as dual-path modeling, band-split modules, or transformer layers achieving comparably good results. However, these models often…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-09 Yun-Ning , Hung , Igor Pereira , Filip Korzeniowski

In this paper, we formulate a blind source separation (BSS) framework, which allows integrating U-Net based deep learning source separation network with probabilistic spatial machine learning expectation maximization (EM) algorithm for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-01 Sania Gul , Muhammad Salman Khan , Syed Waqar Shah

Binaural speech separation in real-world scenarios often involves moving speakers. Most current speech separation methods use utterance-level permutation invariant training (u-PIT) for training. In inference time, however, the order of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Cong Han , Nima Mesgarani

In the recent years, singing voice separation systems showed increased performance due to the use of supervised training. The design of training datasets is known as a crucial factor in the performance of such systems. We investigate on how…

Sound · Computer Science 2019-06-07 Laure Prétet , Romain Hennequin , Jimena Royo-Letelier , Andrea Vaglio

Spatial attributes of room acoustics have been widely studied using microphone and loudspeaker arrays. However, systems that combine both arrays, referred to as multiple-input multiple-output (MIMO) systems, have only been studied to a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Hai Morgenstern , Boaz Rafaely , Franz Zotter

Blind speech separation (BSS) aims to recover multiple speech sources from multi-channel, multi-speaker mixtures under unknown array geometry and room impulse responses. In unsupervised setup where clean target speech is not available for…

Sound · Computer Science 2025-10-13 Shulin He , Zhong-Qiu Wang

In the context of music information retrieval, similarity-based approaches are useful for a variety of tasks that benefit from a query-by-example scenario. Music however, naturally decomposes into a set of semantically meaningful factors of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-03 Sebastian Ribecky , Jakob Abeßer , Hanna Lukashevich

This dissertation proposes the study of multimodal learning in the context of musical signals. Throughout, we focus on the interaction between audio signals and text information. Among the many text sources related to music that can be used…

Sound · Computer Science 2021-11-01 Gabriel Meseguer-Brocal

The expansion of telecommunications incurs increasingly severe crosstalk and interference, and a physical layer cognitive method, called blind source separation (BSS), can effectively address these issues. BSS requires minimal prior…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Weipeng Zhang , Alexander Tait , Chaoran Huang , Thomas Ferreira de Lima , Simon Bilodeau , Eric Blow , Aashu Jha , Bhavin J. Shastri , Paul Prucnal

Recently, deep representation learning has shown strong performance in multiple audio tasks. However, its use for learning spatial representations from multichannel audio is underexplored. We investigate the use of a pretraining stage based…

Supervised deep learning approaches to underdetermined audio source separation achieve state-of-the-art performance but require a dataset of mixtures along with their corresponding isolated source signals. Such datasets can be extremely…

The premise of massive multiple-input multiple-output (MIMO) is based around coherent transmission and detection. Majority of the vast literature on massive MIMO presents performance evaluations over simplified statistical propagation…

Information Theory · Computer Science 2020-03-04 Harsh Tataria , Fredrik Tufvesson

A music mashup combines audio elements from two or more songs to create a new work. To reduce the time and effort required to make them, researchers have developed algorithms that predict the compatibility of audio elements. Prior work has…

Sound · Computer Science 2021-03-29 Jiawen Huang , Ju-Chiang Wang , Jordan B. L. Smith , Xuchen Song , Yuxuan Wang

In the past three decades, neuroimaging has provided important insights into structure-function relationships in the human brain. Recently, however, the methods for analyzing functional magnetic resonance imaging (fMRI) data have come under…

Neurons and Cognition · Quantitative Biology 2022-01-21 Philipp Kellmeyer , Roland Berkemeier , Tonio Ball

Supervised deep learning methods for performing audio source separation can be very effective in domains where there is a large amount of training data. While some music domains have enough data suitable for training a separation system,…

Sound · Computer Science 2020-10-27 Andreas Bugler , Bryan Pardo , Prem Seetharaman