English
Related papers

Related papers: Decoupling Magnitude and Phase Estimation with Dee…

200 papers

Given recent advances in deep music source separation, we propose a feature representation method that combines source separation with a state-of-the-art representation learning technique that is suitably repurposed for computer audition…

Sound · Computer Science 2020-12-08 Gabriel Mersy , Jin Hong Kuan

Most deep learning-based models for speech enhancement have mainly focused on estimating the magnitude of spectrogram while reusing the phase from noisy speech for reconstruction. This is due to the difficulty of estimating the phase of…

Sound · Computer Science 2019-04-03 Hyeong-Seok Choi , Jang-Hyun Kim , Jaesung Huh , Adrian Kim , Jung-Woo Ha , Kyogu Lee

The task of manipulating the level and/or effects of individual instruments to recompose a mixture of recordings, or remixing, is common across a variety of applications such as music production, audio-visual post-production, podcasts, and…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-25 Haici Yang , Shivani Firodiya , Nicholas J. Bryan , Minje Kim

In this work we present a new single-microphone speech dereverberation algorithm. First, a performance analysis is presented to interpret that algorithms focused on improving solely magnitude or phase are not good enough. Furthermore, we…

Sound · Computer Science 2022-11-02 Ayal Schwartz , Sharon Gannot , Shlomo E. Chazan

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

Machine Learning · Statistics 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani

This work addresses the problem of multichannel source separation combining two powerful approaches, multichannel spectral factorization with recent monophonic deep-learning (DL) based spectrum inference. Individual source spectra at…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-04 Antonio J. Muñoz-Montoro , Julio J. Carabias-Orti , Archontis Politis , Konstantinos Drossos

Deep learning based speech enhancement and source separation systems have recently reached unprecedented levels of quality, to the point that performance is reaching a new ceiling. Most systems rely on estimating the magnitude of a target…

Sound · Computer Science 2019-06-26 Jonathan Le Roux , Gordon Wichern , Shinji Watanabe , Andy Sarroff , John R. Hershey

In this paper, we present an efficient neural network for end-to-end general purpose audio source separation. Specifically, the backbone structure of this convolutional network is the SUccessive DOwnsampling and Resampling of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-14 Efthymios Tzinis , Zhepei Wang , Paris Smaragdis

Choral singing is a widely practiced form of ensemble singing wherein a group of people sing simultaneously in polyphonic harmony. The most commonly practiced setting for choir ensembles consists of four parts; Soprano, Alto, Tenor and Bass…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-19 Darius Petermann , Pritish Chandna , Helena Cuesta , Jordi Bonada , Emilia Gomez

In this paper, a novel approach for single channel source separation (SCSS) using a deep neural network (DNN) architecture is introduced. Unlike previous studies in which DNN and other classifiers were used for classifying time-frequency…

Neural and Evolutionary Computing · Computer Science 2013-11-13 Emad M. Grais , Mehmet Umut Sen , Hakan Erdogan

Source separation models either work on the spectrogram or waveform domain. In this work, we show how to perform end-to-end hybrid source separation, letting the model decide which domain is best suited for each source, and even combining…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-31 Alexandre Défossez

Phase information has a significant impact on speech perceptual quality and intelligibility. However, existing speech enhancement methods encounter limitations in explicit phase estimation due to the non-structural nature and wrapping…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-02 Ye-Xin Lu , Yang Ai , Zhen-Hua Ling

The state of the art in music source separation employs neural networks trained in a supervised fashion on multi-track databases to estimate the sources from a given mixture. With only few datasets available, often extensive data…

Machine Learning · Computer Science 2018-04-09 Daniel Stoller , Sebastian Ewert , Simon Dixon

In recent years, significant advances have been made in music source separation, with model architectures such as dual-path modeling, band-split modules, or transformer layers achieving comparably good results. However, these models often…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-09 Yun-Ning , Hung , Igor Pereira , Filip Korzeniowski

Recent approaches for music source separation are almost exclusively based on deep neural networks, mostly employing recurrent neural networks (RNNs). Although RNNs are in many cases superior than other types of deep neural networks for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-08 Pyry Pyykkönen , Styliannos I. Mimilakis , Konstantinos Drossos , Tuomas Virtanen

We propose a time-domain audio source separation method using down-sampling (DS) and up-sampling (US) layers based on a discrete wavelet transform (DWT). The proposed method is based on one of the state-of-the-art deep neural networks,…

Sound · Computer Science 2022-12-05 Tomohiko Nakamura , Hiroshi Saruwatari

Identification and extraction of singing voice from within musical mixtures is a key challenge in source separation and machine audition. Recently, deep neural networks (DNN) have been used to estimate 'ideal' binary masks for carefully…

Sound · Computer Science 2015-04-21 Andrew J. R. Simpson , Gerard Roma , Mark D. Plumbley

Separating a singing voice from its music accompaniment remains an important challenge in the field of music information retrieval. We present a unique neural network approach inspired by a technique that has revolutionized the field of…

Sound · Computer Science 2018-12-05 Kin Wah Edward Lin , Balamurali B. T. , Enyan Koh , Simon Lui , Dorien Herremans

Nowadays, commercial music has extreme loudness and heavily compressed dynamic range compared to the past. Yet, in music source separation, these characteristics have not been thoroughly considered, resulting in the domain mismatch between…

Sound · Computer Science 2022-08-31 Chang-Bin Jeon , Kyogu Lee

The Inaugural Music Source Restoration (MSR) Challenge targets the recovery of original, unprocessed stems from fully mixed and mastered music. Unlike conventional music source separation, MSR requires reversing complex production processes…

Sound · Computer Science 2026-03-19 Xinlong Deng , Yu Xia , Jie Jiang