English
Related papers

Related papers: Audio Source Separation via Multi-Scale Learning w…

200 papers

Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Feature extraction has gained increasing attention in the field of machine learning, as in order to detect patterns, extract information, or predict future observations from big data, the urge of informative features is crucial. The process…

Computation and Language · Computer Science 2016-04-06 Despoina Christou

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

Machine Learning · Statistics 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani

This paper presents a comparison of several Convolutional Neural Network (CNN) models for extracting target signals in highly noisy measurement conditions. Four CNN architectures were investigated. The first comprises six consecutive…

Signal Processing · Electrical Eng. & Systems 2024-10-11 Andrea Faúndez Quezada , Salvatore La Cavera , Sidahmed A Abayzeed

Encouraged by the success of deep neural networks on a variety of visual tasks, much theoretical and experimental work has been aimed at understanding and interpreting how vision networks operate. Meanwhile, deep neural networks have also…

Machine Learning · Computer Science 2020-03-05 Cory Stephenson , Jenelle Feather , Suchismita Padhy , Oguz Elibol , Hanlin Tang , Josh McDermott , SueYeon Chung

Despite speaker verification has achieved significant performance improvement with the development of deep neural networks, domain mismatch is still a challenging problem in this field. In this study, we propose a novel framework to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-24 Mufan Sang , Wei Xia , John H. L. Hansen

In this work, we propose an approach to music source separation that uses a generative diffusion model as a last-stage refinement on top of a deterministic separator, progressively enhancing the separated sources through iterative…

Sound · Computer Science 2026-04-28 Tornike Karchkhadze , Mohammad Rasool Izadi , Shuo Zhang , Shlomo Dubnov

The current paradigm for creating and deploying immersive audio content is based on audio objects, which are composed of an audio track and position metadata. While rendering an object-based production into a multichannel mix is…

Sound · Computer Science 2021-12-22 Daniel Arteaga , Jordi Pons

Even though convolutional neural networks (CNNs) are driving progress in medical image segmentation, standard models still have some drawbacks. First, the use of multi-scale approaches, i.e., encoder-decoder architectures, leads to a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Ashish Sinha , Jose Dolz

The topic of speech separation involves separating mixed speech with multiple overlapping speakers into several streams, with each stream containing speech from only one speaker. Many highly effective models have emerged and proliferated…

Sound · Computer Science 2024-12-25 Shaoxiang Dang , Tetsuya Matsumoto , Yoshinori Takeuchi , Hiroaki Kudo

Contemporary speech enhancement predominantly relies on audio transforms that are trained to reconstruct a clean speech waveform. The development of high-performing neural network sound recognition systems has raised the possibility of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-18 Mark R. Saddler , Andrew Francl , Jenelle Feather , Kaizhi Qian , Yang Zhang , Josh H. McDermott

Extracting individual elements from music mixtures is a valuable tool for music production and practice. While neural networks optimized to mask or transform mixture spectrograms into the individual source(s) have been the leading approach,…

Sound · Computer Science 2025-11-26 Genís Plaja-Roglans , Yun-Ning Hung , Xavier Serra , Igor Pereira

This paper presents an improved deep embedding learning method based on convolutional neural network (CNN) for text-independent speaker verification. Two improvements are proposed for x-vector embedding learning: (1) Multi-scale convolution…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-15 Bin Gu , Wu Guo

Automatic speech recognition (ASR) in multimedia content is one of the promising applications, but speech data in this kind of content are frequently mixed with background music, which is harmful for the performance of ASR. In this study,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Jeongwoo Woo , Masato Mimura , Kazuyoshi Yoshii , Tatsuya Kawahara

Audio-visual saliency prediction can draw support from diverse modality complements, but further performance enhancement is still challenged by customized architectures as well as task-specific loss functions. In recent studies, denoising…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Junwen Xiong , Peng Zhang , Tao You , Chuanyue Li , Wei Huang , Yufei Zha

Learning how objects sound from video is challenging, since they often heavily overlap in a single audio channel. Current methods for visually-guided audio source separation sidestep the issue by training with artificially mixed video…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Ruohan Gao , Kristen Grauman

Deep Learning (DL) algorithms have shown impressive performance in diverse domains. Among them, audio has attracted many researchers over the last couple of decades due to some interesting patterns--particularly in classification of audio…

Sound · Computer Science 2022-06-16 Muhammad Turab , Teerath Kumar , Malika Bendechache , Takfarinas Saber

Deep neural networks suffer from performance decay when there is domain shift between the labeled source domain and unlabeled target domain, which motivates the research on domain adaptation (DA). Conventional DA methods usually assume that…

Machine Learning · Computer Science 2020-02-10 Sicheng Zhao , Guangzhi Wang , Shanghang Zhang , Yang Gu , Yaxian Li , Zhichao Song , Pengfei Xu , Runbo Hu , Hua Chai , Kurt Keutzer

Informed speaker extraction aims to extract a target speech signal from a mixture of sources given prior knowledge about the desired speaker. Recent deep learning-based methods leverage a speaker discriminative model that maps a reference…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-17 Mohamed Elminshawi , Wolfgang Mack , Emanuël A. P. Habets

This work introduces UDPNet, a novel architecture designed to accelerate the reverse diffusion process in speech synthesis. Unlike traditional diffusion models that rely on timestep embeddings and shared network parameters, UDPNet unrolls…

Sound · Computer Science 2025-06-12 Peter Ochieng