English
Related papers

Related papers: Onssen: an open-source speech separation and enhan…

200 papers

While there has been much recent progress using deep learning techniques to separate speech and music audio signals, these systems typically require large collections of isolated sources during the training process. When extending audio…

Sound · Computer Science 2020-09-01 Fatemeh Pishdadian , Gordon Wichern , Jonathan Le Roux

Audio is a rich sensing modality that is useful for a variety of human activity recognition tasks. However, the ubiquitous nature of smartphones and smart speakers with always-on microphones has led to numerous privacy concerns and a lack…

The INTERSPEECH 2020 Deep Noise Suppression Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. A typical…

Despite the overwhelming success of deep learning in various speech processing tasks, the problem of separating simultaneous speakers in a mixture remains challenging. Two major difficulties in such systems are the arbitrary source…

Sound · Computer Science 2017-11-30 Zhuo Chen , Yi Luo , Nima Mesgarani

In the field of audio signal processing research, source separation has been a popular research topic for a long time and the recent adoption of the deep neural networks have shown a significant improvement in performance. The improvement…

Sound · Computer Science 2021-02-23 Soochul Park , Ben Sangbae Chon

A large scale collection of both semantic and natural language resources is essential to leverage active Software Engineering research areas such as code reuse and code comprehensibility. Existing machine learning models ingest data from…

Source separation is a fundamental task in speech, music, and audio processing, and it also provides cleaner and larger data for training generative models. However, improving separation performance in practice often depends on increasingly…

Sound · Computer Science 2025-10-15 Yongsheng Feng , Yuetonghui Xu , Jiehui Luo , Hongjia Liu , Xiaobing Li , Feng Yu , Wei Li

Deep clustering is the first method to handle general audio separation scenarios with multiple sources of the same type and an arbitrary number of sources, performing impressively in speaker-independent speech separation tasks. However,…

Machine Learning · Statistics 2017-11-30 Yi Luo , Zhuo Chen , John R. Hershey , Jonathan Le Roux , Nima Mesgarani

Neural speech separation has made remarkable progress and its integration with automatic speech recognition (ASR) is an important direction towards realizing multi-speaker ASR. This work provides an insightful investigation of speech…

We propose an algorithm to denoise speakers from a single microphone in the presence of non-stationary and dynamic noise. Our approach is inspired by the recent success of neural network models separating speakers from other speakers and…

Sound · Computer Science 2018-05-01 Jeff Hetherly , Paul Gamble , Maria Barrios , Cory Stephenson , Karl Ni

Separating target speech from mixed signals containing flexible speaker quantities presents a challenging task. While existing methods demonstrate strong separation performance and noise robustness, they predominantly assume prior knowledge…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-18 Daning Zhang , Ying Wei

Sharing real-world speech utterances is key to the training and deployment of voice-based services. However, it also raises privacy risks as speech contains a wealth of personal data. Speaker anonymization aims to remove speaker information…

This work examines a semi-blind single-channel source separation problem. Our specific aim is to separate one source whose local structure is approximately known, from another a priori unspecified background source, given only a single…

Sound · Computer Science 2015-01-27 Sirisha Rambhatla , Jarvis D. Haupt

Cooper is an open-source package for solving constrained optimization problems involving deep learning models. Cooper implements several Lagrangian-based first-order update schemes, making it easy to combine constrained optimization…

Machine Learning · Computer Science 2025-04-03 Jose Gallego-Posada , Juan Ramirez , Meraj Hashemizadeh , Simon Lacoste-Julien

Continuous speech separation (CSS) is a recently proposed framework which aims at separating each speaker from an input mixture signal in a streaming fashion. Hereafter we perform an evaluation study on practical design considerations for a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-01 Giovanni Morrone , Samuele Cornell , Enrico Zovato , Alessio Brutti , Stefano Squartini

Automatic Speech Recognition and Text-to-Speech systems are primarily trained in a supervised fashion and require high-quality, accurately labeled speech datasets. In this work, we examine common problems with speech data and introduce a…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-10 Evelina Bakhturina , Vitaly Lavrukhin , Boris Ginsburg

Supervised speech separation uses supervised learning algorithms to learn a mapping from an input noisy signal to an output target. With the fast development of deep learning, supervised separation has become the most important direction in…

Sound · Computer Science 2017-09-05 Shasha Xia , Hao Li , Xueliang Zhang

Our goal is to isolate individual speakers from multi-talker simultaneous speech in videos. Existing works in this area have focussed on trying to separate utterances from known speakers in controlled environments. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Triantafyllos Afouras , Joon Son Chung , Andrew Zisserman

This paper addresses the problem of single-channel speech separation, where the number of speakers is unknown, and each speaker may speak multiple utterances. We propose a speech separation model that simultaneously performs separation,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Yuzhu Wang , Archontis Politis , Konstantinos Drossos , Tuomas Virtanen

Advances in deep learning have led to state-of-the-art performance across a multitude of speech recognition tasks. Nevertheless, the widespread deployment of deep neural networks for on-device speech recognition remains a challenge,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-14 Alexander Wong , Mahmoud Famouri , Maya Pavlova , Siddharth Surana