English
Related papers

Related papers: Time-Frequency Trade-offs for Audio Source Separat…

200 papers

Frame-online speech enhancement systems in the short-time Fourier transform (STFT) domain usually have an algorithmic latency equal to the window size due to the use of overlap-add in the inverse STFT (iSTFT). This algorithmic latency…

Sound · Computer Science 2022-07-13 Zhong-Qiu Wang , Shinji Watanabe

Score-based generative models (SGMs) have recently shown impressive results for difficult generative tasks such as the unconditional and conditional generation of natural images and audio signals. In this work, we extend these models to the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-08 Simon Welker , Julius Richter , Timo Gerkmann

Two-stage pipeline is popular in speech enhancement tasks due to its superiority over traditional single-stage methods. The current two-stage approaches usually enhance the magnitude spectrum in the first stage, and further modify the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-22 Yuewei Zhang , Huanbin Zou , Jie Zhu

Given a time series vector, how can we efficiently compute a specified part of Fourier coefficients? Fast Fourier transform (FFT) is a widely used algorithm that computes the discrete Fourier transform in many machine learning applications.…

Machine Learning · Computer Science 2020-08-31 Yong-chan Park , Jun-Gi Jang , U Kang

Following the successful application of vision transformers in multiple computer vision tasks, these models have drawn the attention of the signal processing community. This is because signals are often represented as spectrograms (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Nicolae-Catalin Ristea , Radu Tudor Ionescu , Fahad Shahbaz Khan

The finite STFT Synchrosqueezing transform is a time-frequency analysis method that can decompose finite complex signals into time-varying oscillatory components. This representation is sparse and invertible, allowing recovery of the…

Numerical Analysis · Mathematics 2017-09-26 Mozhgan Mohammadpour , Bastiaan Kleijn , Rajab Ali Kamyabi Gol

This paper addresses the problems of blind channel identification and multichannel equalization for speech dereverberation and noise reduction. The time-domain cross-relation method is not suitable for blind room impulse response…

Sound · Computer Science 2018-10-15 Xiaofei Li , Radu Horaud , Sharon Gannot

In this work, we address the problem of binaural target-speaker extraction in the presence of multiple simultane-ous talkers. We propose a novel approach that leverages the individual listener's Head-Related Transfer Function (HRTF) to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-25 Yoav Ellinson , Sharon Gannot

We propose an audio-to-audio neural network model that learns to denoise old music recordings. Our model internally converts its input into a time-frequency representation by means of a short-time Fourier transform (STFT), and processes the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Yunpeng Li , Beat Gfeller , Marco Tagliasacchi , Dominik Roblek

Phase retrieval from phaseless short-time Fourier transform (STFT) measurements is known to be inherently unstable when measurements are taken with respect to a single window. While an explicit inversion formula exists, it is useless in…

Functional Analysis · Mathematics 2025-06-19 Rima Alaifari , Yunan Yang

We propose harmonic-aligned frame mask for speech signals using non-stationary Gabor transform (NSGT). A frame mask operates on the transfer coefficients of a signal and consequently converts the signal into a counterpart signal. It depicts…

Sound · Computer Science 2019-04-24 Feng Huang , Peter Balazs

Convolutive Non-Negative Matrix Factorization model factorizes a given audio spectrogram using frequency templates with a temporal dimension. In this paper, we present a convolutional auto-encoder model that acts as a neural network…

Sound · Computer Science 2017-09-26 Shrikant Venkataramani , Y. Cem Subakan , Paris Smaragdis

Resonance frequencies can provide useful information on the deformation occurring during fracturing experiments or $CO_2$ management, complementary to the microseismic event distribution. An accurate time-frequency representation is of…

Geophysics · Physics 2013-01-08 Roberto H. Herrera , Jean-Baptiste Tary , Mirko van der Baan

An auditory neuron can preserve the temporal fine structure of a low-frequency tone by phase-locking its response to the stimulus. Apart from sound localization, however, little is known about the role of this temporal information for…

Neurons and Cognition · Quantitative Biology 2012-09-21 Tobias Reichenbach , A. J. Hudspeth

Speech separation is an important problem in speech processing, which targets to separate and generate clean speech from a mixed audio containing speech from different speakers. Empowered by the deep learning technologies over…

Sound · Computer Science 2021-02-22 Zining Zhang , Bingsheng He , Zhenjie Zhang

Magnetoencephalography (MEG) has a high temporal resolution well-suited for studying perceptual learning. However, to identify where learning happens in the brain, one needs to ap- ply source localization techniques to project MEG sensor…

Applications · Statistics 2015-12-04 Ying Yang , Michael J. Tarr , Robert E. Kass

Considering a mixed signal composed of various audio sources and recorded with a single microphone, we consider on this paper the blind audio source separation problem which consists in isolating and extracting each of the sources. To…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Valentin Leplat , Nicolas Gillis , Man Shun Ang

Audio compression has become one of the basic multimedia technologies. Choosing an efficient compression scheme that is capable of preserving the signal quality while providing a high compression ratio is desirable in the different…

Information Theory · Computer Science 2014-03-13 Hossam M. Kasem , Maha El-Sabrouty

Human-imitated speech poses a greater challenge than AI-generated speech for both human listeners and automatic detection systems. Unlike AI-generated speech, which often contains artifacts, over-smoothed spectra, or robotic cues, imitated…

Sound · Computer Science 2026-04-28 Khalid Zaman , Masashi Unoki

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

Machine Learning · Computer Science 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai