English
Related papers

Related papers: Beyond Griffin-Lim: Improved Iterative Phase Retri…

200 papers

This paper presents a novel speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra by neural networks. The proposed model is a cascade of a residual convolutional network and a parallel estimation…

Sound · Computer Science 2023-02-17 Yang Ai , Zhen-Hua Ling

We propose a new algorithm to learn a dictionary for reconstructing and sparsely encoding signals from measurements without phase. Specifically, we consider the task of estimating a two-dimensional image from squared-magnitude measurements…

Optimization and Control · Mathematics 2016-11-23 Andreas M. Tillmann , Yonina C. Eldar , Julien Mairal

Diffusion models are receiving a growing interest for a variety of signal generation tasks such as speech or music synthesis. WaveGrad, for example, is a successful diffusion model that conditionally uses the mel spectrogram to guide a…

Sound · Computer Science 2024-02-27 Haocheng Liu , Teysir Baoueb , Mathieu Fontaine , Jonathan Le Roux , Gael Richard

Phase retrieval (PR) aims to recover a signal from the magnitudes of a set of inner products. This problem arises in many audio signal processing applications which operate on a short-time Fourier transform magnitude or power spectrogram,…

Sound · Computer Science 2021-02-24 Pierre-Hugo Vial , Paul Magron , Thomas Oberlin , Cédric Févotte

In phase retrieval, the goal is to recover a complex signal from the magnitude of its linear measurements. While many well-known algorithms guarantee deterministic recovery of the unknown signal using i.i.d. random measurement matrices,…

Information Theory · Computer Science 2017-03-24 Boshra Rajaei , Sylvain Gigan , Florent Krzakala , Laurent Daudet

Enabling bi-directional retrieval of images and texts is important for understanding the correspondence between vision and language. Existing methods leverage the attention mechanism to explore such correspondence in a fine-grained manner.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Hui Chen , Guiguang Ding , Xudong Liu , Zijia Lin , Ji Liu , Jungong Han

In many signal processing problems arising in practical applications, we wish to reconstruct an unknown signal from its phaseless measurements with respect to a frame. This inverse problem is known as the phase retrieval problem. For each…

Information Theory · Computer Science 2023-07-04 Palina Salanevich

In recent years generative adversarial network (GAN) based models have been successfully applied for unsupervised speech-to-speech conversion.The rich compact harmonic view of the magnitude spectrogram is considered a suitable choice for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-20 Mohammad Asif Khan , Fabien Cardinaux , Stefan Uhlich , Marc Ferras , Asja Fischer

High-throughput computational imaging requires efficient processing algorithms to retrieve multi-dimensional and multi-scale information. In computational phase imaging, phase retrieval (PR) is required to reconstruct both amplitude and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Xuyang Chang , Liheng Bian , Jun Zhang

The performance of text-to-speech (TTS) systems heavily depends on spectrogram to waveform generation, also known as the speech reconstruction phase. The time required for the same is known as synthesis delay. In this paper, an approach to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-14 Ankit Sharma , Puneet Kumar , Vikas Maddukuri , Nagasai Madamshettib , Kishore KG , Sahit Sai Sriram Kavurub , Balasubramanian Raman , Partha Pratim Roy

In diffraction imaging, one is tasked with reconstructing a signal from its power spectrum. To resolve the ambiguity in this inverse problem, one might invoke prior knowledge about the signal, but phase retrieval algorithms in this vein…

Functional Analysis · Mathematics 2013-06-26 Afonso S. Bandeira , Yutong Chen , Dustin G. Mixon

Generating consecutive images of lip movements that align with a given speech in audio-driven lip synthesis is a challenging task. While previous studies have made strides in synchronization and visual quality, lip intelligibility and video…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shiyan Liu , Rui Qu , Yan Jin

Recovering a signal from its Fourier intensity underlies many important applications, including lensless imaging and imaging through scattering media. Conventional algorithms for retrieving the phase suffer when noise is present but display…

Image and Video Processing · Electrical Eng. & Systems 2020-03-05 Yaotian Wang , Xiaohang Sun , Jason W. Fleischer

We propose a flexible convex relaxation for the phase retrieval problem that operates in the natural domain of the signal. Therefore, we avoid the prohibitive computational cost associated with "lifting" and semidefinite programming (SDP)…

Information Theory · Computer Science 2017-03-17 Sohail Bahmani , Justin Romberg

This paper introduces a novel technique for reconstructing the phase of modified spectrograms of audio signals. From the analysis of mixtures of sinusoids we obtain relationships between phases of successive time frames in the…

Sound · Computer Science 2016-05-25 Paul Magron , Roland Badeau , Bertrand David

Time-frequency audio source separation is usually achieved by estimating the short-time Fourier transform (STFT) magnitude of each source, and then applying a phase recovery algorithm to retrieve time-domain signals. In particular, the…

Sound · Computer Science 2021-02-10 Paul Magron , Pierre-Hugo Vial , Thomas Oberlin , Cédric Févotte

The classical problem of phase retrieval arises in various signal acquisition systems. Due to the ill-posed nature of the problem, the solution requires assumptions on the structure of the signal. In the last several years, sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Rakib Hyder , Viraj Shah , Chinmay Hegde , M. Salman Asif

We derive a set of ptychography phase-retrieval iterative engines based on proximal algorithms originally developed in convex optimization theory, and discuss their connections with existing ones. The use of proximal operator creates a…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Hanfei Yan

In this paper, we address the problem of reconstructing a time-domain signal (or a phase spectrogram) solely from a magnitude spectrogram. Since magnitude spectrograms do not contain phase information, we must restore or infer phase…

Signal Processing · Electrical Eng. & Systems 2018-04-09 Keisuke Oyamada , Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo , Hiroyasu Ando

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi