English
Related papers

Related papers: Neural Speech Phase Prediction based on Parallel E…

200 papers

To investigate how speech is processed in the brain, we can model the relation between features of a natural speech signal and the corresponding recorded electroencephalogram (EEG). Usually, linear models are used in regression tasks.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-25 Corentin Puffay , Jana Van Canneyt , Jonas Vanthornhout , Hugo Van Hamme , Tom Francart

Given a speaker's speech, it is interesting to see if it is possible to generate this speaker's face. One main challenge in this task is to alleviate the natural mismatch between face and speech. To this end, in this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Jianrong Wang , Xiaosheng Hu , Li Liu , Wei Liu , Mei Yu , Tianyi Xu

We present a neural network for rendering binaural speech from given monaural audio, position, and orientation of the source. Most of the previous works have focused on synthesizing binaural speeches by conditioning the positions and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-02 Jin Woo Lee , Kyogu Lee

We propose a flexible convex relaxation for the phase retrieval problem that operates in the natural domain of the signal. Therefore, we avoid the prohibitive computational cost associated with "lifting" and semidefinite programming (SDP)…

Information Theory · Computer Science 2017-03-17 Sohail Bahmani , Justin Romberg

This paper is focused on nonlinear prediction coding, which consists on the prediction of a speech sample based on a nonlinear combination of previous samples. It is known that in the generation of the glottal pulse, the wave equation does…

Sound · Computer Science 2022-04-01 Marcos Faundez-Zanuy , Enric Monte , Francesc Vallverdú

Accurate prediction of fading channel in the upcoming transmission frame is essential to realize adaptive transmission for transmitters, and receivers with the ability of channel prediction can also save some computations of channel…

Signal Processing · Electrical Eng. & Systems 2019-04-19 Yourui Huangfu , Jian Wang , Rong Li , Chen Xu , Xianbin Wang , Huazi Zhang , Jun Wang

Neural networks are among the most powerful nonlinear models used to address supervised learning problems. Similar to most machine learning algorithms, neural networks produce point predictions and do not provide any prediction interval…

Machine Learning · Statistics 2020-07-01 Saeed Khaki , Dan Nettleton

We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge. The system integrates a generative branch, which performs full-stack speech restoration in a self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-03 Xiaobin Rong , Yushi Wang , Zheng Wang , Jing Lu

The goal of this paper is to develop state-of-the-art models for lip reading -- visual speech recognition. We develop three architectures and compare their accuracy and training times: (i) a recurrent model using LSTMs; (ii) a fully…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Triantafyllos Afouras , Joon Son Chung , Andrew Zisserman

This paper proposes a multi-step probabilistic forecasting framework using a single neural-network based model to generate simultaneous point and interval forecasts. Our approach ensures non-crossing prediction intervals (PIs) through a…

Machine Learning · Computer Science 2026-04-21 Worachit Amnuaypongsa , Yotsapat Suparanonrat , Pana Wanitchollakit , Jitkomut Songsiri

Exploring the idea of phase retrieval has been intriguing researchers for decades, due to its appearance in a wide range of applications. The task of a phase retrieval algorithm is typically to recover a signal from linear phaseless…

Machine Learning · Statistics 2020-12-22 Naveed Naimipour , Shahin Khobahi , Mojtaba Soltanalian

In this paper, we propose a phase shift deep neural network (PhaseDNN) which provides a wideband convergence in approximating a high dimensional function during its training of the network. The PhaseDNN utilizes the fact that many DNN…

Signal Processing · Electrical Eng. & Systems 2019-05-14 Wei Cai , Xiaoguang Li , Lizuo Liu

Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scale unlabeled data, and their applications to a wide range of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Yu-An Chung , Yonatan Belinkov , James Glass

Deep neural networks have emerged as effective tools for computational imaging including quantitative phase microscopy of transparent samples. To reconstruct phase from intensity, current approaches rely on supervised learning with training…

Image and Video Processing · Electrical Eng. & Systems 2020-01-28 Emrah Bostan , Reinhard Heckel , Michael Chen , Michael Kellman , Laura Waller

To date, mainstream target speech separation (TSS) approaches are formulated to estimate the complex ratio mask (cRM) of the target speech in time-frequency domain under supervised deep learning framework. However, the existing deep models…

Sound · Computer Science 2021-09-08 Rongzhi Gu , Shi-Xiong Zhang , Yuexian Zou , Dong Yu

Phase segregation, the process by which the components of a binary mixture spontaneously separate, is a key process in the evolution and design of many chemical, mechanical, and biological systems. In this work, we present a data-driven…

Machine Learning · Computer Science 2018-03-28 Amir Barati Farimani , Joseph Gomes , Rishi Sharma , Franklin L. Lee , Vijay S. Pande

Deep neural network (DNN) based speech enhancement models have attracted extensive attention due to their promising performance. However, it is difficult to deploy a powerful DNN in real-time applications because of its high computational…

Sound · Computer Science 2022-07-25 Xiaohuai Le , Tong Lei , Kai Chen , Jing Lu

Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in humans' neural encoding of speech that may facilitate this…

Computation and Language · Computer Science 2024-05-15 Oli Danyi Liu , Hao Tang , Naomi Feldman , Sharon Goldwater

Neural collapse is a highly symmetric geometric pattern of neural networks that emerges during the terminal phase of training, with profound implications on the generalization performance and robustness of the trained networks. To…

Machine Learning · Computer Science 2022-04-26 Wenlong Ji , Yiping Lu , Yiliang Zhang , Zhun Deng , Weijie J. Su

Phase processing has been replaced by group delay processing for the extraction of source and system parameters from speech. Group delay functions are ill-behaved when the transfer function has zeros that are close to unit circle in the…

Sound · Computer Science 2016-03-18 Rajeev Rajan , Hema A. Murthy