English
Related papers

Related papers: Learning to Solve Inverse Problems for Perceptual …

200 papers

The task of learning a diffusion-based neural sampler for drawing samples from an unnormalized target distribution can be viewed as a stochastic optimal control problem on path measures. However, the training of neural samplers can be…

Machine Learning · Computer Science 2026-05-20 Wei Guo , Jaemoo Choi , Yuchen Zhu , Molei Tao , Yongxin Chen

Energy-Based Models (EBMs) assign unnormalized log-probability to data samples. This functionality has a variety of applications, such as sample synthesis, data denoising, sample restoration, outlier detection, Bayesian reasoning, and many…

Machine Learning · Statistics 2019-12-23 Zengyi Li , Yubei Chen , Friedrich T. Sommer

Most deep noise suppression (DNS) models are trained with reference-based losses requiring access to clean speech. However, sometimes an additive microphone model is insufficient for real-world applications. Accordingly, ways to use real…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Ziyi Xu , Marvin Sach , Jan Pirklbauer , Tim Fingscheidt

In recent years, deep learning based source separation has achieved impressive results. Most studies, however, still evaluate separation models on synthetic datasets, while the performance of state-of-the-art techniques on in-the-wild…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-22 Cem Subakan , Mirco Ravanelli , Samuele Cornell , François Grondin

Plug-and-play priors (PnP) is a methodology for regularized image reconstruction that specifies the prior through an image denoiser. While PnP algorithms are well understood for denoisers performing maximum a posteriori probability (MAP)…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Xiaojian Xu , Yu Sun , Jiaming Liu , Brendt Wohlberg , Ulugbek S. Kamilov

Stereo vision generally involves the computation of pixel correspondences and estimation of disparities between rectified image pairs. In many applications, including simultaneous localization and mapping (SLAM) and 3D object detection, the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 WeiQin Chuah , Ruwan Tennakoon , Reza Hoseinnezhad , Alireza Bab-Hadiashar , David Suter

Speech pre-processing techniques such as denoising, de-reverberation, and separation, are commonly employed as front-ends for various downstream speech processing tasks. However, these methods can sometimes be inadequate, resulting in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-17 Sirui Li , Shuai Wang , Zhijun Liu , Zhongjie Jiang , Yannan Wang , Haizhou Li

To fully uncover the great potential of deep neural networks (DNNs), various learning algorithms have been developed to improve the model's generalization ability. Recently, sharpness-aware minimization (SAM) establishes a generic scheme…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Tao Li , Weihao Yan , Zehao Lei , Yingwen Wu , Kun Fang , Ming Yang , Xiaolin Huang

The INTERSPEECH 2020 Deep Noise Suppression (DNS) Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. A typical…

State-of-the-art language models (LMs) represented by long-short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming increasingly complex and expensive for practical applications. Low-bit neural network…

Computation and Language · Computer Science 2021-12-22 Junhao Xu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

Contrastive learning has been demonstrated to be effective in enhancing pre-trained language models (PLMs) to derive superior universal sentence embeddings. However, existing contrastive methods still have two limitations. Firstly, previous…

Computation and Language · Computer Science 2022-10-11 Yuxin Jiang , Linhan Zhang , Wei Wang

Self-supervised speech representation learning has recently been a prosperous research topic. Many algorithms have been proposed for learning useful representations from large-scale unlabeled data, and their applications to a wide range of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-03 Yu-An Chung , Yonatan Belinkov , James Glass

Parameter estimation remains a challenging task across many areas of engineering. Because data acquisition can often be costly, limited, or prone to inaccuracies (noise, uncertainty) it is crucial to identify sensor configurations that…

Machine Learning · Statistics 2025-11-20 Georgios Venianakis , Constantinos Theodoropoulos , Michail Kavousanakis

Perceptual similarity scores that align with human vision are critical for both training and evaluating computer vision models. Deep perceptual losses, such as LPIPS, achieve good alignment but rely on complex, highly non-linear…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Paula Seidler , Neill D. F. Campbell , Ivor J A Simpson

Compressive sensing is a method to recover the original image from undersampled measurements. In order to overcome the ill-posedness of this inverse problem, image priors are used such as sparsity in the wavelet domain, minimum…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Magauiya Zhussip , Shakarim Soltanayev , Se Young Chun

Localizing more sources than sensors with a sparse linear array (SLA) has long relied on minimizing a distance between two covariance matrices and recent algorithms often utilize semidefinite programming (SDP). Although deep neural network…

Signal Processing · Electrical Eng. & Systems 2025-03-11 Kuan-Lin Chen , Bhaskar D. Rao

An important problem encountered by both natural and engineered signal processing systems is blind source separation. In many instances of the problem, the sources are bounded by their nature and known to be so, even though the particular…

Signal Processing · Electrical Eng. & Systems 2020-04-14 Alper T. Erdogan , Cengiz Pehlevan

Deep Neural Network--Hidden Markov Model (DNN-HMM) based methods have been successfully used for many always-on keyword spotting algorithms that detect a wake word to trigger a device. The DNN predicts the state probabilities of a given…

Sound · Computer Science 2021-03-01 Ashish Shrivastava , Arnav Kundu , Chandra Dhir , Devang Naik , Oncel Tuzel

Text-independent speaker verification is an important artificial intelligence problem that has a wide spectrum of applications, such as criminal investigation, payment certification, and interest-based customer services. The purpose of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-22 Jiwei Xu , Xinggang Wang , Bin Feng , Wenyu Liu

Accurately estimating and simulating the physical properties of objects from real-world sound recordings is of great practical importance in the fields of vision, graphics, and robotics. However, the progress in these directions has been…

Sound · Computer Science 2024-09-23 Xutong Jin , Chenxi Xu , Ruohan Gao , Jiajun Wu , Guoping Wang , Sheng Li