English
Related papers

Related papers: Integrating Plug-and-Play Data Priors with Weighte…

200 papers

Plug-and-play (PnP) is a non-convex framework that integrates modern denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal algorithms. An advantage of PnP is that one can use pre-trained denoisers when…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ernest K. Ryu , Jialin Liu , Sicheng Wang , Xiaohan Chen , Zhangyang Wang , Wotao Yin

This paper describes speech enhancement for realtime automatic speech recognition (ASR) in real environments. A standard approach to this task is to use neural beamforming that can work efficiently in an online manner. It estimates the…

Plug-and-Play Priors (PnP) is one of the most widely-used frameworks for solving computational imaging problems through the integration of physical models and learned models. PnP leverages high-fidelity physical sensor models and powerful…

Image and Video Processing · Electrical Eng. & Systems 2023-01-18 Ulugbek S. Kamilov , Charles A. Bouman , Gregery T. Buzzard , Brendt Wohlberg

Plug-and-play priors (PnP) is an image reconstruction framework that uses an image denoiser as an imaging prior. Unlike traditional regularized inversion, PnP does not require the prior to be expressible in the form of a regularization…

Image and Video Processing · Electrical Eng. & Systems 2020-02-27 Xiaojian Xu , Jiaming Liu , Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

Plug-and-play priors (PnP) is a popular framework for regularized signal reconstruction by using advanced denoisers within an iterative algorithm. In this paper, we discuss our recent online variant of PnP that uses only a subset of…

Signal Processing · Electrical Eng. & Systems 2018-11-12 Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

End-to-End Neural Diarization (EEND) systems produce frame-level probabilistic speaker activity estimates, yet since evaluation focuses primarily on Diarization Error Rate (DER), the reliability and calibration of these confidence scores…

This paper aims at eliminating the interfering speakers' speech, additive noise, and reverberation from the noisy multi-talker speech mixture that benefits automatic speech recognition (ASR) backend. While the recently proposed Weighted…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-19 Zhaoheng Ni , Yong Xu , Meng Yu , Bo Wu , Shixiong Zhang , Dong Yu , Michael I Mandel

In this paper, we introduce Plug-and-Play (PnP) Flow Matching, an algorithm for solving imaging inverse problems. PnP methods leverage the strength of pre-trained denoisers, often deep neural networks, by integrating them in optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Ségolène Martin , Anne Gagneux , Paul Hagemann , Gabriele Steidl

In this paper, we present an analysis of a DNN-based autoencoder for speech enhancement, dereverberation and denoising. The target application is a robust speaker recognition system. We started with augmenting the Fisher database with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Ondrej Novotny , Oldrich Plchot , Pavel Matejka , Ondrej Glembek

Inverse problems lie at the heart of modern imaging science, with broad applications in areas such as medical imaging, remote sensing, and microscopy. Recent years have witnessed a paradigm shift in solving imaging inverse problems, where…

Optimization and Control · Mathematics 2025-11-20 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang

Detecting pre-training data in Large Language Models (LLMs) is crucial for auditing data privacy and copyright compliance, yet it remains challenging in black-box, zero-shot settings where computational resources and training data are…

Computation and Language · Computer Science 2026-01-13 Jinhan Liu , Yibo Yang , Ruiying Lu , Piotr Piekos , Yimeng Chen , Peng Wang , Dandan Guo

Plug-and-Play (PnP) algorithms are a class of iterative algorithms that address image inverse problems by combining a physical model and a deep neural network for regularization. Even if they produce impressive image restoration results,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Marien Renaud , Jean Prost , Arthur Leclaire , Nicolas Papadakis

Earth system modeling presents a fundamental challenge in scientific computing: capturing complex, multiscale nonlinear dynamics in computationally efficient models while minimizing forecast errors caused by necessary simplifications. Even…

Machine Learning · Computer Science 2025-08-04 Yongquan Qu , Matthieu Blanke , Sara Shamekh , Pierre Gentine

In order to improve the quality of synthesized videos, currently, one predominant method involves retraining an expert diffusion model and then implementing a noising-denoising process for refinement. Despite the significant training costs,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Qinyu Yang , Haoxin Chen , Yong Zhang , Menghan Xia , Xiaodong Cun , Zhixun Su , Ying Shan

The recently proposed plug-and-play (PnP) framework allows leveraging recent developments in image denoising to tackle other, more involved, imaging inverse problems. In a PnP method, a black-box denoiser is plugged into an iterative…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Afonso M. Teodoro , José M. Bioucas-Dias , Mário A. T. Figueiredo

Reverberation and additive noise have detrimental effects on the performance of automatic speech recognition systems. In this paper we explore the ability of a DNN-based spectral feature mapping to remove the effects of reverberation and…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-05 Juan Pablo Escudero , José Novoa , Rodrigo Mahu , Jorge Wuth , Fernando Huenupán , Richard Stern , Néstor Becerra Yoma

Existing physical model-based imaging methods for ultrasound elasticity reconstruction utilize fixed variational regularizers that may not be appropriate for the application of interest or may not capture complex spatial prior information…

Image and Video Processing · Electrical Eng. & Systems 2021-03-29 Narges Mohammadi , Marvin M. Doyley , Mujdat Cetin

To solve inverse problems, plug-and-play (PnP) methods replace the proximal step in a convex optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network (DNN). Although such methods…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Saurav K. Shastri , Rizwan Ahmad , Christopher A. Metzler , Philip Schniter

Reverberation may severely degrade the quality of speech signals recorded using microphones in a room. For compact microphone arrays, the choice of the reference microphone for multi-microphone dereverberation typically does not have a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-04 Anselm Lohmann , Toon van Waterschoot , Joerg Bitzer , Simon Doclo

Over the recent years, various deep learning-based methods were proposed for extracting a fixed-dimensional embedding vector from speech signals. Although the deep learning-based embedding extraction methods have shown good performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-08 Woo Hyun Kang , Jahangir Alam , Abderrahim Fathan