English
Related papers

Related papers: Adaptive Multimodal Protein Plug-and-Play with Dif…

200 papers

Diffusion probabilistic models (DPMs) have been shown to generate high-quality images without the need for delicate adversarial training. However, the current sampling process in DPMs is prone to violent shaking. In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiyu Wang , Anh-Dung Dinh , Daochang Liu , Chang Xu

Employing a forward diffusion chain to gradually map the data to a noise distribution, diffusion-based generative models learn how to generate the data by inferring a reverse diffusion chain. However, this approach is slow and costly…

Machine Learning · Statistics 2023-09-08 Huangjie Zheng , Pengcheng He , Weizhu Chen , Mingyuan Zhou

The recently proposed plug-and-play (PnP) framework allows leveraging recent developments in image denoising to tackle other, more involved, imaging inverse problems. In a PnP method, a black-box denoiser is plugged into an iterative…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Afonso M. Teodoro , José M. Bioucas-Dias , Mário A. T. Figueiredo

Plug-and-play (PnP) is a non-convex framework that integrates modern denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal algorithms. An advantage of PnP is that one can use pre-trained denoisers when…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ernest K. Ryu , Jialin Liu , Sicheng Wang , Xiaohan Chen , Zhangyang Wang , Wotao Yin

Over the past decade, Plug-and-Play (PnP) has become a popular method for reconstructing images using a modular framework consisting of a forward and prior model. The great strength of PnP is that an image denoiser can be used as a prior…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Charles A. Bouman , Gregery T. Buzzard

Accurate protein function prediction requires integrating heterogeneous intrinsic signals (e.g., sequence and structure) with noisy extrinsic contexts (e.g., protein-protein interactions and GO term annotations). However, two key challenges…

Machine Learning · Computer Science 2025-10-28 Runjie Zheng , Zhen Wang , Anjie Qiao , Jiancong Xie , Jiahua Rao , Yuedong Yang

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems governed by partial differential equations (PDEs), but standard PINN training typically relies on soft penalty formulations that…

Machine Learning · Computer Science 2026-05-12 Binghang Lu , Runyu Zhang , Changhong Mou , Na Li , Guang Lin

The interaction of a protein with its environment can be understood and controlled via its 3D structure. Experimental methods for protein structure determination, such as X-ray crystallography or cryogenic electron microscopy, shed light on…

Machine Learning · Computer Science 2025-04-24 Axel Levy , Eric R. Chan , Sara Fridovich-Keil , Frédéric Poitevin , Ellen D. Zhong , Gordon Wetzstein

Near-field radar imaging systems are used in a wide range of applications such as concealed weapon detection and medical diagnosis. In this paper, we consider the problem of reconstructing the three-dimensional (3D) complex-valued…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Okyanus Oral , Figen S. Oktem

Achieving high-quality Magnetic Resonance Imaging (MRI) reconstruction at accelerated acquisition rates remains challenging due to the inherent ill-posed nature of the inverse problem. Traditional Compressed Sensing (CS) methods, while…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Pierre-Antoine Comby , Benjamin Lapostolle , Matthieu Terris , Philippe Ciuciu

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems. The PnP stochastic gradient descent methods have been recently proposed and shown improved performance in some imaging applications…

Optimization and Control · Mathematics 2020-06-24 Junqi Tang , Mike Davies

Earth system modeling presents a fundamental challenge in scientific computing: capturing complex, multiscale nonlinear dynamics in computationally efficient models while minimizing forecast errors caused by necessary simplifications. Even…

Machine Learning · Computer Science 2025-08-04 Yongquan Qu , Matthieu Blanke , Sara Shamekh , Pierre Gentine

Spectral unmixing is a widely used technique in hyperspectral image processing and analysis. It aims to separate mixed pixels into the component materials and their corresponding abundances. Early solutions to spectral unmixing are…

Signal Processing · Electrical Eng. & Systems 2021-04-27 Min zhao , Xiuheng Wang , Jie Chen , Wei Chen

For magnetic resonance imaging (MRI), recently proposed "plug-and-play" (PnP) image recovery algorithms have shown remarkable performance. These PnP algorithms are similar to traditional iterative algorithms like FISTA, ADMM, or primal-dual…

Information Theory · Computer Science 2020-12-03 Saurav K. Shastri , Rizwan Ahmad , Philip Schniter

Diffusion Probabilistic Models (DPMs) are powerful generative models that have achieved unparalleled success in a number of generative tasks. In this work, we aim to build inductive biases into the training and sampling of diffusion models…

Machine Learning · Computer Science 2025-03-14 Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio , Luca Scimeca

This article makes discrete masked models for the generative modeling of discrete data controllable. The goal is to generate samples of a discrete random variable that adheres to a posterior distribution, satisfies specific constraints, or…

Machine Learning · Computer Science 2024-10-04 Wei Guo , Yuchen Zhu , Molei Tao , Yongxin Chen

Plug-and-play priors (PnP) is a popular framework for regularized signal reconstruction by using advanced denoisers within an iterative algorithm. In this paper, we discuss our recent online variant of PnP that uses only a subset of…

Signal Processing · Electrical Eng. & Systems 2018-11-12 Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

Pretrained diffusion models (DMs) have recently been popularly used in solving inverse problems (IPs). The existing methods mostly interleave iterative steps in the reverse diffusion process and iterative steps to bring the iterates closer…

Machine Learning · Computer Science 2024-11-07 Hengkang Wang , Xu Zhang , Taihui Li , Yuxiang Wan , Tiancong Chen , Ju Sun

The rapid progress of large multimodal models has inspired efforts toward unified frameworks that couple understanding and generation. While such paradigms have shown remarkable success in 2D, extending them to 3D remains largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yongwei Chen , Tianyi Wei , Yushi Lan , Zhaoyang Lyu , Shangchen Zhou , Xudong Xu , Xingang Pan