English
Related papers

Related papers: Plug-In Stochastic Gradient Method

200 papers

We propose a new plug-and-play priors (PnP) based MR image reconstruction method that systematically enforces data consistency while also exploiting deep-learning priors. Our prior is specified through a convolutional neural network (CNN)…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Weijie Gan , Cihat Eldeniz , Jiaming Liu , Sihao Chen , Hongyu An , Ulugbek S. Kamilov

Aiming at high-dimensional (HD) data acquisition and analysis, snapshot compressive imaging (SCI) obtains the 2D compressed measurement of HD data with optical imaging systems and reconstructs HD data using compressive sensing algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Qing Yang , Yaping Zhao

We propose SING (StabIlized and Normalized Gradient), a plug-and-play technique that improves the stability and generalization of the Adam(W) optimizer. SING is straightforward to implement and has minimal computational overhead, requiring…

Machine Learning · Computer Science 2023-05-26 Adrien Courtois , Damien Scieur , Jean-Michel Morel , Pablo Arias , Thomas Eboli

We consider the reconstruction problem of video snapshot compressive imaging (SCI), which captures high-speed videos using a low-speed 2D sensor (detector). The underlying principle of SCI is to modulate sequential high-speed frames with…

Image and Video Processing · Electrical Eng. & Systems 2021-01-14 Xin Yuan , Yang Liu , Jinli Suo , Frédo Durand , Qionghai Dai

We propose a novel multi-layer neural network architecture that gives a promising neural network empowered optimization approach to the image restoration problem. The proposed architecture is motivated by the recent study of monotone…

Optimization and Control · Mathematics 2025-10-27 Haruya Shimizu , Masahiro Yukawa

Posterior sampling has been shown to be a powerful Bayesian approach for solving imaging inverse problems. The recent plug-and-play unadjusted Langevin algorithm (PnP-ULA) has emerged as a promising method for Monte Carlo sampling and…

Machine Learning · Statistics 2025-08-13 Marien Renaud , Jiaming Liu , Valentin de Bortoli , Andrés Almansa , Ulugbek S. Kamilov

Recently, the degenerate preconditioned proximal point (PPP) method provides a unified and flexible framework for designing and analyzing operator-splitting algorithms such as Douglas-Rachford (DR). However, the degenerate PPP method…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Shuchang Zhang , Hui Zhang , Hongxia Wang

Regularized inversion methods for image reconstruction are used widely due to their tractability and ability to combine complex physical sensor models with useful regularity criteria. Such methods motivated the recently developed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Gregery T. Buzzard , Stanley H. Chan , Suhas Sreehari , Charles A. Bouman

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

Although deep neural networks (NNs) have achievedstate-of-the-art accuracy in many visual recognition tasks,the growing computational complexity and energy con-sumption of networks remains an issue, especially for ap-plications on platforms…

Machine Learning · Computer Science 2020-02-26 Le Thanh Nguyen-Meidine , Eric Granger , Madhu Kiran , Louis-Antoine Blais-Morin , Marco Pedersoli

Magnetic resonance imaging (MRI) plays an important role in modern medical diagnostic but suffers from prolonged scan time. Current deep learning methods for undersampled MRI reconstruction exhibit good performance in image de-aliasing…

Image and Video Processing · Electrical Eng. & Systems 2023-10-10 Min Xiao , Zi Wang , Jiefeng Guo , Xiaobo Qu

Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented…

Image and Video Processing · Electrical Eng. & Systems 2021-08-30 Selin Aslan , Zhengchun Liu , Viktor Nikitin , Tekin Bicer , Sven Leyffer , Doga Gursoy

Hyperspectral images are typically composed of hundreds of narrow and contiguous spectral bands, each containing information regarding the material composition of the imaged scene. However, these images can be affected by various sources of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Shuo Li , Mehrdad Yaghoobi

The ability to predict trajectories of surrounding agents and obstacles is a crucial component in many robotic applications. Data-driven approaches are commonly adopted for state prediction in scenarios where the underlying dynamics are…

Robotics · Computer Science 2025-04-28 Kaiyuan Tan , Peilun Li , Jun Wang , Thomas Beckers

To enable DNNs on edge devices like mobile phones, low-rank approximation has been widely adopted because of its solid theoretical rationale and efficient implementations. Several previous works attempted to directly approximate a…

Machine Learning · Computer Science 2020-05-01 Yuhui Xu , Yuxi Li , Shuai Zhang , Wei Wen , Botao Wang , Yingyong Qi , Yiran Chen , Weiyao Lin , Hongkai Xiong

Integrated photonic neural networks (PNNs) have demonstrated significant potential to complement the digital electronic counterparts [1-3]. Nevertheless, robust and repeatable performance of scalable integrated PNNs is directly tied to the…

Optics · Physics 2025-06-18 Farshid Ashtiani , Mohamad Hossein Idjadi , Kwangwoong Kim

Estimating a vector $\mathbf{x}$ from noisy linear measurements $\mathbf{Ax}+\mathbf{w}$ often requires use of prior knowledge or structural constraints on $\mathbf{x}$ for accurate reconstruction. Several recent works have considered…

Information Theory · Computer Science 2020-01-29 Alyson K. Fletcher , Sundeep Rangan , Subrata Sarkar , Philip Schniter

Physics informed neural networks (PINNs) represent a very popular class of neural solvers for partial differential equations. In practice, one often employs stochastic gradient descent type algorithms to train the neural network. Therefore,…

Machine Learning · Computer Science 2025-09-01 Bangti Jin , Longjun Wu

Advancements in parallel processing have lead to a surge in multilayer perceptrons' (MLP) applications and deep learning in the past decades. Recurrent Neural Networks (RNNs) give additional representational power to feedforward MLPs by…

Machine Learning · Statistics 2014-10-22 Saahil Ognawala , Justin Bayer

Plug-and-play (PnP) methods offer an iterative strategy for solving image restoration (IR) problems in a zero-shot manner, using a learned \textit{discriminative denoiser} as the implicit prior. More recently, a sampling-based variant of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Chong Wang , Lanqing Guo , Zixuan Fu , Siyuan Yang , Hao Cheng , Alex C. Kot , Bihan Wen