English
Related papers

Related papers: Learning Maximally Monotone Operators for Image Re…

200 papers

We present a method for supervised learning of sparsity-promoting regularizers for denoising signals and images. Sparsity-promoting regularization is a key ingredient in solving modern signal reconstruction problems; however, the operators…

Machine Learning · Computer Science 2023-09-07 Avrajit Ghosh , Michael T. McCann , Madeline Mitchell , Saiprasad Ravishankar

In this paper, under the monotonicity of pairs of operators, we propose some Generalized Proximal Point Algorithms to solve non-monotone inclusions using warped resolvents and transformed resolvents. The weak, strong, and linear convergence…

Optimization and Control · Mathematics 2025-01-24 Ba Khiet Le , Minh N. Dao , Michel Théra

Modulo-Imaging (MI) offers a promising alternative for expanding the dynamic range of images by resetting the signal intensity when it reaches the saturation level. Subsequently, high-dynamic range (HDR) modulo imaging requires a recovery…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Brayan Monroy , Jorge Bacca

Conventional algorithms for sparse signal recovery and sparse representation rely on $l_1$-norm regularized variational methods. However, when applied to the reconstruction of $\textit{sparse images}$, i.e., images where only a few pixels…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Sohil Shah , Tom Goldstein , Christoph Studer

Plug-and-play priors (PnP) is an image reconstruction framework that uses an image denoiser as an imaging prior. Unlike traditional regularized inversion, PnP does not require the prior to be expressible in the form of a regularization…

Image and Video Processing · Electrical Eng. & Systems 2020-02-27 Xiaojian Xu , Jiaming Liu , Yu Sun , Brendt Wohlberg , Ulugbek S. Kamilov

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function so that along the iterations the objective function decreases. Such a simple principle allows to solve a large…

Optimization and Control · Mathematics 2025-03-04 Ion Necoara , Daniela Lupu

Reinforcement learning (RL) has gained attention for aligning large language models (LLMs) via reinforcement learning from human feedback (RLHF). The actor-only variants of Proximal Policy Optimization (PPO) are widely applied for their…

Optimization and Control · Mathematics 2025-12-19 Yin Liu , Qiming Dai , Junyu Zhang , Zaiwen Wen

Continual learning has emerged as a pivotal area of research, primarily due to its advantageous characteristic that allows models to persistently acquire and retain information. However, catastrophic forgetting can severely impair model…

Machine Learning · Computer Science 2026-01-28 KaiHui Huang , RunQing Wu , JinHui Sheng , HanYi Zhang , Ling Ge , JinYu Guo , Fei Ye

Deep neural networks suffer from catastrophic forgetting, where performance on previous tasks degrades after training on a new task. This issue arises due to the model's tendency to overwrite previously acquired knowledge with new…

Machine Learning · Computer Science 2025-12-02 Lama Alssum , Hasan Abed Al Kader Hammoud , Motasem Alfarra , Juan C Leon Alcazar , Bernard Ghanem

A central question in modern deep learning is how to design optimizers whose behavior remains stable as the network width $w$ increases. We address this question by interpreting several widely used neural-network optimizers, including…

Machine Learning · Computer Science 2026-03-11 Ruihan Xu , Jiajin Li , Yiping Lu

We consider the minimum-norm-point (MNP) problem over polyhedra, a well-studied problem that encompasses linear programming. We present a general algorithmic framework that combines two fundamental approaches for this problem: active set…

Optimization and Control · Mathematics 2023-08-15 Satoru Fujishige , Tomonari Kitahara , László A. Végh

Operator learning offers a robust framework for approximating mappings between infinite-dimensional function spaces. It has also become a powerful tool for solving inverse problems in the computational sciences. This chapter surveys…

Numerical Analysis · Mathematics 2025-12-08 Nicholas H. Nelsen , Yunan Yang

Removal of noise from an image is an extensively studied problem in image processing. Indeed, the recent advent of sophisticated and highly effective denoising algorithms lead some to believe that existing methods are touching the ceiling…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Yaniv Romano , Michael Elad , Peyman Milanfar

In plug-and-play image restoration, the regularization is performed using powerful denoisers such as nonlocal means (NLM) or BM3D. This is done within the framework of alternating direction method of multipliers (ADMM), where the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Unni V. S. , Sanjay Ghosh , Kunal N. Chaudhury

Image corruption by motion artifacts is an ingrained problem in Magnetic Resonance Imaging (MRI). In this work, we propose a neural network-based regularization term to enhance Autofocusing, a classic optimization-based method to remove…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Ekaterina Kuzmina , Artem Razumov , Oleg Y. Rogov , Elfar Adalsteinsson , Jacob White , Dmitry V. Dylov

In this article we propose a method for solving unconstrained optimization problems with convex and Lipschitz continuous objective functions. By making use of the Moreau envelopes of the functions occurring in the objective, we smooth the…

Optimization and Control · Mathematics 2012-07-16 Radu Ioan Bot , Christopher Hendrich

Plug-and-Play Priors (PnP) and Regularization by Denoising (RED) are widely-used frameworks for solving imaging inverse problems by computing fixed-points of operators combining physical measurement models and learned image priors. While…

Image and Video Processing · Electrical Eng. & Systems 2022-05-27 Jiaming Liu , Xiaojian Xu , Weijie Gan , Shirin Shoushtari , Ulugbek S. Kamilov

In solving multi-modal, multi-objective optimization problems (MMOPs), the objective is not only to find a good representation of the Pareto-optimal front (PF) in the objective space but also to find all equivalent Pareto-optimal subsets…

Neural and Evolutionary Computing · Computer Science 2022-10-24 Tapabrata Ray , Mohammad Mohiuddin Mamun , Hemant Kumar Singh

Compressive Sensing (CS) has recently attracted attention for ECG data compression. In CS, an ECG signal is projected onto a small set of random vectors. Recovering the original signal from such compressed measurements remains a challenging…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Unni VS , Ruturaj Gavaskar , Kunal Narayan Chaudhury

In this work, we introduce a unifying Bregman-based majorization-minimization (MM) framework for solving nonconvex nonsmooth optimization problems. The proposed approach leverages Bregman divergences, possibly varying across iterations, to…

Optimization and Control · Mathematics 2026-04-15 Maxence Adly , Alix Chazottes , Emilie Chouzenoux , Jean-Christophe Pesquet , Florent Sureau