English
Related papers

Related papers: An $\ell_p$ Variable Projection Method for Large-S…

200 papers

Designing computational experiments involving $\ell_1$ minimization with linear constraints in a finite-dimensional, real-valued space for receiving a sparse solution with a precise number $k$ of nonzero entries is, in general, difficult.…

Optimization and Control · Mathematics 2013-09-11 Christian Kruschel , Dirk A. Lorenz

We tackle the problem of building adaptive estimation procedures for ill-posed inverse problems. For general regularization methods depending on tuning parameters, we construct a penalized method that selects the optimal smoothing sequence…

Statistics Theory · Mathematics 2008-07-31 Jean-Michel Loubes , Carenne Ludeña

Model-based iterative reconstruction plays a key role in solving inverse problems. However, the associated minimization problems are generally large-scale, nonsmooth, and sometimes even nonconvex, which present challenges in designing…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Tao Hong , Zhaoyi Xu , Jason Hu , Jeffrey A. Fessler

We introduce an adaptive regularization approach. In contrast to conventional Tikhonov regularization, which specifies a fixed regularization operator, we estimate it simultaneously with parameters. From a Bayesian perspective we estimate…

Computer Vision and Pattern Recognition · Computer Science 2009-06-19 Andriy Myronenko , Xubo Song

This work addresses the robust reconstruction problem of a sparse signal from compressed measurements. We propose a robust formulation for sparse reconstruction which employs the $\ell_1$-norm as the loss function for the residual error and…

Information Theory · Computer Science 2017-03-30 Fei Wen , Yuan Yang , Ling Pei , Wenxian Yu , Peilin Liu

Fine-tuning pre-trained generative models with Reinforcement Learning (RL) has emerged as an effective approach for aligning outputs more closely with nuanced human preferences. In this paper, we investigate the application of Group…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Matteo Gallici , Haitz Sáez de Ocáriz Borde

A projection-based formulation is presented for non-linear model reduction of problems with extreme scale disparity. The approach allows for the selection of an arbitrary, but complete, set of solution variables while preserving the…

Computational Physics · Physics 2021-10-04 Cheng Huang , Christopher R. Wentland , Karthik Duraisamy , Charles Merkle

Ill-posed linear inverse problems (ILIP), such as restoration and reconstruction, are a core topic of signal/image processing. A standard approach to deal with ILIP uses a constrained optimization problem, where a regularization function is…

Optimization and Control · Mathematics 2016-11-15 Manya V. Afonso , Jose M. Bioucas-Dias , Mario A. T. Figueiredo

We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear…

Optimization and Control · Mathematics 2023-03-08 Yifei Wang , Kangkang Deng , Haoyang Liu , Zaiwen Wen

Tikhonov regularization is a popular approach to obtain a meaningful solution for ill-conditioned linear least squares problems. A relatively simple way of choosing a good regularization parameter is given by Morozov's discrepancy…

Numerical Analysis · Mathematics 2020-06-24 Jeffrey Cornelis , Nick Schenkels , Wim Vanroose

A range of nonlinear image reconstruction procedures based on extremizing the generalized Shannon entropy, Kullback-Leibler cross-entropy and Renyi information measures and proposed by the author in early papers is presented. The…

Astrophysics · Physics 2007-05-23 Anisa T. Bajkova

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

Optimization and Control · Mathematics 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

Neural implicit representations have revolutionized dense multi-view surface reconstruction, yet their performance significantly diminishes with sparse input views. A few pioneering works have sought to tackle the challenge of sparse-view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Sheng Ye , Yuze He , Matthieu Lin , Jenny Sheng , Ruoyu Fan , Yiheng Han , Yubin Hu , Ran Yi , Yu-Hui Wen , Yong-Jin Liu , Wenping Wang

We consider the problem of finding for a given $N$-tuple of polynomials (real or complex) the closest $N$-tuple that has a common divisor of degree at least $d$. Extended weighted Euclidean seminorm of the coefficients is used as a measure…

Optimization and Control · Mathematics 2015-11-05 Konstantin Usevich , Ivan Markovsky

In this work we present a novel optimization strategy for image reconstruction tasks under analysis-based image regularization, which promotes sparse and/or low-rank solutions in some learned transform domain. We parameterize such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Iaroslav Koshelev , Stamatios Lefkimmiatis

In this work, we introduce a unifying Bregman-based majorization-minimization (MM) framework for solving nonconvex nonsmooth optimization problems. The proposed approach leverages Bregman divergences, possibly varying across iterations, to…

Optimization and Control · Mathematics 2026-04-15 Maxence Adly , Alix Chazottes , Emilie Chouzenoux , Jean-Christophe Pesquet , Florent Sureau

Dynamic inverse problems are challenging to solve due to the need to identify and incorporate appropriate regularization in both space and time. Moreover, the very large scale nature of such problems in practice presents an enormous…

Numerical Analysis · Mathematics 2025-01-23 Toluwani Okunola , Mirjeta Pasha , Misha Kilmer , Melina Freitag

This paper deals with a modified iterative projection method for approximating a solution of the hierarchical fixed point problem for a sequene of nearly nonexpansive mappings with respect to a nonexpansive mapping. It is shown that under…

Functional Analysis · Mathematics 2014-03-14 Ibrahim Karahan , Murat Ozdemir

We introduce and compare new compression approaches to obtain regularized solutions of large linear systems which are commonly encountered in large scale inverse problems. We first describe how to approximate matrix vector operations with a…

Numerical Analysis · Mathematics 2016-08-12 Sergey Voronin , Dylan Mikesell , Guust Nolet

We propose the use of $\ell_1$ regularization in a wavelet basis for the solution of linearized seismic tomography problems $Am=d$, allowing for the possibility of sharp discontinuities superimposed on a smoothly varying background. An…

Geophysics · Physics 2009-11-13 Ignace Loris , Guust Nolet , Ingrid Daubechies , F. A. Dahlen