English
Related papers

Related papers: Variable Projection Methods for Solving Regularize…

200 papers

We consider the problem of finding the best approximation point from a polyhedral set, and its applications, in particular to solving large-scale linear programs. The classical projection problem has many various and many applications. We…

Optimization and Control · Mathematics 2023-06-12 Yair Censor , Walaa M. Moursi , Tyler Weames , Henry Wolkowicz

In this paper we provide a convergence analysis of some variational methods alternative to the classical Tikhonov regularization, namely Ivanov regularization (also called method of quasi solutions) with some versions of the discrepancy…

Numerical Analysis · Mathematics 2018-04-18 Barbara Kaltenbacher , Andrej Klassen

We present a class of nonconforming virtual element methods for general fourth order partial differential equations in two dimensions. We develop a generic approach for constructing the necessary projection operators and virtual element…

Numerical Analysis · Mathematics 2021-01-28 Andreas Dedner , Alice Hodson

We show that the sparse polynomial interpolation problem reduces to a discrete super-resolution problem on the $n$-dimensional torus. Therefore the semidefinite programming approach initiated by Cand\`es \\& Fernandez-Granda…

Optimization and Control · Mathematics 2018-11-26 Cédric Josz , Jean-Bernard Lasserre , Bernard Mourrain

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

We propose a new approach to linear ill-posed inverse problems. Our algorithm alternates between enforcing two constraints: the measurements and the statistical correlation structure in some transformed space. We use a non-linear multiscale…

Computational Engineering, Finance, and Science · Computer Science 2018-12-04 Ivan Dokmanić , Joan Bruna , Stéphane Mallat , Maarten de Hoop

We investigate a Tikhonov regularization scheme specifically tailored for shallow neural networks within the context of solving a classic inverse problem: approximating an unknown function and its derivatives within a unit cubic domain…

Numerical Analysis · Mathematics 2024-12-17 Yuanyuan Li , Shuai Lu

We consider sequential and parallel decomposition methods for a dual problem of a general total variation minimization problem with applications in several image processing tasks, like image inpainting, estimation of optical flow and…

Numerical Analysis · Mathematics 2022-11-02 Stephan Hilb , Andreas Langer

Algorithms for automatically selecting a scalar or locally varying regularization parameter for total variation models with an $L^{\tau}$-data fidelity term, $\tau\in \{1,2\}$, are presented. The automated selection of the regularization…

Numerical Analysis · Mathematics 2017-01-02 Andreas Langer

Recovering clear images from blurry ones with an unknown blur kernel is a challenging problem. Deep image prior (DIP) proposes to use the deep network as a regularizer for a single image rather than as a supervised model, which achieves…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Tingting Wu , Zhiyan Du , Zhi Li , Feng-Lei Fan , Tieyong Zeng

The image deblurring problem consists of reconstructing images from blur and noise contaminated available data. In this AMS Notices article, we provide an overview of some well known numerical linear algebra techniques that are use for…

Numerical Analysis · Mathematics 2022-01-25 David Austin , Malena I. Español , Mirjeta Pasha

Many computational problems involve solving a linear system of equations, although only a subset of the entries of the solution are needed. In inverse problems, where the goal is to estimate unknown parameters from indirect noisy…

Numerical Analysis · Mathematics 2026-01-13 Daniela Calvetti , Nuutti Hyvönen , Ville Kolehmainen , Erkki Somersalo

In this paper we investigate the use of half-precision Kronecker product singular value decomposition (SVD) approximations as preconditioners for large-scale Tikhonov regularized least squares problems. Half precision reduces storage…

Numerical Analysis · Mathematics 2023-11-28 Yizhou Chen , Xiang Ji , James Nagy

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

We consider the problem of finding for a given $N$-tuple of polynomials (real or complex) the closest $N$-tuple that has a common divisor of degree at least $d$. Extended weighted Euclidean seminorm of the coefficients is used as a measure…

Optimization and Control · Mathematics 2015-11-05 Konstantin Usevich , Ivan Markovsky

Variable thickness topology optimization (VTTO) is a potent methodology for designing high-performance, high-stiffness sheet structures. However, this method frequently encounters two primary challenges: 1) the formation of undesirable…

Computational Engineering, Finance, and Science · Computer Science 2026-03-11 Gabriel Stankiewicz , Chaitanya Dev , Paul Steinmann

We present new convergence analyses for parallel subspace correction methods for unconstrained semicoercive and nearly semicoercive convex optimization problems, generalizing the theory of singular and nearly singular linear problems to a…

Numerical Analysis · Mathematics 2026-04-03 Young-Ju Lee , Jongho Park

We develop hybrid projection methods for computing solutions to large-scale inverse problems, where the solution represents a sum of different stochastic components. Such scenarios arise in many imaging applications (e.g., anomaly detection…

Numerical Analysis · Mathematics 2022-06-15 Julianne Chung , Jiahua Jiang , Scot M. Miller , Arvind K. Saibaba

Singular value decomposition is the key tool in the analysis and understanding of linear regularization methods. In the last decade nonlinear variational approaches such as $\ell^1$ or total variation regularizations became quite prominent…

Numerical Analysis · Mathematics 2012-11-12 Martin Benning , Martin Burger

Contrastive learning has proven to be highly efficient and adaptable in shaping representation spaces across diverse modalities by pulling similar samples together and pushing dissimilar ones apart. However, two key limitations persist: (1)…

Machine Learning · Computer Science 2025-12-08 Ziwen Wang , Jiajun Fan , Thao Nguyen , Heng Ji , Ge Liu