English
Related papers

Related papers: A rational conjugate gradient method for linear il…

200 papers

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

This paper introduces a new strategy for setting the regularization parameter when solving large-scale discrete ill-posed linear problems by means of the Arnoldi-Tikhonov method. This new rule is essentially based on the discrepancy…

Numerical Analysis · Mathematics 2013-07-02 Silvia Gazzola , Paolo Novati , Maria Rosaria Russo

In this paper, we develop algorithms for computing the recurrence coefficients corresponding to multiple orthogonal polynomials on the step-line. We reformulate the problem as an inverse eigenvalue problem, which can be solved using…

Numerical Analysis · Mathematics 2026-03-05 Amin Faghih , Michele Rinelli , Marc Van Barel , Raf Vandebril , Robbe Vermeiren

This paper is concerned with the regularization of large-scale discrete inverse problems by means of inexact Krylov methods. Specifically, we derive two new inexact Krylov methods that can be efficiently applied to unregularized or…

Numerical Analysis · Mathematics 2021-05-18 Silvia Gazzola , Malena Sabaté Landman

For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the…

Numerical Analysis · Mathematics 2020-02-03 Bernd Hofmann , Robert Plato

We consider the solution to the biharmonic equation in mixed form discretized by the Hybrid High-Order (HHO) methods. The two resulting second-order elliptic problems can be decoupled via the introduction of a new unknown, corresponding to…

Numerical Analysis · Mathematics 2024-09-06 Paola F. Antonietti , Pierre Matalon , Marco Verani

The efficient solution of large-scale multiterm linear matrix equations is a challenging task in numerical linear algebra, and it is a largely open problem. We propose a new iterative scheme for symmetric and positive definite operators,…

Numerical Analysis · Mathematics 2025-05-27 Davide Palitta , Martina Iannacito , Valeria Simoncini

In this paper, we consider the problem of minimizing the sum of two convex functions subject to linear linking constraints. The classical alternating direction type methods usually assume that the two convex functions have relatively easy…

Optimization and Control · Mathematics 2015-07-10 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

In this paper, we propose two second-order methods for solving the \(\ell_1\)-regularized composite optimization problem, which are developed based on two distinct definitions of approximate second-order stationary points. We introduce a…

Optimization and Control · Mathematics 2026-01-12 Hong Zhu

We develop a novel randomized conjugate gradient least squares (RCGLS) method for solving least-squares problems, in which iterative sketching is employed at each step to reduce the dimension and hence the computational cost. In particular,…

Numerical Analysis · Mathematics 2026-05-26 Yun Zeng , Jian-Feng Cai , Deren Han , Jiaxin Xie

This work presents a new Krylov-subspace-recycling method for efficiently solving sequences of linear systems of equations characterized by varying right-hand sides and symmetric-positive-definite matrices. As opposed to typical truncation…

Numerical Analysis · Mathematics 2016-01-22 Kevin Carlberg , Virginia Forstall , Ray Tuminaro

In this rather brief note we present and discuss techniques for solving Kronecker matrix product least squares problems. Our main contribution is an iterative approach that uses the efficient Kronecker matrix-vector multiplication strategy…

Numerical Analysis · Mathematics 2017-05-25 Pranay Seshadri

In the framework of inverse linear problems on infinite-dimensional Hilbert space, we prove the convergence of the conjugate gradient iterates to an exact solution to the inverse problem in the most general case where the self-adjoint,…

Numerical Analysis · Mathematics 2021-11-18 Noe Caruso , Alessandro Michelangeli

This paper introduces a novel double regularization scheme for bilevel optimization problems whose lower-level problem is composite and convex, but not necessarily strongly convex, in the lower-level variable. The analysis focuses on the…

Optimization and Control · Mathematics 2026-02-06 Mattia Solla , Johannes O. Royset

This is a survey, which is a continuation of the previous survey of the author about applications of Carleman estimates to Inverse Problems, J. Inverse and Ill-Posed Problems, 21, 477-560, 2013. It is shown here that Tikhonov functionals…

Mathematical Physics · Physics 2014-10-29 Michael V. Klibanov

The advantages and difficulties of application of Pad\'e approximants to two-dimensional regression analysis are discussed. New formulation of residuals is suggested in the method of least squares. It leads to a system of linear equations…

Methodology · Statistics 2022-08-23 Glib Yevkin , Olexandr Yevkin

This paper is concerned with the development and analysis of an iterative solver for high-dimensional second-order elliptic problems based on subspace-based low-rank tensor formats. Both the subspaces giving rise to low-rank approximations…

Numerical Analysis · Mathematics 2014-07-21 Markus Bachmayr , Wolfgang Dahmen

Adaptive cubic regularization methods for solving nonconvex problems need the efficient computation of the trial step, involving the minimization of a cubic model. We propose a new approach in which this model is minimized in a low…

Optimization and Control · Mathematics 2024-12-02 Stefania Bellavia , Davide Palitta , Margherita Porcelli , Valeria Simoncini

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

We propose a new first-order augmented Lagrangian algorithm ALCC for solving convex conic programs of the form min{rho(x)+gamma(x): Ax-b in K, x in chi}, where rho and gamma are closed convex functions, and gamma has a Lipschitz continuous…

Optimization and Control · Mathematics 2013-02-27 Necdet Serhat Aybat , Garud Iyengar