English
Related papers

Related papers: On Steepest-Descent-Kaczmarz Methods for Regulariz…

200 papers

In this paper we consider new regularization methods for linear inverse problems of dynamic type. These methods are based on dynamic programming techniques for linear quadratic optimal control problems. Two different approaches are…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

Iterative methods have led to better understanding and solving problems such as missing sampling, deconvolution, inverse systems, impulsive and Salt and Pepper noise removal problems. However, the challenges such as the speed of convergence…

Signal Processing · Electrical Eng. & Systems 2024-09-23 Mahdi Shamsi , Mahmoud Ghandi , Farokh Marvasti

We study randomized variants of two classical algorithms: coordinate descent for systems of linear equations and iterated projections for systems of linear inequalities. Expanding on a recent randomized iterated projection algorithm of…

Optimization and Control · Mathematics 2008-06-19 D. Leventhal , A. S. Lewis

We introduce a high-order finite element method for approximating the Vlasov-Poisson equations. This approach employs continuous Lagrange polynomials in space and explicit Runge-Kutta schemes for time discretization. To stabilize the…

Numerical Analysis · Mathematics 2025-03-12 Junjie Wen , Murtazo Nazarov

We study Kaczmarz type methods to solve consistent linear matrix equations. We first present a block Kaczmarz (BK) method that employs a deterministic cyclic row selection strategy. Assuming that the associated coefficient matrix has full…

Numerical Analysis · Mathematics 2026-02-04 Wenli Wang , Duo Liu , Gangrong Qu , Michiel E. Hochstenbach

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

Kaczmarz's alternating projection method has been widely used for solving a consistent (mostly over-determined) linear system of equations Ax=b. Because of its simple iterative nature with light computation, this method was successfully…

Numerical Analysis · Computer Science 2014-07-22 Tim Wallace , Ali Sekmen

This paper presents a Koopman lifting linearization method that is applicable to nonlinear dynamical systems having both stable and unstable regions. It is known that DMD and other standard data-driven methods face a fundamental difficulty…

Machine Learning · Computer Science 2023-01-18 Jerry Ng , H. Harry Asada

The Kaczmarz algorithm is an iterative method to reconstruct an unknown vector $f$ from inner products $\langle f , \varphi_{n} \rangle $. We consider the problem of how additive noise affects the reconstruction under the assumption that…

Functional Analysis · Mathematics 2019-06-21 Caleb Camrud , Evan Camrud , Lee Przybylski , Eric S. Weber

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

Optimization and Control · Mathematics 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin…

Numerical Analysis · Mathematics 2009-11-30 Thomas Blumensath

Direct solution of simultaneous linear equations is regarded to be slow for large systems of equations and requires special treatment to avoid numerical instability. A new method is proposed that addresses the numerical instability without…

Numerical Analysis · Mathematics 2011-05-02 Anoosh Abdy

We propose and test improvements to state-of-the-art techniques of Bayeasian statistical inference based on pseudolikelihood maximization with $\ell_1$ regularization and with decimation. In particular, we present a method to determine the…

Data Analysis, Statistics and Probability · Physics 2018-07-18 Alessia Marruzzo , Payal Tyagi , Fabrizio Antenucci , Andrea Pagnani , Luca Leuzzi

Optimization techniques play a crucial role in estimating parameters and state information for nonlinear systems. However, some critical aspects of these problems have received little attention in previous research. In this paper, we…

Optimization and Control · Mathematics 2023-06-02 Kaushal Kumar

Reduced-order modeling is an efficient approach for solving parameterized discrete partial differential equations when the solution is needed at many parameter values. An offline step approximates the solution space and an online step…

Numerical Analysis · Mathematics 2017-04-05 Howard C. Elman , Virginia Forstall

Subspace recycling techniques have been used quite successfully for the acceleration of iterative methods for solving large-scale linear systems. These methods often work by augmenting a solution subspace generated iteratively by a known…

Numerical Analysis · Mathematics 2021-05-18 Ronny Ramlau , Kirk M. Soodhalter , Victoria Hutterer

We show that Nesterov acceleration is an optimal-order iterative regularization method for linear ill-posed problems provided that a parameter is chosen accordingly to the smoothness of the solution. This result is proven both for an a…

Numerical Analysis · Mathematics 2021-07-07 Stefan Kindermann

In this paper, we build on recent work using a mathematical programming approach for incremental state update in analysis of non-linear mechanics models. In particular, we consider quasi-static analysis of continuum problems in the…

Optimization and Control · Mathematics 2015-06-23 Zahrasadat Lotfian , Mettupalayam Sivaselvan

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen