English
Related papers

Related papers: On Steepest-Descent-Kaczmarz Methods for Regulariz…

200 papers

A version of the Dynamical Systems Method (DSM) for solving ill-conditioned linear algebraic systems is studied in this paper. An {\it a priori} and {\it a posteriori} stopping rules are justified. An algorithm for computing the solution…

Numerical Analysis · Mathematics 2009-01-28 N. S. Hoang , A. G. Ramm

Nonlinear convex problems arise in various areas of applied mathematics and engineering. Classical techniques such as the relaxed proximal point algorithm (PPA) and the prediction correction (PC) method were proposed for linearly…

Optimization and Control · Mathematics 2023-07-28 Sai Wang , Yi Gong

Motivated by the randomized sketch to solve a variety of problems in scientific computation, we improve both the maximal weighted residual Kaczmarz method and the randomized block average Kaczmarz method using two new randomized sketch…

Numerical Analysis · Mathematics 2025-11-18 Haochen Jiang , Dongdong Liu , Xianping Wu , Xu Yang

Optimization techniques are at the core of many scientific and engineering disciplines. The steepest descent methods play a foundational role in this area. In this paper we studied a generalized steepest descent method on Riemannian…

Optimization and Control · Mathematics 2025-02-28 Rashid A. , Amal A Samad

In this work, we investigate a stochastic gradient descent method for solving inverse problems that can be written as systems of linear or nonlinear ill-posed equations in Banach spaces. The method uses only a randomly selected equation at…

Numerical Analysis · Mathematics 2024-09-10 Ruixue Gu , Zhenwu Fu , Bo Han , Hongsun Fu

The randomized version of the Kaczmarz method for the solution of linear systems is known to converge linearly in expectation. In this work we extend this result and show that the recently proposed Randomized Sparse Kaczmarz method for…

Optimization and Control · Mathematics 2016-10-11 Frank Schöpfer , Dirk A. Lorenz

In this paper we the formulation of inverse problems as constrained minimization problems and their iterative solution by gradient or Newton type. We carry out a convergence analysis in the sense of regularization methods and discuss…

Numerical Analysis · Mathematics 2021-01-15 Barbara Kaltenbacher , Kha Van Huynh

Based on the ideas of arXiv:1710.06612, we consider the problem of minimization of the Holder-continuous non-smooth functional $f$ with non-positive convex (generally, non-smooth) Lipschitz-continuous functional constraint. We propose some…

Optimization and Control · Mathematics 2022-01-03 Fedor Stonyakin , Alexey Stepanov , Alexander Gasnikov , Alexander Titov

We study the convergence of the gradient descent method for solving ill-posed problems where the solution is characterized as a global minimum of a differentiable functional in a Hilbert space. The classical least-squares functional for…

Numerical Analysis · Mathematics 2016-06-02 Stefan Kindermann

Approximating the Koopman operator from data is numerically challenging when many lifting functions are considered. Even low-dimensional systems can yield unstable or ill-conditioned results in a high-dimensional lifted space. In this…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Steven Dahdah , James Richard Forbes

In this paper we propose a nonconforming finite element method for the solution of the ill-posed elliptic Cauchy problem. We prove error estimates using continuous dependence estimates in the $L^2$-norm. The effect of perturbations in data…

Numerical Analysis · Mathematics 2014-06-18 Erik Burman

The Kaczmarz method is an iterative method for solving large systems of equations that projects iterates orthogonally onto the solution space of each equation. In contrast to direct methods such as Gaussian elimination or QR-factorization,…

Numerical Analysis · Computer Science 2013-09-30 Noreen Jamil , Deanna Needell , Johannes Muller , Christof Lutteroth , Gerald Weber

In these notes we propose and analyze an inertial type method for obtaining stable approximate solutions to nonlinear ill-posed operator equations. The method is based on the Levenberg-Marquardt (LM) iteration. The main obtained results…

Numerical Analysis · Mathematics 2024-06-12 Antonio Leitão , Joel C. Rabelo , Dirk A. Lorenz , Maximilian Winkler

This paper investigates the randomized version of the Kaczmarz method to solve linear systems in the case where the adjoint of the system matrix is not exact---a situation we refer to as "mismatched adjoint". We show that the method may…

Numerical Analysis · Mathematics 2018-03-09 Dirk A. Lorenz , Sean Rose , Frank Schöpfer

This paper studies multistep methods for the integration of reversible dynamical systems, with particular emphasis on the planar Kepler problem. It has previously been shown by Cano & Sanz-Serna that reversible linear multisteps for…

Astrophysics · Physics 2009-10-31 Wyn Evans , Scott Tremaine

The systems of nonlinear Volterra integral equations of the first kind with jump discontinuous kernels are studied. The iterative numerical method for such nonlinear systems is proposed. Proposed method employs the modified…

Numerical Analysis · Mathematics 2019-10-22 A. N. Tynda , D. N. Sidorov , N. A. Sidorov

For solving linear ill-posed problems regularization methods are required when the right hand side is with some noise. In the present paper regularized solutions are obtained by implicit iteration methods in Hilbert scales. % By exploiting…

Numerical Analysis · Mathematics 2015-05-20 Qinian Jin , Ulrich Tautenhahn

A comprehensive convergence and stability analysis of some probabilistic numerical methods designed to solve Cauchy-type inverse problems is performed in this study. Such inverse problems aim at solving an elliptic partial differential…

Numerical Analysis · Mathematics 2025-08-12 Iulian Cîmpean , Andreea Grecu , Liviu Marin

We consider the problem of minimizing the sum of an average function of a large number of smooth convex components and a general, possibly non-differentiable, convex function. Although many methods have been proposed to solve this problem…

Optimization and Control · Mathematics 2019-01-01 Le Thi Khanh Hien , Cuong V. Nguyen , Huan Xu , Canyi Lu , Jiashi Feng

We provide a complete characterization of the randomized Kaczmarz algorithm (RKA) for inconsistent linear systems. The Kaczmarz algorithm, known in some fields as the algebraic reconstruction technique, is a classical method for solving…

Numerical Analysis · Mathematics 2015-02-05 Chuang Wang , Ameya Agaskar , Yue M. Lu