English
Related papers

Related papers: Randomized Algorithms for Large-scale Inverse Prob…

200 papers

In this paper we investigate an adaptive discretization strategy for ill-posed linear prob- lems combined with a regularization from a class of semiiterative methods. We show that such a discretization approach in combination with a…

Numerical Analysis · Mathematics 2014-07-22 Wolfgang Erb , Evgeniya V. Semenova

The singular value decomposition (SVD) of a matrix is a powerful tool for many matrix computation problems. In this paper, we consider generalizing the standard SVD to analyze and compute the regularized solution of linear ill-posed…

Numerical Analysis · Mathematics 2023-12-19 Haibo Li

In this work, we propose a high-order regularization method to solve the ill-conditioned problems in robot localization. Numerical solutions to robot localization problems are often unstable when the problems are ill-conditioned. A typical…

Robotics · Computer Science 2025-05-07 Xinghua Liu , Ming Cao

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

Randomized rounding is a technique that was originally used to approximate hard offline discrete optimization problems from a mathematical programming relaxation. Since then it has also been used to approximately solve sequential stochastic…

Data Structures and Algorithms · Computer Science 2024-11-21 Will Ma

Randomized rounding is a standard method, based on the probabilistic method, for designing combinatorial approximation algorithms. In Raghavan's seminal paper introducing the method (1988), he writes: "The time taken to solve the linear…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

In this paper, we study randomized methods for feedback design of uncertain systems. The first contribution is to derive the sample complexity of various constrained control problems. In particular, we show the key role played by the…

Systems and Control · Computer Science 2014-07-22 T. Alamo , R. Tempo , A. Luque , D. R. Ramirez

For the solution of full-rank ill-posed linear systems a new approach based on the Arnoldi algorithm is presented. Working with regularized systems, the method theoretically reconstructs the true solution by means of the computation of a…

Numerical Analysis · Mathematics 2010-09-29 Claude Brezinski , Paolo Novati , Michela Redivo-Zaglia

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

Aiming to provide a faster and convenient truncated SVD algorithm for large sparse matrices from real applications (i.e. for computing a few of largest singular values and the corresponding singular vectors), a dynamically shifted power…

Mathematical Software · Computer Science 2024-04-16 Xu Feng , Wenjian Yu , Yuyang Xie , Jie Tang

In this paper, we investigate iterative methods that are based on sampling of the data for computing Tikhonov-regularized solutions. We focus on very large inverse problems where access to the entire data set is not possible all at once…

Numerical Analysis · Mathematics 2018-12-18 J. Tanner Slagel , Julianne Chung , Matthias Chung , David Kozak , Luis Tenorio

Randomized algorithms for very large matrix problems have received a great deal of attention in recent years. Much of this work was motivated by problems in large-scale data analysis, and this work was performed by individuals from many…

Data Structures and Algorithms · Computer Science 2011-11-16 Michael W. Mahoney

This thesis gives an overview of the state-of-the-art randomized linear algebra algorithms for singular value decomposition (SVD), including the presentation of existing pseudo-codes and theoretical error analysis. Our main focus is on…

Optimization and Control · Mathematics 2024-02-29 Xiaowen Li

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

Obtaining meaningful solutions for inverse problems has been a major challenge with many applications in science and engineering. Recent machine learning techniques based on proximal and diffusion-based methods have shown promising results.…

Machine Learning · Computer Science 2024-02-08 Moshe Eliasof , Eldad Haber , Eran Treister

Randomized iterative algorithms have attracted much attention in recent years because they can approximately solve large-scale linear systems of equations without accessing the entire coefficient matrix. In this paper, we propose two novel…

Numerical Analysis · Mathematics 2021-10-22 Kui Du , Xiao-Hui Sun

Recently, a class of algorithms combining classical fixed point iterations with repeated random sparsification of approximate solution vectors has been successfully applied to eigenproblems with matrices as large as $10^{108} \times…

Numerical Analysis · Mathematics 2025-04-28 Jonathan Weare , Robert J. Webber

Accurate determination of the regularization parameter in inverse problems still represents an analytical challenge, owing mainly to the considerable difficulty to separate the unknown noise from the signal. We present a new approach for…

Numerical Analysis · Mathematics 2019-07-24 Eitan Levin , Alexander Y. Meltzer

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal