English
Related papers

Related papers: Splitting-based randomized iterative methods for s…

200 papers

Clinically useful proton Computed Tomography images will rely on algorithms to find the three-dimensional proton stopping power distribution that optimally fits the measured proton data. We present a least squares iterative method with many…

Medical Physics · Physics 2021-05-12 Don F. DeJongh , Ethan A. DeJongh

Least squares method is one of the simplest and most popular techniques applied in data fitting, imaging processing and high dimension data analysis. The classic methods like QR and SVD decomposition for solving least squares problems has a…

Numerical Analysis · Mathematics 2018-06-11 Long Chen , Huiwen Wu

In this paper, we study the problem of finding the least square solutions of over-determined linear algebraic equations over networks in a distributed manner. Each node has access to one of the linear equations and holds a dynamic state. We…

Optimization and Control · Mathematics 2019-09-10 Tao Yang , Jemin George , Jiahu Qin , Xinlei Yi , Junfeng Wu

The Kaczmarz method is an iterative method for solving large systems of equations that projects iterates orthogonally onto the solution space of each equation. In contrast to direct methods such as Gaussian elimination or QR-factorization,…

Numerical Analysis · Computer Science 2013-09-30 Noreen Jamil , Deanna Needell , Johannes Muller , Christof Lutteroth , Gerald Weber

iALS is a popular algorithm for learning matrix factorization models from implicit feedback with alternating least squares. This algorithm was invented over a decade ago but still shows competitive quality compared to recent approaches like…

Machine Learning · Computer Science 2021-10-28 Steffen Rendle , Walid Krichene , Li Zhang , Yehuda Koren

A multiscale numerical method is proposed for the solution of semi-linear elliptic stochastic partial differential equations with localized uncertainties and non-linearities, the uncertainties being modeled by a set of random parameters. It…

Numerical Analysis · Mathematics 2019-01-23 Anthony Nouy , Florent Pled

Quantization can be used to form new vectors/matrices with shared values close to the original. In recent years, the popularity of scalar quantization for value-sharing applications has been soaring as it has been found huge utilities in…

Machine Learning · Computer Science 2019-12-11 Chen Wang , Xiaomei Yang , Shaomin Fei , Kai Zhou , Xiaofeng Gong , Miao Du , Ruisen Luo

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Statistics Theory · Mathematics 2018-10-16 Michael Krikheli , Amir Leshem

Performance analysis of $l_0$ norm constrained Recursive least Squares (RLS) algorithm is attempted in this paper. Though the performance pretty attractive compared to its various alternatives, no thorough study of theoretical analysis has…

Information Theory · Computer Science 2016-02-11 Samrat Mukhopadhyay , Bijit Kumar Das , Mrityunjoy Chakraborty

This work presents an algorithmic scheme for solving the infinite-time constrained linear quadratic regulation problem. We employ an accelerated version of a popular proximal gradient scheme, commonly known as the Forward-Backward Splitting…

Optimization and Control · Mathematics 2015-01-20 Giorgos Stathopoulos , Milan Korda , Colin N. Jones

Instead of minimizing the sum of all $n$ squared residuals as the classical least squares (LS) does, Rousseeuw (1984) proposed to minimize the sum of $h$ ($n/2 \leq h < n$) smallest squared residuals, the resulting estimator is called least…

Computation · Statistics 2022-10-13 Yijun Zuo

This paper presents a first-order {distributed continuous-time algorithm} for computing the least-squares solution to a linear equation over networks. Given the uniqueness of the solution, with nonintegrable and diminishing step size,…

Systems and Control · Computer Science 2018-08-14 Yang Liu , Youcheng Lou , Brian D. O. Anderson , Guodong Shi

A frequently faced task in experimental physics is to measure the probability distribution of some quantity. Often this quantity to be measured is smeared by a non-ideal detector response or by some physical process. The procedure of…

Statistics Theory · Mathematics 2014-04-11 Andras Laszlo

To find the least squares solution of a very large and inconsistent system of equations, one can employ the extended Kaczmarz algorithm. This method simultaneously removes the error term, such that a consistent system is asymptotically…

Numerical Analysis · Mathematics 2015-04-02 Stefania Petra , Constantin Popa

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

The design of digital filters is a fundamental process in the context of digital signal processing. The purpose of this paper is to study the use of $\lp$ norms (for $2 < p < \infty$) as design criteria for digital filters, and to introduce…

Information Theory · Computer Science 2012-07-20 Ricardo A. Vargas , C. Sidney Burrus

We present a new iterative rotation inversion technique based on the Simultaneous Algebraic Reconstruction Technique developed for image reconstruction. We describe in detail our algorithmic implementation and compare it to the classical…

Solar and Stellar Astrophysics · Physics 2024-06-17 Sylvain G. Korzennik , Antonio Eff-Darwich

In this article, we establish a class of new projected type iteration methods based on matrix spitting for solving the linear complementarity problem. Also, we provide a sufficient condition for the convergence analysis when the system…

Optimization and Control · Mathematics 2023-05-10 Bharat Kumar , Deepmala , A. K. Das

Stochastic iterative algorithms such as the Kaczmarz and Gauss-Seidel methods have gained recent attention because of their speed, simplicity, and the ability to approximately solve large-scale linear systems of equations without needing to…

Numerical Analysis · Mathematics 2019-01-10 Anna Ma , Deanna Needell , Aaditya Ramdas