English
Related papers

Related papers: Randomized Kaczmarz methods for t-product tensor l…

200 papers

Regularized factorization is proposed to simulate time evolution for quantum lattice systems. Transcending the Trotter decomposition, the resulting compact structure of the propagator indicates a high-order Baker-Campbell-Hausdorff series.…

Strongly Correlated Electrons · Physics 2022-08-09 Li-Xiang Cen

With the growth of large data as well as large-scale learning tasks, the need for efficient and robust linear system solvers is greater than ever. The randomized Kaczmarz method (RK) and similar stochastic iterative methods have received…

Numerical Analysis · Mathematics 2023-01-04 Lu Cheng , Benjamin Jarman , Deanna Needell , Elizaveta Rebrova

Tensor time series, which is a time series consisting of tensorial observations, has become ubiquitous. It typically exhibits high dimensionality. One approach for dimension reduction is to use a factor model structure, in a form similar to…

Methodology · Statistics 2024-07-19 Yuefeng Han , Rong Chen , Dan Yang , Cun-Hui Zhang

A multi-step extended maximum residual Kaczmarz method is presented for the solution of the large inconsistent linear system of equations by using the multi-step iterations technique. Theoretical analysis proves the proposed method is…

Numerical Analysis · Mathematics 2023-09-07 Aqin Xiao , Junfeng Yin , Ning Zheng

We consider the problem of solving mixed random linear equations with $k$ components. This is the noiseless setting of mixed linear regression. The goal is to estimate multiple linear models from mixed samples in the case where the labels…

Machine Learning · Computer Science 2016-08-23 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

Among recent developments centered around Randomized Kaczmarz (RK), a row-sampling iterative projection method for large-scale linear systems, several adaptions to the method have inspired faster convergence. Focusing solely on…

Numerical Analysis · Mathematics 2026-03-03 James Nguyen , Oleg Presnyakov , Adityakrishnan Radhakhrishnan

Randomized algorithms for very large matrix problems have received a great deal of attention in recent years. Much of this work was motivated by problems in large-scale data analysis, and this work was performed by individuals from many…

Data Structures and Algorithms · Computer Science 2011-11-16 Michael W. Mahoney

We investigate modified steepest descent methods coupled with a loping Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization…

Numerical Analysis · Mathematics 2008-08-03 A. De Cezaro , M. Haltmeier , A. Leitao , O. Scherzer

We present a randomized Kaczmarz method for linear discriminant analysis (rkLDA), an iterative randomized approach to binary-class Gaussian model linear discriminant analysis (LDA) for very large data. We harness a least squares formulation…

Computation · Statistics 2025-01-09 Jocelyn T. Chi , Deanna Needell

This text investigates relations between two well-known family of algorithms, matrix factorisations and recursive linear filters, by describing a probabilistic model in which approximate inference corresponds to a matrix factorisation…

Machine Learning · Statistics 2015-09-08 Ömer Deniz Akyıldız

We present new algorithms to detect and correct errors in the lower-upper factorization of a matrix, or the triangular linear system solution, over an arbitrary field. Our main algorithms do not require any additional information or…

Symbolic Computation · Computer Science 2019-01-31 Jean-Guillaume Dumas , Joris Van Der Hoeven , Clément Pernet , Daniel Roche

We present a new framework for the analysis and design of randomized algorithms for solving various types of linear systems, including consistent or inconsistent, full rank or rank-deficient. Our method is formulated with four randomized…

Optimization and Control · Mathematics 2022-08-25 Deren Han , Jiaxin Xie

The article mainly introduces preprocessing algorithms for solving linear equation systems. This algorithm uses three algorithms as inner iterations, namely RPCG algorithm, ADI algorithm, and Kaczmarz algorithm. Then, it uses BA-GMRES as an…

Numerical Analysis · Mathematics 2024-04-10 Juan Zhang , Yiyi Luo

Recent literature has advocated the use of randomized methods for accelerating the solution of various matrix problems arising throughout data science and computational science. One popular strategy for leveraging randomization is to use it…

Numerical Analysis · Mathematics 2024-09-27 Boris Shustin , Haim Avron

This paper discusses weighted tensor Golub-Kahan-type bidiagonalization processes using the t-product. This product was introduced in [M. E. Kilmer and C. D. Martin, Factorization strategies for third order tensors, Linear Algebra Appl.,…

Numerical Analysis · Mathematics 2021-09-10 Lothar Reichel , Ugochukwu O Ugwu

By introducing a subsampling strategy, we propose a randomized block Kaczmarz-Motzkin method for solving linear systems. Such strategy not only determines the block size, but also combines and extends two famous strategies, i.e., randomness…

Numerical Analysis · Mathematics 2022-12-01 Yanjun Zhang , Hanyu Li

Dynamic mode decomposition (DMD) has become a powerful data-driven method for analyzing the spatiotemporal dynamics of complex, high-dimensional systems. However, conventional DMD methods are limited to matrix-based formulations, which…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Ziqin He , Mengqi Hu , Yifei Lou , Can Chen

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

Randomized Kaczmarz-type methods are widely used for their simplicity and efficiency in solving large-scale linear systems and optimization problems. However, their applicability is limited when dealing with inconsistent systems or…

Numerical Analysis · Mathematics 2025-12-11 Zeyu Dong , Aqin Xiao , Guojian Yin , Junfeng Yin

The distributed Kaczmarz algorithm is an adaptation of the standard Kaczmarz algorithm to the situation in which data is distributed throughout a network represented by a tree. We isolate substructures of the network and study convergence…

Numerical Analysis · Mathematics 2020-06-03 Riley Borgard , Steven N. Harding , Haley Duba , Chloe Makdad , Jay Mayfield , Randal Tuggle , Eric Weber