English
Related papers

Related papers: Block Matrix and Tensor Randomized Kaczmarz Method…

200 papers

In this work we study the method of Bregman projections for deterministic and stochastic convex feasibility problems with three types of control sequences for the selection of sets during the algorithmic procedure: greedy, random, and…

Optimization and Control · Mathematics 2021-01-06 Vladimir Kostic , Saverio Salzo

In this paper, an optimization model with a linear objective function subject to a system of fuzzy relation equations (FRE) is studied where the feasible region is defined by the Lukasiewicz t-norm. Since the finding of all minimal…

Optimization and Control · Mathematics 2022-04-14 Amin Ghodousian , Zahra Boreiri , Faeze Habibi

In this article we introduce $K$-type block matrices which include two new classes of block matrices namely block triangular $K$-matrices and hidden block triangular $K$-matrices. We show that the solution of linear complementarity problem…

Optimization and Control · Mathematics 2021-09-21 A. Dutta , A. K. Das

The sampling Kaczmarz-Motzkin (SKM) method is a generalization of the randomized Kaczmarz and Motzkin methods. It first samples some rows of coefficient matrix randomly to build a set and then makes use of the maximum violation criterion…

Numerical Analysis · Mathematics 2020-11-16 Yanjun Zhang , Hanyu Li

In the last decade, tensors have shown their potential as valuable tools for various tasks in numerical linear algebra. While most of the research has been focusing on how to compress a given tensor in order to maintain information as well…

Numerical Analysis · Mathematics 2024-09-17 Alberto Bucci , Davide Palitta , Leonardo Robol

For solving the large-scale linear system by iteration methods, we utilize the Petrov-Galerkin conditions and relaxed greedy index selection technique and provide two relaxed greedy deterministic row (RGDR) and column (RGDC) iterative…

Numerical Analysis · Mathematics 2022-08-12 Nian-Ci Wu , Ling-Xia Cui , Qian Zuo

We present randUBV, a randomized algorithm for matrix sketching based on the block Lanzcos bidiagonalization process. Given a matrix $\bf{A}$, it produces a low-rank approximation of the form ${\bf UBV}^T$, where $\bf{U}$ and $\bf{V}$ have…

Numerical Analysis · Mathematics 2021-02-09 Eric Hallman

The Kaczmarz method is a popular iterative method for solving consistent, overdetermined linear system such as medical imaging in computerized tomography. The Kaczmarz's iteration repeatedly scans all equations in order, which leads to…

Numerical Analysis · Mathematics 2023-05-23 Chuan-gang Kang

Currently, existing tensor recovery methods fail to recognize the impact of tensor scale variations on their structural characteristics. Furthermore, existing studies face prohibitive computational costs when dealing with large-scale…

Machine Learning · Computer Science 2025-07-09 Wenjin Qin , Hailin Wang , Jingyao Hou , Jianjun Wang

In this paper we present a convergence rate analysis of inexact variants of several randomized iterative methods. Among the methods studied are: stochastic gradient descent, stochastic Newton, stochastic proximal point and stochastic…

Optimization and Control · Mathematics 2019-03-20 Nicolas Loizou , Peter Richtárik

We present a simple, accurate method for solving consistent, rank-deficient linear systems, with or without addi- tional rank-completing constraints. Such problems arise in a variety of applications, such as the computation of the…

Numerical Analysis · Mathematics 2014-01-15 Josef Sifuentes , Zydrunas Gimbutas , Leslie Greengard

We introduce a new iterative regularization method for solving inverse problems that can be written as systems of linear or non-linear equations in Hilbert spaces. The proposed averaged Kaczmarz (AVEK) method can be seen as a hybrid method…

Numerical Analysis · Mathematics 2018-03-09 Housen Li , Markus Haltmeier

In recent years, a distributed Douglas-Rachford splitting method (DDRSM) has been proposed to tackle multi-block separable convex optimization problems. This algorithm offers relatively easier subproblems and greater efficiency for…

Optimization and Control · Mathematics 2024-11-19 Leyu Hu , Jiaxin Xie , Xingju Cai , Deren Han

Phase retrieval has been an attractive but difficult problem rising from physical science, and there has been a gap between state-of-the-art theoretical convergence analyses and the corresponding efficient retrieval methods. Firstly, these…

Information Theory · Computer Science 2017-12-06 Gen Li , Yuchen Jiao , Yuantao Gu

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

In this paper, we consider a novel two-dimensional randomized Kaczmarz method and its improved version with simple random sampling, which chooses two active rows with probability proportional to the square of their cross-product-like…

Numerical Analysis · Mathematics 2025-06-27 Tao Li , Meng-Long Xiao , Xin-Fang Zhang

In the low-rank matrix completion (LRMC) problem, the low-rank assumption means that the columns (or rows) of the matrix to be completed are points on a low-dimensional linear algebraic variety. This paper extends this thinking to cases…

Machine Learning · Statistics 2020-09-08 Greg Ongie , Daniel Pimentel-Alarcón , Laura Balzano , Rebecca Willett , Robert D. Nowak

In this paper, a robust sequential quadratic programming method for constrained optimization is generalized to problem with an {expectation} objective function {and} deterministic equality and inequality constraints. A stochastic line…

Optimization and Control · Mathematics 2024-10-07 Songqiang Qiu , Vyacheslav Kungurtsev

We propose a simple doubly stochastic block Gauss--Seidel algorithm for solving linear systems of equations. By varying the row partition parameter and the column partition parameter of the coefficient matrix, we recover the Landweber…

Numerical Analysis · Mathematics 2020-07-09 Kui Du , Xiaohui Sun

In the past few years powerful generalizations to the Euclidean k-means problem have been made, such as Bregman clustering [7], co-clustering (i.e., simultaneous clustering of rows and columns of an input matrix) [9,18], and tensor…

Data Structures and Algorithms · Computer Science 2009-11-09 Stefanie Jegelka , Suvrit Sra , Arindam Banerjee