English
Related papers

Related papers: Greedy randomized Bregman-Kaczmarz method for cons…

200 papers

In this paper, we introduce an iterative numerical method to solve systems of nonlinear equations. The third-order convergence of this method is analyzed. Several examples are given to illustrate the efficiency of the proposed method.

Dynamical Systems · Mathematics 2009-04-23 M. Eshaghi Gordji , A. Ebadian , M. B. Ghaemi , J. Shokri

Greedy Sampling Methods (GSMs) are widely used to construct approximate solutions of Configuration Optimization Problems (COPs), where a loss functional is minimized over finite configurations of points in a compact domain. While effective…

Optimization and Control · Mathematics 2026-01-09 Evie Nielen , Oliver Tse

Randomized regularized Kaczmarz algorithms have recently been proposed to solve tensor recovery models with {\it consistent} linear measurements. In this work, we propose a novel algorithm based on the randomized extended Kaczmarz algorithm…

Numerical Analysis · Mathematics 2021-12-17 Kui Du , Xiao-Hui Sun

We combine two iterative algorithms for solving large-scale systems of linear inequalities, the relaxation method of Agmon, Motzkin et al. and the randomized Kaczmarz method. In doing so, we obtain a family of algorithms that generalize and…

Optimization and Control · Mathematics 2019-06-05 Jesus De Loera , Jamie Haddock , Deanna Needell

Recently proposed adaptive Sketch & Project (SP) methods connect several well-known projection methods such as Randomized Kaczmarz (RK), Randomized Block Kaczmarz (RBK), Motzkin Relaxation (MR), Randomized Coordinate Descent (RCD), Capped…

Numerical Analysis · Mathematics 2020-12-25 Md Sarowar Morshed , Sabbir Ahmad , Md Noor-E-Alam

Randomized iterative algorithms have recently been proposed to solve large-scale linear systems. In this paper, we present a simple randomized extended block Kaczmarz algorithm that exponentially converges in the mean square to the unique…

Numerical Analysis · Mathematics 2020-07-09 Kui Du , Wutao Si , Xiaohui Sun

With the growth of large data as well as large-scale learning tasks, the need for efficient and robust linear system solvers is greater than ever. The randomized Kaczmarz method (RK) and similar stochastic iterative methods have received…

Numerical Analysis · Mathematics 2023-01-04 Lu Cheng , Benjamin Jarman , Deanna Needell , Elizaveta Rebrova

We revisit the problem of inferring the overall ranking among entities in the framework of Bradley-Terry-Luce (BTL) model, based on available empirical data on pairwise preferences. By a simple transformation, we can cast the problem as…

Machine Learning · Computer Science 2016-05-10 Vivek S. Borkar , Nikhil Karamchandani , Sharad Mirani

Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some…

Numerical Analysis · Mathematics 2018-07-26 Gabriele Santin , Dominik Wittwar , Bernard Haasdonk

The Kaczmarz method is a way to iteratively solve a linear system of equations $Ax = b$. One interprets the solution $x$ as the point where hyperplanes intersect and then iteratively projects an approximate solution onto these hyperplanes…

Numerical Analysis · Mathematics 2024-11-12 Stefan Steinerberger

The randomized Kaczmarz algorithm has received considerable attention recently because of its simplicity, speed, and the ability to approximately solve large-scale linear systems of equations. In this paper we propose randomized double and…

Numerical Analysis · Mathematics 2020-10-28 Kui Du , Xiao-Hui Sun

The realisation of sensing modalities based on the principles of compressed sensing is often hindered by discrepancies between the mathematical model of its sensing operator, which is necessary during signal recovery, and its actual…

Information Theory · Computer Science 2018-02-21 Valerio Cambareri , Amirafshar Moshtaghpour , Laurent Jacques

We develop two greedy sampling rules for the Sketch & Project method for solving linear feasibility problems. The proposed greedy sampling rules generalize the existing max-distance sampling rule and uniform sampling rule and generate…

Numerical Analysis · Mathematics 2020-12-08 Md Sarowar Morshed , Md. Noor-E-Alam

This paper investigates the randomized version of the Kaczmarz method to solve linear systems in the case where the adjoint of the system matrix is not exact---a situation we refer to as "mismatched adjoint". We show that the method may…

Numerical Analysis · Mathematics 2018-03-09 Dirk A. Lorenz , Sean Rose , Frank Schöpfer

In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying…

Machine Learning · Computer Science 2012-02-28 Christopher C. Johnson , Ali Jalali , Pradeep Ravikumar

In this paper, we propose a globally convergent method for solving constrained nonlinear systems. The method combines an efficient Newton conditional gradient method with a derivative-free and nonmonotone linesearch strategy. The global…

Optimization and Control · Mathematics 2018-06-06 M. L. N. Gonçalves , F. R. Oliveira

Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling…

Dynamical Systems · Mathematics 2024-05-15 Ali Forootani , Harshit Kapadia , Sridhar Chellappa , Pawan Goyal , Peter Benner

This paper is a follow up to the previous author's paper on convex optimization. In that paper we began the process of adjusting greedy-type algorithms from nonlinear approximation for finding sparse solutions of convex optimization…

Machine Learning · Statistics 2012-06-05 V. N. Temlyakov

We study efficient simulation of steady state for rarefied gas flow, which is modeled by the Boltzmann equation with BGK-type collision term. A nonlinear multigrid solver is proposed to resolve the efficiency issue by the following…

Numerical Analysis · Mathematics 2022-06-28 Zhicheng Hu , Guanghan Li

In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Andrew Eberhard , Nargiz Sultanova