中文
相关论文

相关论文: Stochastic Preconditioning for Iterative Linear Eq…

200 篇论文

Low-rank matrix estimation is a canonical problem that finds numerous applications in signal processing, machine learning and imaging science. A popular approach in practice is to factorize the matrix into two compact low-rank factors, and…

机器学习 · 计算机科学 2021-06-16 Tian Tong , Cong Ma , Yuejie Chi

Incomplete factorizations have long been popular general-purpose algebraic preconditioners for solving large sparse linear systems of equations. Guaranteeing the factorization is breakdown free while computing a high quality preconditioner…

数值分析 · 数学 2025-02-04 Jennifer Scott , Miroslav Tůma

To precondition a large and sparse linear system, two direct methods for approximate factoring of the inverse are devised. The algorithms are fully parallelizable and appear to be more robust than the iterative methods suggested for the…

数值分析 · 数学 2012-08-20 Mikko Byckling , Marko Huhtanen

Motivated by the desire to understand stochastic algorithms for nonconvex optimization that are robust to their hyperparameter choices, we analyze a mini-batched prox-linear iterative algorithm for the problem of recovering an unknown…

最优化与控制 · 数学 2024-02-05 Mengqi Lou , Kabir Aladin Verchand , Ashwin Pananjady

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

数值分析 · 数学 2021-04-15 Jonathan Lacotte , Mert Pilanci

We present a successive constraint approach that makes it possible to cheaply solve large-scale linear matrix inequalities for a large number of parameter values. The efficiency of our method is made possible by an offline/online…

数值分析 · 数学 2017-08-08 Robert O'Connor

We present an iterative method to diagonalise large matrices. The basic idea is the same as the conjugated gradient (CG) method, i.e, minimizing the Rayleigh quotient via its gradient and avoiding reintroduce errors to the directions of…

计算物理 · 物理学 2009-11-10 Quanlin Jie , Dunhuan Liu

This paper introduces a new preconditioning technique that is suitable for matrices arising from the discretization of a system of PDEs on unstructured grids. The preconditioner satisfies a so-called filtering property, which ensures that…

数值分析 · 计算机科学 2011-03-17 Laura Grigori , Frédéric Nataf

The convergence rates of iterative methods for solving a linear system $\mathbf{A} x = b$ typically depend on the condition number of the matrix $\mathbf{A}$. Preconditioning is a common way of speeding up these methods by reducing that…

最优化与控制 · 数学 2021-11-04 Arun Jambulapati , Jerry Li , Christopher Musco , Aaron Sidford , Kevin Tian

Spatially distributed problems are often approximately modelled in terms of partial differential equations (PDEs) for appropriate coarse-grained quantities (e.g. concentrations). The derivation of accurate such PDEs starting from finer…

定量方法 · 定量生物学 2009-11-13 Liang Qiao , Radek Erban , C. T. Kelley , Ioannis G. Kevrekidis

We apply preconditioning, which is widely used in classical solvers for linear systems $A\textbf{x}=\textbf{b}$, to the variational quantum linear solver. By utilizing incomplete LU factorization as a preconditioner for linear equations…

We consider iterative methods for solving the linearised Navier-Stokes equations arising from two-phase flow problems and the efficient preconditioning of such systems when using mixed finite element methods. Our target application is…

数值分析 · 数学 2020-05-18 Niall Bootland , Alistair Bentley , Christopher Kees , Andrew Wathen

We study first-order methods with preconditioning for solving structured nonlinear convex optimization problems. We propose a new family of preconditioners generated by symmetric polynomials. They provide first-order optimization methods…

最优化与控制 · 数学 2023-01-31 Nikita Doikov , Anton Rodomanov

Matrix factorization techniques have been widely used as a method for collaborative filtering for recommender systems. In recent times, different variants of deep learning algorithms have been explored in this setting to improve the task of…

机器学习 · 计算机科学 2019-03-26 Vaibhav Krishna , Tian Guo , Nino Antulov-Fantulin

The efficient solution of moderately large-scale linear systems arising from the KKT conditions in optimal control problems (OCPs) is a critical challenge in robotics. With the stagnation of Moore's law, there is growing interest in…

最优化与控制 · 数学 2025-05-21 Shaohui Yang , Toshiyuki Ohtsuka , Brian Plancher , Colin N. Jones

We introduce a preconditioner based on a hierarchical low-rank compression scheme of Schur complements. The construction is inspired by standard nested dissection, and relies on the assumption that the Schur complements can be approximated,…

数值分析 · 数学 2015-09-01 Paolo Gatto , Jan S. Hesthaven

Preconditioning is a technique from numerical linear algebra that can accelerate algorithms to solve systems of equations. In this paper, we demonstrate how preconditioning can circumvent a stringent assumption for sign consistency in…

统计理论 · 数学 2012-08-29 Jinzhu Jia , Karl Rohe

We introduce a parallel algorithm to construct a preconditioner for solving a large, sparse linear system where the coefficient matrix is a Laplacian matrix (a.k.a., graph Laplacian). Such a linear system arises from applications such as…

分布式、并行与集群计算 · 计算机科学 2025-05-30 Tianyu Liang , Chao Chen , Yotam Yaniv , Hengrui Luo , David Tench , Xiaoye S. Li , Aydin Buluc , James Demmel

The solution of systems of linear(ized) equations lies at the heart of many problems in Scientific Computing. In particular for systems of large dimension, iterative methods are a primary approach. Stationary iterative methods are generally…

数值分析 · 数学 2025-04-08 Andy Wathen

There has been substantial progress in the inference of formal behavioural specifications from sample trajectories, for example, using Linear Temporal Logic (LTL). However, these techniques cannot handle specifications that correctly…

计算机科学中的逻辑 · 计算机科学 2025-05-20 Rajarshi Roy , Yash Pote , David Parker , Marta Kwiatkowska