English
Related papers

Related papers: Stein-based preconditioners for weak-constraint 4D…

200 papers

We carry out a rigorous analysis of four-dimensional variational data assimilation ($4D$-VAR) problems for linear and semilinear parabolic partial differential equations. Continuity of the state with respect to the spatial variable is…

Optimization and Control · Mathematics 2025-05-30 Paula Castro , Juan Carlos De los Reyes , Ira Neitzel

Continuous data assimilation addresses time-dependent problems with unknown initial conditions by incorporating observations of the solution into a nudging term. For the prototypical heat equation with variable conductivity and the Neumann…

Numerical Analysis · Mathematics 2025-04-01 Vladimir Yushutin

There has been a growing interest in parallel strategies for solving trajectory optimization problems. One key step in many algorithmic approaches to trajectory optimization is the solution of moderately-large and sparse linear systems.…

Optimization and Control · Mathematics 2024-03-05 Xueyi Bu , Brian Plancher

Many particle-based Bayesian inference methods use a single global step size for all parts of the update. In Stein variational gradient descent (SVGD), however, each update combines two qualitatively different effects: attraction toward…

Machine Learning · Computer Science 2026-04-07 Arash Sarshar

Power electronic devices such as HVDC and FACTS can be used to improve the damping of poorly damped inter-area modes in large power systems. This involves the use of wide-area feedback signals, which are transmitted via communication…

Systems and Control · Electrical Eng. & Systems 2022-11-17 K. K. Gajjar , Kaustav Dey , A. M. Kulkarni

Many important challenges in science and technology can be cast as optimization problems. When viewed in a statistical physics framework, these can be tackled by simulated annealing, where a gradual cooling procedure helps search for…

Disordered Systems and Neural Networks · Physics 2024-01-17 Mohamed Hibat-Allah , Estelle M. Inack , Roeland Wiersema , Roger G. Melko , Juan Carrasquilla

Numerical solution of discrete PDEs corresponding to saddle point problems is highly relevant to physical systems such as Stokes flow. However, scaling up numerical solvers for such systems is often met with challenges in efficiency and…

Numerical Analysis · Mathematics 2024-08-23 Yutian Tao , Eftychios Sifakis

We present a data-driven approach to efficiently approximate nonlinear transient dynamics in solid-state systems. Our proposed machine-learning model combines a dimensionality reduction stage with a nonlinear vector autoregression scheme.…

Computational Physics · Physics 2024-02-22 Stefan Meinecke , Felix Köster , Dominik Christiansen , Kathy Lüdge , Andreas Knorr , Malte Selig

This paper considers the multi-agent linear least-squares problem in a server-agent network. In this problem, the system comprises multiple agents, each having a set of local data points, that are connected to a server. The goal for the…

Optimization and Control · Mathematics 2024-10-29 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integration of deep…

Machine Learning · Computer Science 2023-10-26 Sibo Cheng , Che Liu , Yike Guo , Rossella Arcucci

A modification of the generalized shift-splitting (GSS) method is presented for solving singular saddle point problems. In this kind of modification, the diagonal shift matrix is replaced by a block diagonal matrix which is symmetric…

Numerical Analysis · Mathematics 2017-04-26 Davod Khojasteh Salkuyeh , Maryam Rahimian

This paper presents fast solvers for linear systems arising from the discretization of fractional nonlinear Schr\"odinger equations with Riesz derivatives and attractive nonlinearities. These systems are characterized by complex symmetry,…

Numerical Analysis · Mathematics 2024-10-07 Chao Chen , Xi Yang , Fei-Yan Zhang

We propose $\textsf{ScaledGD($\lambda$)}$, a preconditioned gradient descent method to tackle the low-rank matrix sensing problem when the true rank is unknown, and when the matrix is possibly ill-conditioned. Using overparametrized factor…

Machine Learning · Computer Science 2026-01-01 Xingyu Xu , Yandi Shen , Yuejie Chi , Cong Ma

We present a new class of preconditioned iterative methods for solving linear systems of the form $Ax = b$. Our methods are based on constructing a low-rank Nystr\"om approximation to $A$ using sparse random matrix sketching. This…

Data Structures and Algorithms · Computer Science 2025-04-14 Michał Dereziński , Christopher Musco , Jiaming Yang

We present a simple way to discretize and precondition mixed variational formulations. Our theory connects with, and takes advantage of, the classical theory of symmetric saddle point problems and the theory of preconditioning symmetric…

Numerical Analysis · Mathematics 2018-05-18 Constantin Bacuta , Jacob Jacavage

This paper presents the first results to combine two theoretically sound methods (spectral projection and multigrid methods) together to attack ill-conditioned linear systems. Our preliminary results show that the proposed algorithm applied…

Numerical Analysis · Mathematics 2016-02-18 Craig C. Douglas , Long Lee , Man-Chung Yeung

Atomic-scale materials synthesis via layer deposition techniques present a unique opportunity to control material structures and yield systems that display unique functional properties that cannot be stabilized using traditional bulk…

Computational Physics · Physics 2020-06-30 Siyan Liu , Nikolay Borodinov , Lukas Vlcek , Dan Lu , Nouamane Laanait , Rama K. Vasudevan

In solid mechanics, Data-driven approaches are widely considered as the new paradigm that can overcome the classic problems of constitutive models such as limiting hypothesis, complexity, and high dependence on training data. However,…

Soft Condensed Matter · Physics 2020-11-23 Aref Ghaderi , Vahid Morovati , Roozbeh Dargazany

A preconditioning strategy is proposed for the iterative solve of large numbers of linear systems with parameter-dependent matrix and right-hand side which arise during the computation of solution statistics of stochastic elliptic partial…

Numerical Analysis · Mathematics 2025-06-24 Nicolas Venkovic , Paul Mycek , Olivier Le Maître

Least squares method is one of the simplest and most popular techniques applied in data fitting, imaging processing and high dimension data analysis. The classic methods like QR and SVD decomposition for solving least squares problems has a…

Numerical Analysis · Mathematics 2018-06-11 Long Chen , Huiwen Wu