English
Related papers

Related papers: Error Control of Iterative Linear Solvers for Inte…

200 papers

We propose fast O(N) preconditioning, where N is the number of gridpoints on the prediction horizon, for iterative solution of (non)-linear systems appearing in model predictive control methods such as forward-difference Newton-Krylov…

Optimization and Control · Mathematics 2016-10-20 Andrew Knyazev , Alexander Malyshev

Machine learning (ML) training algorithms often possess an inherent self-correcting behavior due to their iterative-convergent nature. Recent systems exploit this property to achieve adaptability and efficiency in unreliable computing…

Machine Learning · Computer Science 2018-10-18 Aurick Qiao , Bryon Aragam , Bingjing Zhang , Eric P. Xing

This manuscript presents a new extended linear system for integral equation based techniques for solving boundary value problems on locally perturbed geometries. The new extended linear system is similar to a previously presented technique…

Numerical Analysis · Mathematics 2021-03-17 Yabin Zhang , Adrianna Gillman

The treatment of the differential PDE constraint poses a key challenge in computing the numerical solution of the Serre-Green-Naghdi (SGN) equations. In this work, we introduce a constant coefficient preconditioner for the SGN constraint…

Numerical Analysis · Mathematics 2025-06-23 Linwan Feng , David Shirokoff , Wooyoung Choi

While recent work on conjugate gradient methods and Lanczos decompositions have achieved scalable Gaussian process inference with highly accurate point predictions, in several implementations these iterative methods appear to struggle with…

Machine Learning · Computer Science 2022-01-03 Wesley J. Maddox , Sanyam Kapoor , Andrew Gordon Wilson

In this paper we develop two goal-oriented adaptive strategies for a posteriori error estimation within the generalized multiscale finite element framework. In this methodology, one seeks to determine the number of multiscale basis…

Numerical Analysis · Mathematics 2015-09-21 Eric T. Chung , Wing Tat Leung , Sara Pollock

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

In this paper, we study fast iterative solvers for the solution of fourth order parabolic equations discretized by mixed finite element methods. We propose to use consistent mass matrix in the discretization and use lumped mass matrix to…

Numerical Analysis · Mathematics 2016-02-26 Bin Zheng , Luoping Chen , Xiaozhe Hu , Long Chen , Ricardo H. Nochetto , Jinchao Xu

A mathematical model for the charging simulation of non-insulated superconducting pancake solenoids is presented. Numerical solutions are obtained by the simulation model implemented on the Petra-M FEM platform using a variety of solvers. A…

Computational Physics · Physics 2020-07-31 M. Mohebujjaman , S. Shiraiwa , B. LaBombard , J. C. Wright , K. Uppalapati

We revisit the sequential variants of linear regression with the squared loss, classification problems with hinge loss, and logistic regression, all characterized by unbounded losses in the setup where no assumptions are made on the…

Machine Learning · Statistics 2025-09-08 Jian Qian , Alexander Rakhlin , Nikita Zhivotovskiy

The discovery of first integrals is of fundamental scientific importance for understanding conservation laws in dynamical systems. However, existing symbolic computation tools and Large Language Models (LLMs) remain limited on this task…

Machine Learning · Computer Science 2026-05-21 Jingfeng Zhong , Zhengxiang Liu , Zhijie Wang , Shuai Li

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods have explored the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ashwini Pokle , Matthew J. Muckley , Ricky T. Q. Chen , Brian Karrer

Inverse design problems are common in engineering and materials science. The forward direction, i.e., computing output quantities from design parameters, typically requires running a numerical simulation, such as a FEM, as an intermediate…

Machine Learning · Computer Science 2026-02-18 Jens U. Kreber , Christian Weißenfels , Joerg Stueckler

We describe a parallel iterative least squares solver named \texttt{LSRN} that is based on random normal projection. \texttt{LSRN} computes the min-length solution to $\min_{x \in \mathbb{R}^n} \|A x - b\|_2$, where $A \in \mathbb{R}^{m…

Data Structures and Algorithms · Computer Science 2012-02-21 Xiangrui Meng , Michael A. Saunders , Michael W. Mahoney

In this paper, we propose a local-global multiscale method for highly heterogeneous stochastic groundwater flow problems under the framework of reduced basis method and the generalized multiscale finite element method (GMsFEM). Due to…

Numerical Analysis · Mathematics 2022-03-02 Yiran Wang , Eric Chung , Shubin Fu

Model predictive control is a powerful framework for enabling optimal control of constrained systems. However, for systems that are described by high-dimensional state spaces this framework can be too computationally demanding for real-time…

Systems and Control · Electrical Eng. & Systems 2020-08-24 Joseph Lorenzetti , Marco Pavone

Systems governed by partial differential equations (PDEs) require computationally intensive numerical solvers to predict spatiotemporal field evolution. While machine learning (ML) surrogates offer faster solutions, autoregressive inference…

Machine Learning · Computer Science 2025-07-08 Ishan Khurjekar , Indrashish Saha , Lori Graham-Brady , Somdatta Goswami

Forward regression is a crucial methodology for automatically identifying important predictors from a large pool of potential covariates. In contexts with moderate predictor correlation, forward selection techniques can achieve screening…

Methodology · Statistics 2024-08-23 Xuejun Jiang , Yue Ma , Haofeng Wang

Finite element discretization of Stokes problems can result in singular, inconsistent saddle point linear algebraic systems. This inconsistency can cause many iterative methods to fail to converge. In this work, we consider the lowest-order…

Numerical Analysis · Mathematics 2024-12-16 Weizhang Huang , Zhuoran Wang

We study Model Predictive Control (MPC) and propose a general analysis pipeline to bound its dynamic regret. The pipeline first requires deriving a perturbation bound for a finite-time optimal control problem. Then, the perturbation bound…

Optimization and Control · Mathematics 2022-10-25 Yiheng Lin , Yang Hu , Guannan Qu , Tongxin Li , Adam Wierman