English
Related papers

Related papers: First Order System Least Squares Neural Networks

200 papers

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

In this paper, we study the problem of finding the least square solutions of over-determined linear algebraic equations over networks in a distributed manner. Each node has access to one of the linear equations and holds a dynamic state. We…

Optimization and Control · Mathematics 2019-09-10 Tao Yang , Jemin George , Jiahu Qin , Xinlei Yi , Junfeng Wu

Historically, analysis for multiscale PDEs is largely unified while numerical schemes tend to be equation-specific. In this paper, we propose a unified framework for computing multiscale problems through random sampling. This is achieved by…

Numerical Analysis · Mathematics 2022-03-09 Ke Chen , Shi Chen , Qin Li , Jianfeng Lu , Stephen J. Wright

Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored…

Machine Learning · Computer Science 2023-05-30 Haixu Wu , Tengge Hu , Huakun Luo , Jianmin Wang , Mingsheng Long

Finding parameters in a deep neural network (NN) that fit training data is a nonconvex optimization problem, but a basic first-order optimization method (gradient descent) finds a global optimizer with perfect fit (zero-loss) in many…

Machine Learning · Computer Science 2025-03-07 Zhiyan Ding , Shi Chen , Qin Li , Stephen Wright

The Zarantonello fixed-point iteration is an established linearization scheme for quasilinear PDEs with strongly monotone and Lipschitz continuous nonlinearity in Hilbert spaces. This paper presents a weighted least-squares minimization for…

Numerical Analysis · Mathematics 2026-02-24 Philipp Bringmann , Dirk Praetorius

In many recent applications when new materials and technologies are developed it is important to describe and simulate new nonlinear and nonlocal diffusion transport processes. A general class of such models deals with nonlocal fractional…

Numerical Analysis · Mathematics 2024-12-20 Raimondas Ciegis , Petr Vabishchevich

We study (constrained) least-squares regression as well as multiple response least-squares regression and ask the question of whether a subset of the data, a coreset, suffices to compute a good approximate solution to the regression. We…

Data Structures and Algorithms · Computer Science 2016-11-18 Christos Boutsidis , Petros Drineas , Malik Magdon-Ismail

A new approximation format for solutions of partial differential equations depending on infinitely many parameters is introduced. By combining low-rank tensor approximation in a selected subset of variables with a sparse polynomial…

Numerical Analysis · Mathematics 2025-06-25 Markus Bachmayr , Huqing Yang

We introduce Neural Parameter Regression (NPR), a novel framework specifically developed for learning solution operators in Partial Differential Equations (PDEs). Tailored for operator learning, this approach surpasses traditional DeepONets…

Machine Learning · Computer Science 2024-03-20 Konrad Mundinger , Max Zimmer , Sebastian Pokutta

In this paper, we propose a model reduction method for solving multiscale elliptic PDEs with random coefficients in the multiquery setting using an optimization approach. The optimization approach enables us to construct a set of localized…

Numerical Analysis · Mathematics 2018-07-09 Thomas Y. Hou , Dingjiong Ma , Zhiwen Zhang

In this paper, we propose a novel shape optimization approach for the source identification of elliptic equations. This identification problem arises from two application backgrounds: actuator placement in PDE-constrained optimal controls…

Optimization and Control · Mathematics 2024-07-04 Wei Gong , Ziyi Zhang

Partial differential equations (PDEs) are crucial for modeling various physical phenomena such as heat transfer, fluid flow, and electromagnetic waves. In computer-aided engineering (CAE), the ability to handle fine resolutions and large…

Quantum Physics · Physics 2025-01-31 Yuki Sato , Hiroyuki Tezuka , Ruho Kondo , Naoki Yamamoto

Motivated by a growing list of nontraditional statistical estimation problems of the piecewise kind, this paper provides a survey of known results supplemented with new results for the class of piecewise linear-quadratic programs. These are…

Optimization and Control · Mathematics 2018-08-16 Ying Cui , Tsung-Hui Chang , Mingyi Hong , Jong-Shi Pang

This paper investigates some theoretical properties of the Partial Least Square (PLS) method. We focus our attention on the single component case, that provides a useful framework to understand the underlying mechanism. We provide a…

Statistics Theory · Mathematics 2023-10-17 Luca Castelli , Clément Marteau , Irène Gannaz

We present FastLSQ, a framework for PDE solving and inverse problems built on trigonometric random Fourier features with exact analytical derivatives. Trigonometric features admit closed-form derivatives of any order in $\mathcal{O}(1)$,…

Numerical Analysis · Mathematics 2026-03-24 Antonin Sulc

Partial Least Square (PLS) is a dimension reduction method used to remove multicollinearities in a regression model. However contrary to Principal Components Analysis (PCA) the PLS components are also choosen to be optimal for predicting…

Statistics Theory · Mathematics 2014-05-26 Mélanie Blazère , Fabrice Gamboa , Jean-Michel Loubes

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

In this work, we propose a novel discrete-time distributed algorithm for finding least-squares solutions of linear algebraic equations with a scheduling protocol to further enhance its scalability. Each agent in the network is assumed to…

Systems and Control · Electrical Eng. & Systems 2025-10-24 Shenyu Liu

This paper develops a first-order system least-squares (FOSLS) formulation for equations of two-phase flow. The main goal is to show that this discretization, along with numerical techniques such as nested iteration, algebraic multigrid,…

Numerical Analysis · Mathematics 2012-06-01 J. H. Adler , J. Brannick , C. Liu , T. Manteuffel , L. Zikatanov