English
Related papers

Related papers: Least-Squares Neural Network (LSNN) Method For Sca…

200 papers

A third-order weighted essentially non-oscillatory compact least-squares scheme is developed for the finite volume method on structured curvilinear non-uniform grids. The proposed scheme features compact least-squares reconstruction with…

Fluid Dynamics · Physics 2025-08-05 Jianhua Pana , Luxin Li , Wei-Gang Zeng

We present a neural network-based method for learning scalar hyperbolic conservation laws. Our method replaces the traditional numerical flux in finite volume schemes with a trainable neural network while preserving the conservative…

This paper proposes a novel algorithm for training recurrent neural network models of nonlinear dynamical systems from an input/output training dataset. Arbitrary convex and twice-differentiable loss functions and regularization terms are…

Machine Learning · Computer Science 2022-10-18 Alberto Bemporad

This study enhances the application of Physics-Informed Neural Networks (PINNs) for modeling discontinuous solutions in both hydrodynamics and relativistic hydrodynamics. Conventional PINNs, trained with partial differential equation…

Fluid Dynamics · Physics 2025-09-15 Jorge F. Urbán , José A. Pons

We propose a novel model reduction approach for the approximation of non linear hyperbolic equations in the scalar and the system cases. The approach relies on an offline computation of a dictionary of solutions together with an online…

Numerical Analysis · Mathematics 2015-06-23 Remi Abgrall , David Amsallem

In the case of hyperbolic conservation laws, high-order methods, such as the classical DG method, experience the phenomenon of unwanted high-frequency oscillations in the vicinity of a shock. Shock-capturing methods such as artificial…

Numerical Analysis · Mathematics 2025-11-04 Sai Shruthi Srinivasan , Siva Nadarajah

In this paper, a new Discontinuity Capturing Shallow Neural Network (DCSNN) for approximating $d$-dimensional piecewise continuous functions and for solving elliptic interface problems is developed. There are three novel features in the…

Numerical Analysis · Mathematics 2023-06-13 Wei-Fan Hu , Te-Sheng Lin , Ming-Chih Lai

In this paper, we propose a structure-guided Gauss-Newton (SgGN) method for solving least squares problems using a shallow ReLU neural network. The method effectively takes advantage of both the least squares structure and the neural…

Machine Learning · Computer Science 2025-07-22 Zhiqiang Cai , Tong Ding , Min Liu , Xinyu Liu , Jianlin Xia

This paper provides a least squares formulation for the training of a 2-layer convolutional neural network using quadratic activation functions, a 2-norm loss function, and no regularization term. Using this method, an analytic expression…

Machine Learning · Computer Science 2024-11-18 Zachary Yetman Van Egmond , Luis Rodrigues

Many computer vision problems (e.g., camera calibration, image alignment, structure from motion) are solved with nonlinear optimization methods. It is generally accepted that second order descent methods are the most robust, fast, and…

Computer Vision and Pattern Recognition · Computer Science 2014-05-06 Xuehan Xiong , Fernando De la Torre

We present a subspace method based on neural networks (SNN) for solving the partial differential equation with high accuracy. The basic idea of our method is to use some functions based on neural networks as base functions to span a…

Numerical Analysis · Mathematics 2024-04-15 Zhaodong Xu , Zhiqiang Sheng

For hyperbolic conservation laws, traditional methods and physics-informed neural networks (PINNs) often encounter difficulties in capturing sharp discontinuities and maintaining temporal consistency. To address these challenges, we…

Numerical Analysis · Mathematics 2025-08-25 Yan Shen , Jingrun Chen , Keke Wu

For a parameterized hyperbolic system $\frac{du}{dt}=f(u,s)$ the derivative of the ergodic average $\langle J \rangle = \lim_{T \to \infty}\frac{1}{T}\int_0^T J(u(t),s)$ to the parameter $s$ can be computed via the Least Squares Shadowing…

Dynamical Systems · Mathematics 2017-09-13 Mario Chater , Angxiu Ni , Patrick J. Blonigan , Qiqi Wang

In this paper, we put forward a neural network framework to solve the nonlinear hyperbolic systems. This framework, named relaxation neural networks(RelaxNN), is a simple and scalable extension of physics-informed neural networks(PINN). It…

Numerical Analysis · Mathematics 2024-04-02 Nan Zhou , Zheng Ma

We introduce a deep residual recurrent neural network (DR-RNN) as an efficient model reduction technique for nonlinear dynamical systems. The developed DR-RNN is inspired by the iterative steps of line search methods in finding the residual…

Computational Engineering, Finance, and Science · Computer Science 2017-09-05 J. Nagoor Kani , Ahmed H. Elsheikh

We propose a novel model reduction approach for the approximation of non linear hyperbolic equations in the scalar and the system cases. The approach relies on an offline computation of a dictionary of solutions together with an online…

Numerical Analysis · Mathematics 2016-03-09 Remi Abgrall , David Amsallem , Roxana Crisonovan

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

In this paper, we propose a sparse least squares (SLS) optimization model for solving multilinear equations, in which the sparsity constraint on the solutions can effectively reduce storage and computation costs. By employing variational…

Optimization and Control · Mathematics 2023-10-10 Xin Li , Ziyan Luo , Yang Chen

Recent research works for solving partial differential equations (PDEs) with deep neural networks (DNNs) have demonstrated that spatiotemporal function approximators defined by auto-differentiation are effective for approximating nonlinear…

Numerical Analysis · Mathematics 2021-09-21 Haoxiang Huang , Yingjie Liu , Vigor Yang

Physics-informed Neural Network (PINN) faces significant challenges when approximating solutions to conservation laws, particularly in ensuring conservation and accurately resolving discontinuities. To address these limitations, we propose…

Numerical Analysis · Mathematics 2025-09-10 Weiheng Zeng , Kun Wang , Ruoxi Lu , Tiegang Liu