English
Related papers

Related papers: Neural Network-Based Parameter Estimation for Non-…

200 papers

Real-world systems are often formulated as constrained optimization problems. Techniques to incorporate constraints into Neural Networks (NN), such as Neural Ordinary Differential Equations (Neural ODEs), have been used. However, these…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

This paper introduces a tensor neural network (TNN) to address nonparametric regression problems, leveraging its distinct sub-network structure to effectively facilitate variable separation and enhance the approximation of complex,…

Machine Learning · Statistics 2024-09-16 Yongxin Li , Yifan Wang , Zhongshuo Lin , Hehu Xie

We propose a numerical method for solving high dimensional fully nonlinear partial differential equations (PDEs). Our algorithm estimates simultaneously by backward time induction the solution and its gradient by multi-layer neural…

Optimization and Control · Mathematics 2021-01-27 Huyen Pham , Xavier Warin , Maximilien Germain

We develop a framework for estimating unknown partial differential equations from noisy data, using a deep learning approach. Given noisy samples of a solution to an unknown PDE, our method interpolates the samples using a neural network,…

Machine Learning · Computer Science 2019-10-24 Ali Hasan , João M. Pereira , Robert Ravier , Sina Farsiu , Vahid Tarokh

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its…

Machine Learning · Computer Science 2022-12-08 Halima Bouzidi , Mohanad Odema , Hamza Ouarnoughi , Mohammad Abdullah Al Faruque , Smail Niar

A neural network is essentially a high-dimensional complex mapping model by adjusting network weights for feature fitting. However, the spectral bias in network training leads to unbearable training epochs for fitting the high-frequency…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Zhi Zeng , Pengpeng Shi , Fulei Ma , Peihan Qi

In many signal processing applications, including communications, sonar, radar, and localization, a fundamental problem is the detection of a signal of interest in background noise, known as signal detection [1] [2]. A simple version of…

Signal Processing · Electrical Eng. & Systems 2025-12-16 Tom Anders , Hiten Prakash Kothari , R. Michael Buehrer

To solve high-dimensional parameter-dependent partial differential equations (pPDEs), a neural network architecture is presented. It is constructed to map parameters of the model data to corresponding finite element solutions. To improve…

Numerical Analysis · Mathematics 2024-03-20 Janina E. Schütte , Martin Eigel

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

We present a nonlinear dynamical approximation method for time-dependent Partial Differential Equations (PDEs). The approach makes use of parametrized decoder functions, and provides a general, and principled way of understanding and…

Numerical Analysis · Mathematics 2025-05-20 Daan Bon , Benjamin Caris , Olga Mula

In this article, we introduce and analyze a deep learning based approximation algorithm for SPDEs. Our approach employs neural networks to approximate the solutions of SPDEs along given realizations of the driving noise process. If applied…

Numerical Analysis · Mathematics 2025-10-21 Christian Beck , Sebastian Becker , Patrick Cheridito , Arnulf Jentzen , Ariel Neufeld

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

In this paper, we consider approximating the parameter-to-solution maps of parametric partial differential equations (PPDEs) using deep neural networks (DNNs). We propose an efficient approach combining reduced collocation methods (RCMs)…

Numerical Analysis · Mathematics 2025-08-18 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng

We investigate the potential of applying (D)NN ((deep) neural networks) for approximating nonlinear mappings arising in the finite element discretization of nonlinear PDEs (partial differential equations). As an application, we apply the…

Numerical Analysis · Mathematics 2019-11-14 Tuyen Tran , Aidan Hamilton , Maricela Best McKay , Benjamin Quiring , Panayot S. Vassilevski

We introduce and analyze a method of learning-informed parameter identification for partial differential equations (PDEs) in an all-at-once framework. The underlying PDE model is formulated in a rather general setting with three unknowns:…

Optimization and Control · Mathematics 2023-08-25 Christian Aarset , Martin Holler , Tram Thi Ngoc Nguyen

We propose a novel deep neural network (DNN) based approximation architecture to learn estimates of measurements. We detail an algorithm that enables training of the DNN. The DNN estimator only uses measurements, if and when they are…

Machine Learning · Computer Science 2022-09-13 Shivangi Agarwal , Sanjit K. Kaul , Saket Anand , P. B. Sujit

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

Neural simulation-based inference is a powerful class of machine-learning-based methods for statistical inference that naturally handles high-dimensional parameter estimation without the need to bin data into low-dimensional summary…

Data Analysis, Statistics and Probability · Physics 2025-06-16 ATLAS Collaboration