English
Related papers

Related papers: Neural network augmented inverse problems for PDEs

200 papers

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

Numerical Analysis · Mathematics 2020-06-09 Markus Haltmeier , Linh V. Nguyen

To quantify uncertainties in inverse problems of partial differential equations (PDEs), we formulate them into statistical inference problems using Bayes' formula. Recently, well-justified infinite-dimensional Bayesian analysis methods have…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Yanni Wu , Peijun Li , Deyu Meng

Adding noises to artificial neural network(ANN) has been shown to be able to improve robustness in previous work. In this work, we propose a new technique to compute the pathwise stochastic gradient estimate with respect to the standard…

Machine Learning · Computer Science 2021-02-10 Li Xiao , Zeliang Zhang , Yijie Peng

Artificial neural networks are algorithms which have been developed to tackle a range of computational problems. These range from modelling brain function to making predictions of time-dependent phenomena to solving hard (NP-complete)…

Astrophysics · Physics 2007-05-23 C. A. L. Bailer-Jones , R. Gupta , H. P. Singh

The primary issue in inverse halftoning is removing noisy dots on flat areas and restoring image structures (e.g., lines, patterns) on textured areas. Hence, a new structure-aware deep convolutional neural network that incorporates two…

Image and Video Processing · Electrical Eng. & Systems 2021-02-10 Chang-Hwan Son

Classical Physics-informed neural networks (PINNs) approximate solutions to PDEs with the help of deep neural networks trained to satisfy the differential operator and the relevant boundary conditions. We revisit this idea in the quantum…

Quantum Physics · Physics 2023-12-27 Josh Dees , Antoine Jacquier , Sylvain Laizet

Symbolic regression with polynomial neural networks and polynomial neural ordinary differential equations (ODEs) are two recent and powerful approaches for equation recovery of many science and engineering problems. However, these methods…

Machine Learning · Computer Science 2023-08-28 Colby Fronk , Jaewoong Yun , Prashant Singh , Linda Petzold

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

In contrast to conventional artificial neural networks, which are structurally static, we present two approaches for evolving small networks into larger ones during training. The first method employs an auxiliary weight that directly…

Machine Learning · Computer Science 2025-07-29 Anil Radhakrishnan , John F. Lindner , Scott T. Miller , Sudeshna Sinha , William L. Ditto

While neural networks have made significant strides in many AI tasks, they remain vulnerable to a range of noise types, including natural corruptions, adversarial noise, and low-resolution artifacts. Many existing approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Zhiling Zhou , Zirui Liu , Chengming Xu , Yanwei Fu , Xinwei Sun

Active learning methods for neural networks are usually based on greedy criteria which ultimately give a single new design point for the evaluation. Such an approach requires either some heuristics to sample a batch of design points at one…

Machine Learning · Computer Science 2020-01-28 Evgenii Tsymbalov , Sergei Makarychev , Alexander Shapeev , Maxim Panov

Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we…

Optimization and Control · Mathematics 2022-01-05 Maximilien Germain , Mathieu Laurière , Huyên Pham , Xavier Warin

All discretized numerical models contain modelling errors - this reality is amplified when reduced-order models are used. The ability to accurately approximate modelling errors informs statistics on model confidence and improves…

Computational Physics · Physics 2021-03-17 Danny Smyl , Tyler N. Tallman , Jonathan A. Black , Andreas Hauptmann , Dong Liu

Network weights can be reverse-engineered given enough informative samples of a network's input-output function. In a teacher-student setup, this translates into collecting a dataset of the teacher mapping -- querying the teacher -- and…

Artificial Intelligence · Computer Science 2025-11-26 Alexander Beiser , Flavio Martinelli , Wulfram Gerstner , Johanni Brea

The task of a neural associative memory is to retrieve a set of previously memorized patterns from their noisy versions using a network of neurons. An ideal network should have the ability to 1) learn a set of patterns as they arrive, 2)…

Neural and Evolutionary Computing · Computer Science 2014-07-25 Amin Karbasi , Amir Hesam Salavati , Amin Shokrollahi

Neural networks are usually not the tool of choice for nonparametric high-dimensional problems where the number of input features is much larger than the number of observations. Though neural networks can approximate complex multivariate…

Methodology · Statistics 2019-06-25 Jean Feng , Noah Simon

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

We propose a numerical method for solving high dimensional fully nonlinear partial differential equations (PDEs). Our algorithm estimates simultaneously by backward time induction the solution and its gradient by multi-layer neural…

Optimization and Control · Mathematics 2021-01-27 Huyen Pham , Xavier Warin , Maximilien Germain