English
Related papers

Related papers: Quadratic neural networks for solving inverse prob…

200 papers

One of the most common and universal problems in science is to investigate a function. The prediction can be made by an Artificial Neural Network (ANN) or a mathematical model. Both approaches have their advantages and disadvantages.…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Szymon Buchaniec , Marek Gnatowski , Grzegorz Brus

Convolutional neural networks (CNNs) have achieved breakthrough performances in a wide range of applications including image classification, semantic segmentation, and object detection. Previous research on characterizing the generalization…

Machine Learning · Statistics 2019-10-04 Shan Lin , Jingwei Zhang

Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Neural networks have succeeded in many reasoning tasks. Empirically, these tasks require specialized network structures, e.g., Graph Neural Networks (GNNs) perform well on many such tasks, but less structured networks fail. Theoretically,…

Machine Learning · Computer Science 2020-02-18 Keyulu Xu , Jingling Li , Mozhi Zhang , Simon S. Du , Ken-ichi Kawarabayashi , Stefanie Jegelka

We analyze the convergence and approximation error of the inverse Born series, obtaining results that hold under qualitatively weaker conditions than previously known. Our approach makes use of tools from geometric function theory in Banach…

Analysis of PDEs · Mathematics 2022-01-14 Jeremy G Hoskins , John C Schotland

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for…

Machine Learning · Statistics 2018-04-20 Maziar Raissi

Inverse problems are encountered in many domains of physics, with analytic continuation of the imaginary Green's function into the real frequency domain being a particularly important example. However, the analytic continuation problem is…

Computational Physics · Physics 2020-02-07 Romain Fournier , Lei Wang , Oleg V. Yazyev , QuanSheng Wu

Convex quadratically constrained quadratic programs (QCQPs) involve finding a solution within a convex feasible region defined by quadratic constraints while minimizing a convex quadratic objective function. These problems arise in various…

Optimization and Control · Mathematics 2025-11-25 Chenyang Wu , Qian Chen , Akang Wang , Tian Ding , Ruoyu Sun , Wenguo Yang , Qingjiang Shi

We provide new theoretical insights on why over-parametrization is effective in learning neural networks. For a $k$ hidden node shallow network with quadratic activation and $n$ training data points, we show as long as $ k \ge \sqrt{2n}$,…

Machine Learning · Computer Science 2018-06-18 Simon S. Du , Jason D. Lee

Operator learning offers a robust framework for approximating mappings between infinite-dimensional function spaces. It has also become a powerful tool for solving inverse problems in the computational sciences. This chapter surveys…

Numerical Analysis · Mathematics 2025-12-08 Nicholas H. Nelsen , Yunan Yang

Neural-net-induced Gaussian process (NNGP) regression inherits both the high expressivity of deep neural networks (deep NNs) as well as the uncertainty quantification property of Gaussian processes (GPs). We generalize the current NNGP to…

Machine Learning · Computer Science 2019-03-27 Guofei Pang , Liu Yang , George Em Karniadakis

In this paper we consider inverse problems that are mathematically ill-posed. That is, given some (noisy) data, there is more than one solution that approximately fits the data. In recent years, deep neural techniques that find the most…

Machine Learning · Computer Science 2023-08-28 Moshe Eliasof , Eldad Haber , Eran Treister

Neural networks have recently gained attention in solving inverse problems. One prominent methodology are Physics-Informed Neural Networks (PINNs) which can solve both forward and inverse problems. In the paper at hand, full waveform…

Numerical Analysis · Mathematics 2023-12-05 Leon Herrmann , Tim Bürchner , Felix Dietrich , Stefan Kollmannsberger

Inverse problems consist in reconstructing signals from incomplete sets of measurements and their performance is highly dependent on the quality of the prior knowledge encoded via regularization. While traditional approaches focus on…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Antonio Montanaro , Diego Valsesia , Enrico Magli

Due to the success of generative flows to model data distributions, they have been explored in inverse problems. Given a pre-trained generative flow, previous work proposed to minimize the 2-norm of the latent variables as a regularization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 José A. Chávez

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

Machine Learning · Statistics 2017-11-08 Randall Balestriero , Richard Baraniuk

Characterizing statistical properties of solutions of inverse problems is essential for decision making. Bayesian inversion offers a tractable framework for this purpose, but current approaches are computationally unfeasible for most…

Machine Learning · Statistics 2024-12-18 Jonas Adler , Ozan Öktem

In this paper, we use deep neural networks for inverting face sketches to synthesize photorealistic face images. We first construct a semi-simulated dataset containing a very large number of computer-generated face sketches with different…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Yağmur Güçlütürk , Umut Güçlü , Rob van Lier , Marcel A. J. van Gerven

Two dimensional (2D) peak finding is a common practice in data analysis for physics experiments, which is typically achieved by computing the local derivatives. However, this method is inherently unstable when the local landscape is…

Data Analysis, Statistics and Probability · Physics 2020-04-22 Han Peng , Xiang Gao , Yu He , Yiwei Li , Yuchen Ji , Chuhang Liu , Sandy A. Ekahana , Ding Pei , Zhongkai Liu , Zhixun Shen , Yulin Chen