English
Related papers

Related papers: Quadratic neural networks for solving inverse prob…

200 papers

We introduce a novel framework for solving inverse problems using NeRF-style generative models. We are interested in the problem of 3-D scene reconstruction given a single 2-D image and known camera parameters. We show that naively…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Giannis Daras , Wen-Sheng Chu , Abhishek Kumar , Dmitry Lagun , Alexandros G. Dimakis

Recent efforts on solving inverse problems in imaging via deep neural networks use architectures inspired by a fixed number of iterations of an optimization method. The number of iterations is typically quite small due to difficulties in…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Davis Gilton , Gregory Ongie , Rebecca Willett

We develop a weak adversarial approach to solving obstacle problems using neural networks. By employing (generalised) regularised gap functions and their properties we rewrite the obstacle problem (which is an elliptic variational…

Optimization and Control · Mathematics 2024-11-28 Amal Alphonse , Michael Hintermüller , Alexander Kister , Chin Hang Lun , Clemens Sirotenko

With the recent success of deep neural networks in computer vision, it is important to understand the internal working of these networks. What does a given neuron represent? The concepts captured by a neuron may be hard to understand or…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Suryabhan Singh Hada , Miguel Á. Carreira-Perpiñán

Deep neural networks have achieved substantial success across various scientific computing tasks. A pivotal challenge within this domain is the rapid and parallel approximation of matrix inverses, critical for numerous applications. Despite…

Machine Learning · Computer Science 2025-06-03 Yuliang Ji , Jian Wu , Yuanzhe Xi

In many physical systems, inputs related by intrinsic system symmetries are mapped to the same output. When inverting such systems, i.e., solving the associated inverse problems, there is no unique solution. This causes fundamental…

Machine Learning · Computer Science 2020-03-23 Kshitij Tayal , Chieh-Hsin Lai , Vipin Kumar , Ju Sun

Deep learning has been proven to yield reliably generalizable answers to numerous classification and decision tasks. Here, we demonstrate for the first time, to our knowledge, that deep neural networks (DNNs) can be trained to solve inverse…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Ayan Sinha , Justin Lee , Shuai Li , George Barbastathis

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Phase-field models have been widely used to investigate the phase transformation phenomena. However, it is difficult to solve the problems numerically due to their strong nonlinearities and higher-order terms. This work is devoted to…

Numerical Analysis · Mathematics 2024-07-23 Gang Bao , Chang Ma , Yuxuan Gong

Neural networks have a reputation for being better at solving statistical or approximate problems than at performing calculations or working with symbolic data. In this paper, we show that they can be surprisingly good at more elaborated…

Symbolic Computation · Computer Science 2019-12-04 Guillaume Lample , François Charton

The majority of machine learning methods can be regarded as the minimization of an unavailable risk function. To optimize the latter, given samples provided in a streaming fashion, we define a general stochastic Newton algorithm and its…

Statistics Theory · Mathematics 2023-06-30 Claire Boyer , Antoine Godichon-Baggioni

This paper considers one of the fundamental parallel-in-time methods for the solution of ordinary differential equations, Parareal, and extends it by adopting a neural network as a coarse propagator. We provide a theoretical analysis of the…

Numerical Analysis · Mathematics 2024-08-20 Marta M. Betcke , Lisa Maria Kreusser , Davide Murari

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

Supervised convolutional neural networks (CNNs) are widely used to solve imaging inverse problems, achieving state-of-the-art performance in numerous applications. However, despite their empirical success, these methods are poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Minh Hai Nguyen , Quoc Bao Do , Edouard Pauwels , Pierre Weiss

We study the existence and uniqueness of solutions to the inverse quasi-variational inequality problem. Motivated by the neural network approach to solving optimization problems such as variational inequality, monotone inclusion, and…

Optimization and Control · Mathematics 2022-04-13 Soumitra Dey , Simeon Reich

Pan-sharpening algorithms utilize a panchromatic image and a multispectral image to generate a high spatial and high spectral image. However, the optimizations of the algorithms are designed with different standards. We employ a simple…

Machine Learning · Computer Science 2025-07-17 Shiqi Liu , Yihua Tan , Yutong Bai , Alan Yuille

The distinctive architectural features of normalizing flows (NFs), notably bijectivity and tractable Jacobians, make them well-suited for generative modeling. Invertible neural networks (INNs) build on these principles to address supervised…

Machine Learning · Computer Science 2026-02-25 Shubhanshu Shekhar , Mohammad Javad Khojasteh , Ananya Acharya , Tony Tohme , Kamal Youcef-Toumi

Data inconsistency leads to a slow training process when deep neural networks are used for the inverse design of photonic devices, an issue that arises from the fundamental property of non-uniqueness in all inverse scattering problems. Here…

Optics · Physics 2018-04-09 Dianjing Liu , Yixuan Tan , Erfan Khoram , Zongfu Yu

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

Symmetric functions, which take as input an unordered, fixed-size set, are known to be universally representable by neural networks that enforce permutation invariance. These architectures only give guarantees for fixed input sizes, yet in…

Machine Learning · Computer Science 2022-10-11 Aaron Zweig , Joan Bruna