English
Related papers

Related papers: Newton's methods for solving linear inverse proble…

200 papers

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by generative adversarial networks, or GANs). In this work,…

Machine Learning · Computer Science 2018-10-09 Chinmay Hegde

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita

We introduce a neural network architecture to solve inverse problems linked to a one-dimensional integral operator. This architecture is built by unfolding a forward-backward algorithm derived from the minimization of an objective function…

Optimization and Control · Mathematics 2021-06-01 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

Among other uses, neural networks are a powerful tool for solving deterministic and Bayesian inverse problems in real-time, where variational autoencoders, a specialized type of neural network, enable the Bayesian estimation of model…

Machine Learning · Computer Science 2025-09-25 Andrea Tonini , Luca Dede'

We present an algorithm based on numerical techniques that have become standard for solving nonlinear integral equations: Newton's method, homotopy continuation, the multilevel method and random projection to solve the inversion problem…

Computational Physics · Physics 2021-05-26 Michael Jasiulek

Inspired by Gauss-Newton-like methods, we study the benefit of leveraging the structure of deep learning objectives, namely, the composition of a convex loss function and of a nonlinear network, in order to derive better direction oracles…

Machine Learning · Computer Science 2023-10-30 Vincent Roulet , Mathieu Blondel

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

Newton-type methods enjoy fast local convergence and strong empirical performance, but achieving global guarantees comparable to first-order methods remains challenging. Even for simple strongly convex problems, no straightforward variant…

Numerical Analysis · Mathematics 2025-10-20 Alexander Lim , Fred Roosta

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

One of the most important problems in the field of distributed optimization is the problem of minimizing a sum of local convex objective functions over a networked system. Most of the existing work in this area focus on developing…

Optimization and Control · Mathematics 2019-01-08 Fatemeh Mansoori , Ermin Wei

This paper proposes a Newton-type method to solve numerically the eigenproblem of several diagonalizable matrices, which pairwise commute. A classical result states that these matrices are simultaneously diagonalizable. From a suitable…

Numerical Analysis · Mathematics 2022-11-07 Rima Khouja , Bernard Mourrain , Jean-Claude Yakoubsohn

Downward continuation is a critical task in potential field processing, including gravity and magnetic fields, which aims to transfer data from one observation surface to another that is closer to the source of the field. Its effectiveness…

Geophysics · Physics 2025-02-11 Jing Sun , Lu Li , Liang Zhang

The purpose of this work is to investigate root finding problems defined on (quasi-)metric spaces, and ranging in Euclidean spaces. The motivation for this line of inquiry stems from recent models in biology and phylogenetics, where…

Optimization and Control · Mathematics 2025-10-28 Titus Pinta

We consider solving a probably ill-conditioned linear operator equation, where the operator is not modeled by physical laws but is specified via training pairs (consisting of images and data) of the input-output relation of the operator. We…

Numerical Analysis · Mathematics 2024-08-21 Andrea Aspri , Leon Frischauf , Otmar Scherzer

Imaging inverse problems aim to recover high-dimensional signals from undersampled, noisy measurements, a fundamentally ill-posed task with infinite solutions in the null-space of the sensing operator. To resolve this ambiguity, prior…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Roman Jacome , Romario Gualdrón-Hurtado , Leon Suarez , Henry Arguello

Unrolled networks have become prevalent in various computer vision and imaging tasks. Although they have demonstrated remarkable efficacy in solving specific computer vision and computational imaging tasks, their adaptation to other…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Eric Chen , Xi Chen , Arian Maleki , Shirin Jalali

In this paper we consider new regularization methods for linear inverse problems of dynamic type. These methods are based on dynamic programming techniques for linear quadratic optimal control problems. Two different approaches are…

Numerical Analysis · Mathematics 2021-01-26 S. Kindermann , A. Leitao

Solving nonlinear partial differential equations (PDEs) with multiple solutions using neural networks has found widespread applications in various fields such as physics, biology, and engineering. However, classical neural network methods…

Machine Learning · Computer Science 2024-05-24 Wenrui Hao , Xinliang Liu , Yahong Yang

Deep neural networks (DNN) have an impressive ability to invert very complex models, i.e. to learn the generative parameters from a model's output. Once trained, the forward pass of a DNN is often much faster than traditional,…

Machine Learning · Computer Science 2021-07-23 Gaetan Rensonnet , Louise Adam , Benoit Macq

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders their utility in sensitive applications such as medical…

Machine Learning · Computer Science 2020-12-10 Arda Sahiner , Morteza Mardani , Batu Ozturkler , Mert Pilanci , John Pauly