English
Related papers

Related papers: Stabilizing Invertible Neural Networks Using Mixtu…

200 papers

We propose a new approach to linear ill-posed inverse problems. Our algorithm alternates between enforcing two constraints: the measurements and the statistical correlation structure in some transformed space. We use a non-linear multiscale…

Computational Engineering, Finance, and Science · Computer Science 2018-12-04 Ivan Dokmanić , Joan Bruna , Stéphane Mallat , Maarten de Hoop

We study the inverse boundary value problem for the Helmholtz equation using the Dirichlet-to-Neumann map at selected frequency as the data. We develop an explicit reconstruction of the wavespeed using a multi-level nonlinear projected…

Numerical Analysis · Mathematics 2014-06-11 Elena Beretta , Maarten V. de Hoop , Lingyun Qiu , Otmar Scherzer

In the past five years, deep learning methods have become state-of-the-art in solving various inverse problems. Before such approaches can find application in safety-critical fields, a verification of their reliability appears mandatory.…

Machine Learning · Computer Science 2023-01-18 Martin Genzel , Jan Macdonald , Maximilian März

Deep neural networks are considered to be state of the art models in many offline machine learning tasks. However, their performance and generalization abilities in online learning tasks are much less understood. Therefore, we focus on…

Machine Learning · Computer Science 2019-05-28 Guy Uziel

In this paper, we study an inverse problem for linear parabolic system with variable diffusion coefficients subject to dynamic boundary conditions. We prove a global Lipschitz stability for the inverse problem involving a simultaneous…

Analysis of PDEs · Mathematics 2022-01-04 E. M. Ait Ben Hassi , S. E. Chorfi , L. Maniar , O. Oukdach

A novel numerical method for solving inverse scattering problem with fixed-energy data is proposed. The method contains a new important concept: the stability index of the inversion problem. This is a number, computed from the data, which…

Mathematical Physics · Physics 2007-05-23 S. Gutman , A. G. Ramm , W. Scheid

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

There are various inverse problems -- including reconstruction problems arising in medical imaging -- where one is often aware of the forward operator that maps variables of interest to the observations. It is therefore natural to ask…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

Graph prediction problems prevail in data analysis and machine learning. The inverse prediction problem, namely to infer input data from given output labels, is of emerging interest in various applications. In this work, we develop…

Machine Learning · Statistics 2022-11-22 Chen Xu , Xiuyuan Cheng , Yao Xie

In this work we study the increasing resolution of linear inverse scattering problems at a large fixed frequency. We consider the problem of recovering the density of a Herglotz wave function, and the linearized inverse scattering problem…

Analysis of PDEs · Mathematics 2025-03-07 Pu-Zhao Kow , Mikko Salo , Sen Zou

Despite the large success of deep neural networks (DNN) in recent years, most neural networks still lack mathematical guarantees in terms of stability. For instance, DNNs are vulnerable to small or even imperceptible input perturbations, so…

Machine Learning · Computer Science 2022-11-02 Leon Bungert , René Raab , Tim Roith , Leo Schwinn , Daniel Tenbrinck

Solving inverse problems is a fundamental component of science, engineering and mathematics. With the advent of deep learning, deep neural networks have significant potential to outperform existing state-of-the-art, model-based methods for…

Machine Learning · Computer Science 2022-12-22 Maksym Neyra-Nesterenko , Ben Adcock

Explainability models are now prevalent within machine learning to address the black-box nature of neural networks. The question now is which explainability model is most effective. Probabilistic Lipschitzness has demonstrated that the…

Machine Learning · Computer Science 2024-03-11 Lachlan Simpson , Kyle Millar , Adriel Cheng , Cheng-Chew Lim , Hong Gunn Chew

This paper concerns the inverse source problems for the time-harmonic elastic and electromagnetic wave equations. The goal is to determine the external force and the electric current density from boundary measurements of the radiated wave…

Analysis of PDEs · Mathematics 2018-08-17 Gang Bao , Peijun Li , Yue Zhao

In this paper we introduce the randomised stability constant for abstract inverse problems, as a generalisation of the randomised observability constant, which was studied in the context of observability inequalities for the linear wave…

Analysis of PDEs · Mathematics 2020-07-16 Giovanni S. Alberti , Yves Capdeboscq , Yannick Privat

Exciting new work on the generalization bounds for neural networks (NN) given by Neyshabur et al. , Bartlett et al. closely depend on two parameter-depenedent quantities: the Lipschitz constant upper-bound and the stable rank (a softer…

Machine Learning · Statistics 2020-02-21 Amartya Sanyal , Philip H. S. Torr , Puneet K. Dokania

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

The distinctive architectural features of normalizing flows (NFs), notably bijectivity and tractable Jacobians, make them well-suited for generative modeling. Invertible neural networks (INNs) build on these principles to address supervised…

Machine Learning · Computer Science 2026-02-25 Shubhanshu Shekhar , Mohammad Javad Khojasteh , Ananya Acharya , Tony Tohme , Kamal Youcef-Toumi

Recovering a low-complexity signal from its noisy observations by regularization methods is a cornerstone of inverse problems and compressed sensing. Stable recovery ensures that the original signal can be approximated linearly by optimal…

Optimization and Control · Mathematics 2025-05-30 Tran T. A. Nghia , Huy N. Pham , Nghia V. Vo

Since the control of the Lipschitz constant has a great impact on the training stability, generalization, and robustness of neural networks, the estimation of this value is nowadays a real scientific challenge. In this paper we introduce a…

Machine Learning · Computer Science 2023-06-21 Blaise Delattre , Quentin Barthélemy , Alexandre Araujo , Alexandre Allauzen