English
Related papers

Related papers: Deep learning methods for inverse problems using c…

200 papers

A large class of inverse problems for PDEs are only well-defined as mappings from operators to functions. Existing operator learning frameworks map functions to functions and need to be modified to learn inverse maps from data. We propose a…

Machine Learning · Computer Science 2023-06-06 Roberto Molinaro , Yunan Yang , Björn Engquist , Siddhartha Mishra

Recently, various high-order methods have been developed to solve the convex optimization problem. The auxiliary problem of these methods shares the general form that is the same as the high-order proximal operator proposed by Nesterov. In…

Optimization and Control · Mathematics 2023-09-06 Jingyu Gao , Xiurui Geng

Information divergences allow one to assess how close two distributions are from each other. Among the large panel of available measures, a special attention has been paid to convex $\varphi$-divergences, such as Kullback-Leibler,…

Information Theory · Computer Science 2019-04-09 Mireille El Gheche , Giovanni Chierchia , Jean-Christophe Pesquet

Recent advances in deep learning have led to a data-centric intelligence i.e. artificially intelligent models unlocking the potential to ingest a large amount of data and be really good at performing digital tasks such as text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Muhammad Zubair Irshad

This paper considers the inversion of ill-posed linear operators. To regularise the problem the solution is enforced to lie in a non-convex subset. Theoretical properties for the stable inversion are derived and an iterative algorithm akin…

Numerical Analysis · Mathematics 2009-11-30 Thomas Blumensath

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Optimal control problems with nonsmooth objectives and nonlinear partial differential equation (PDE) constraints are challenging, mainly because of the underlying nonsmooth and nonconvex structures and the demanding computational cost for…

Optimization and Control · Mathematics 2025-04-25 Yongcun Song , Xiaoming Yuan , Hangrui Yue , Tianyou Zeng

Robust learning aims to maintain model performance under noise, corruption, and distributional shifts, which are prevalent in modern machine learning applications. This work shows that examples of robust learning problems can be formulated…

Optimization and Control · Mathematics 2026-05-12 Alireza Kabgani , Felipe Lara , Masoud Ahookhosh

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang

Despite its nonconvex nature, $\ell_0$ sparse approximation is desirable in many theoretical and application cases. We study the $\ell_0$ sparse approximation problem with the tool of deep learning, by proposing Deep $\ell_0$ Encoders. Two…

Machine Learning · Computer Science 2015-11-24 Zhangyang Wang , Qing Ling , Thomas S. Huang

The utilisation of Plug-and-Play (PnP) priors in inverse problems has become increasingly prominent in recent years. This preference is based on the mathematical equivalence between the general proximal operator and the regularised…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Yanqi Cheng , Lipei Zhang , Zhenda Shen , Shujun Wang , Lequan Yu , Raymond H. Chan , Carola-Bibiane Schönlieb , Angelica I Aviles-Rivero

Gradient descent and coordinate descent are well understood in terms of their asymptotic behavior, but less so in a transient regime often used for approximations in machine learning. We investigate how proper initialization can have a…

Machine Learning · Computer Science 2017-06-14 Hadi Daneshmand , Hamed Hassani , Thomas Hofmann

A wide array of image recovery problems can be abstracted into the problem of minimizing a sum of composite convex functions in a Hilbert space. To solve such problems, primal-dual proximal approaches have been developed which provide…

Optimization and Control · Mathematics 2014-06-23 Patrick L. Combettes , Laurent Condat , Jean-Christophe Pesquet , Bang Cong Vu

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

Inverse problems constrained by partial differential equations (PDEs) play a critical role in model development and calibration. In many applications, there are multiple uncertain parameters in a model that must be estimated. However, high…

Numerical Analysis · Mathematics 2022-10-27 Joseph Hart , Bart van Bloemen Waanders

Generative priors have been shown to provide improved results over sparsity priors in linear inverse problems. However, current state of the art methods suffer from one or more of the following drawbacks: (a) speed of recovery is slow; (b)…

Image and Video Processing · Electrical Eng. & Systems 2021-01-14 Jasjeet Dhaliwal , Kyle Hambrook

Bilevel optimization has arisen as a powerful tool in modern machine learning. However, due to the nested structure of bilevel optimization, even gradient-based methods require second-order derivative approximations via Jacobian- or/and…

Machine Learning · Computer Science 2022-06-07 Daouda Sow , Kaiyi Ji , Yingbin Liang

Neural networks have become a prominent approach to solve inverse problems in recent years. Amongst the different existing methods, the Deep Image/Inverse Priors (DIPs) technique is an unsupervised approach that optimizes a highly…

Machine Learning · Computer Science 2023-03-21 Nathan Buskulic , Yvain Quéau , Jalal Fadili

Koopman operators provide tractable means of learning linear approximations of non-linear dynamics. Many approaches have been proposed to find these operators, typically based upon approximations using an a-priori fixed class of models.…

Systems and Control · Electrical Eng. & Systems 2021-02-09 Mario Sznaier

This paper aims to solve numerically the two-dimensional inverse medium scattering problem with far-field data. This is a challenging task due to the severe ill-posedness and strong nonlinearity of the inverse problem. As already known, it…

Numerical Analysis · Mathematics 2025-09-25 Kai Li , Bo Zhang , Haiwen Zhang