English
Related papers

Related papers: Data-consistent neural networks for solving nonlin…

200 papers

An extendable, efficient and explainable Machine Learning approach is proposed to represent cyclic plasticity and replace conventional material models based on the Radial Return Mapping algorithm. High accuracy and stability by means of a…

Materials Science · Physics 2025-08-11 Stefan Hildebrand , Sandra Klinge

In this paper, we establish universal approximation theorems for neural networks applied to general nonlinear ill-posed operator equations. In addition to the approximation error, the measurement error is also taken into account in our…

Numerical Analysis · Mathematics 2025-11-21 Lan Wang , Qiao Zhu , Bangti Jin , Ye Zhang

In this paper we investigate a variety of deep learning strategies for solving inverse problems. We classify existing deep learning solutions for inverse problems into three categories of Direct Mapping, Data Consistency Optimizer, and Deep…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Shima Kamyab , Zohreh Azimifar , Rasool Sabzi , Paul Fieguth

There is growing body of learning problems for which it is natural to organize the parameters into matrix, so as to appropriately regularize the parameters under some matrix norm (in order to impose some more sophisticated prior knowledge).…

Machine Learning · Computer Science 2010-10-19 Sham M. Kakade , Shai Shalev-Shwartz , Ambuj Tewari

Learning-to-optimize is an emerging framework that leverages training data to speed up the solution of certain optimization problems. One such approach is based on the classical mirror descent algorithm, where the mirror map is modelled…

Optimization and Control · Mathematics 2023-06-05 Hong Ye Tan , Subhadip Mukherjee , Junqi Tang , Andreas Hauptmann , Carola-Bibiane Schönlieb

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

The paper considers the problem of performing a task defined on a model parameter that is only observed indirectly through noisy data in an ill-posed inverse problem. A key aspect is to formalize the steps of reconstruction and task as…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jonas Adler , Sebastian Lunz , Olivier Verdier , Carola-Bibiane Schönlieb , Ozan Öktem

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Davide Evangelista , Elena Morotti , Elena Loli Piccolomini , James Nagy

Deep learning (DL) has had unprecedented success and is now entering scientific computing with full force. However, current DL methods typically suffer from instability, even when universal approximation properties guarantee the existence…

Machine Learning · Computer Science 2022-04-04 Matthew J. Colbrook , Vegard Antun , Anders C. Hansen

We propose a new method that uses deep learning techniques to solve the inverse problems. The inverse problem is cast in the form of learning an end-to-end mapping from observed data to the ground-truth. Inspired by the splitting strategy…

Computer Vision and Pattern Recognition · Computer Science 2017-12-04 Kai Fan , Qi Wei , Wenlin Wang , Amit Chakraborty , Katherine Heller

We propose a general learning based framework for solving nonsmooth and nonconvex image reconstruction problems. We model the regularization function as the composition of the $l_{2,1}$ norm and a smooth but nonconvex feature mapping…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yunmei Chen , Hongcheng Liu , Xiaojing Ye , Qingchao Zhang

In recent years, deep learning has achieved remarkable empirical success for image reconstruction. This has catalyzed an ongoing quest for precise characterization of correctness and reliability of data-driven methods in critical use-cases,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Subhadip Mukherjee , Andreas Hauptmann , Ozan Öktem , Marcelo Pereyra , Carola-Bibiane Schönlieb

Regularization is commonly used for alleviating overfitting in machine learning. For convolutional neural networks (CNNs), regularization methods, such as DropBlock and Shake-Shake, have illustrated the improvement in the generalization…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yi Wang , Zhen-Peng Bian , Junhui Hou , Lap-Pui Chau

Learning effective regularization is crucial for solving ill-posed inverse problems, which arise in a wide range of scientific and engineering applications. While data-driven methods that parameterize regularizers using deep neural networks…

Machine Learning · Statistics 2025-02-04 Yasi Zhang , Oscar Leong

The reconstruction of images from their corresponding noisy Radon transform is a typical example of an ill-posed linear inverse problem as arising in the application of computerized tomography (CT). As the (naive) solution does not depend…

Machine learning techniques for the solution of inverse problems have become an attractive approach in the last decade, while their theoretical foundations are still in their infancy. In this chapter we want to pursue the study of…

Numerical Analysis · Mathematics 2025-12-10 Martin Burger , Samira Kabri , Gitta Kutyniok , Yunseok Lee , Lukas Weigand

Despite impressive performance on numerous visual tasks, Convolutional Neural Networks (CNNs) --- unlike brains --- are often highly sensitive to small perturbations of their input, e.g. adversarial noise leading to erroneous decisions. We…

Nonlinear regression has been extensively employed in many computer vision problems (e.g., crowd counting, age estimation, affective computing). Under the umbrella of deep learning, two common solutions exist i) transforming nonlinear…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Le Zhang , Zenglin Shi , Ming-Ming Cheng , Yun Liu , Jia-Wang Bian , Joey Tianyi Zhou , Guoyan Zheng , Zeng Zeng

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini