English
Related papers

Related papers: Theoretical Perspectives on Deep Learning Methods …

200 papers

These lecture notes evolve around mathematical concepts arising in inverse problems. We start by introducing inverse problems through examples such as differentiation, deconvolution, computed tomography and phase retrieval. This then leads…

Numerical Analysis · Mathematics 2025-08-26 Danielle Bednarski , Tim Roith

Recently the field of inverse problems has seen a growing usage of mathematically only partially understood learned and non-learned priors. Based on first principles, we develop a projectional approach to inverse problems that addresses the…

Machine Learning · Computer Science 2019-08-07 Sören Dittmer , Peter Maass

Deep Learning is one of the newest trends in Machine Learning and Artificial Intelligence research. It is also one of the most popular scientific research trends now-a-days. Deep learning methods have brought revolutionary advances in…

Machine Learning · Computer Science 2018-07-24 Matiur Rahman Minar , Jibon Naher

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

Trained generative models have shown remarkable performance as priors for inverse problems in imaging -- for example, Generative Adversarial Network priors permit recovery of test images from 5-10x fewer measurements than sparsity priors.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Muhammad Asim , Mara Daniels , Oscar Leong , Ali Ahmed , Paul Hand

Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art results in many domains. Recently, a variety of model designs and methods have blossomed in the context…

Computation and Language · Computer Science 2018-11-27 Tom Young , Devamanyu Hazarika , Soujanya Poria , Erik Cambria

Deep learning, a branch of artificial intelligence, is a data-driven method that uses multiple layers of interconnected units or neurons to learn intricate patterns and representations directly from raw input data. Empowered by this…

Machine Learning · Computer Science 2025-07-28 Mohd Halim Mohd Noor , Ayokunle Olalekan Ige

Deep learning has recently become one of the most popular sub-fields of machine learning owing to its distributed data representation with multiple levels of abstraction. A diverse range of deep learning algorithms are being employed to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Rajat Kumar Sinha , Ruchi Pandey , Rohan Pattnaik

The present paper studies so-called deep image prior (DIP) techniques in the context of ill-posed inverse problems. DIP networks have been recently introduced for applications in image processing; also first experimental results for…

Machine Learning · Computer Science 2020-03-19 Sören Dittmer , Tobias Kluth , Peter Maass , Daniel Otero Baguer

While variational methods have been among the most powerful tools for solving linear inverse problems in imaging, deep (convolutional) neural networks have recently taken the lead in many challenging benchmarks. A remaining drawback of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tim Meinhardt , Michael Moeller , Caner Hazirbas , Daniel Cremers

Neural network systems describe complex mappings that can be very difficult to understand. In this paper, we study the inverse problem of determining the input images that get mapped to specific neural network classes. Ultimately, we expect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Rebecca Pattichis , Sebastian Janampa , Constantinos S. Pattichis , Marios S. Pattichis

Deep neural network approaches to inverse imaging problems have produced impressive results in the last few years. In this paper, we consider the use of generative models in a variational regularisation approach to inverse problems. The…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Margaret Duff , Neill D. F. Campbell , Matthias J. Ehrhardt

Deep learning research aims at discovering learning algorithms that discover multiple levels of distributed representations, with higher levels representing more abstract concepts. Although the study of deep learning has already led to…

Machine Learning · Computer Science 2013-06-10 Yoshua Bengio

In the space of only a few years, deep generative modeling has revolutionized how we think of artificial creativity, yielding autonomous systems which produce original images, music, and text. Inspired by these successes, researchers are…

Machine Learning · Computer Science 2019-05-24 Daniel C. Elton , Zois Boukouvalas , Mark D. Fuge , Peter W. Chung

Deep learning has been the most popular machine learning method in the last few years. In this chapter, we present the application of deep learning and physics-informed neural networks concerning structural mechanics and vibration problems.…

Machine Learning · Computer Science 2022-02-23 Ehsan Haghighat , Ali Can Bekar , Erdogan Madenci , Ruben Juanes

Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alternative,…

Machine Learning · Computer Science 2021-06-28 Xiao Liu , Fanjin Zhang , Zhenyu Hou , Zhaoyu Wang , Li Mian , Jing Zhang , Jie Tang

Over the past few years, we have seen fundamental breakthroughs in core problems in machine learning, largely driven by advances in deep neural networks. At the same time, the amount of data collected in a wide array of scientific domains…

Machine Learning · Computer Science 2020-03-27 Maithra Raghu , Eric Schmidt

Neural networks have become a prominent approach to solve inverse problems in recent years. While a plethora of such methods was developed to solve inverse problems empirically, we are still lacking clear theoretical guarantees for these…

Machine Learning · Computer Science 2024-03-19 Nathan Buskulic , Jalal Fadili , Yvain Quéau

Solving inverse problems continues to be a challenge in a wide array of applications ranging from deblurring, image inpainting, source separation etc. Most existing techniques solve such inverse problems by either explicitly or implicitly…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Timo Bremer

Deep neural networks (DNN) have an impressive ability to invert very complex models, i.e. to learn the generative parameters from a model's output. Once trained, the forward pass of a DNN is often much faster than traditional,…

Machine Learning · Computer Science 2021-07-23 Gaetan Rensonnet , Louise Adam , Benoit Macq