English
Related papers

Related papers: Rethinking Neural-based Matrix Inversion: Why can'…

200 papers

Invertible neural networks (INNs) represent an important class of deep neural network architectures that have been widely used in several applications. The universal approximation properties of INNs have also been established recently.…

Numerical Analysis · Mathematics 2023-08-21 Bangti Jin , Zehui Zhou , Jun Zou

Recent years have witnessed a hot wave of deep neural networks in various domains; however, it is not yet well understood theoretically. A theoretical characterization of deep neural networks should point out their approximation ability and…

Machine Learning · Computer Science 2022-10-28 Gao Zhang , Jin-Hui Wu , Shao-Qun Zhang

Deep neural networks have been applied successfully to a wide variety of inverse problems arising in computational imaging. These networks are typically trained using a forward model that describes the measurement process to be inverted,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-14 Davis Gilton , Gregory Ongie , Rebecca Willett

We study the computational complexity of (deterministic or randomized) algorithms based on point samples for approximating or integrating functions that can be well approximated by neural networks. Such algorithms (most prominently…

Machine Learning · Computer Science 2021-04-08 Philipp Grohs , Felix Voigtlaender

In this study, we explore the integration of Neural Networks, a powerful class of functions known for their exceptional approximation capabilities. Our primary emphasis is on the integration of multi-layer Neural Networks, a challenging…

Numerical Analysis · Mathematics 2024-03-20 Yucong Liu

We study the problem of reconstructing solutions of inverse problems when only noisy measurements are available. We assume that the problem can be modeled with an infinite-dimensional forward operator that is not continuously invertible.…

Numerical Analysis · Mathematics 2023-10-23 Andrés Felipe Lerma Pineda , Philipp Christian Petersen

We consider deep neural networks with a Lipschitz continuous activation function and with weight matrices of variable widths. We establish a uniform convergence analysis framework in which sufficient conditions on weight matrices and bias…

Machine Learning · Computer Science 2023-06-05 Yuesheng Xu , Haizhang Zhang

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

We introduce a neural network architecture to solve inverse problems linked to a one-dimensional integral operator. This architecture is built by unfolding a forward-backward algorithm derived from the minimization of an objective function…

Optimization and Control · Mathematics 2021-06-01 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

Neural network models are one of the most successful approaches to machine learning, enjoying an enormous amount of development and research over recent years and finding concrete real-world applications in almost any conceivable area of…

Mathematical Physics · Physics 2023-06-06 Nicholas P Baskerville

Neural network systems describe complex mappings that can be very difficult to understand. In this paper, we study the inverse problem of determining the input images that get mapped to specific neural network classes. Ultimately, we expect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Rebecca Pattichis , Sebastian Janampa , Constantinos S. Pattichis , Marios S. Pattichis

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Matrix completion is one of the key problems in signal processing and machine learning, with applications ranging from image pro- cessing and data gathering to classification and recommender sys- tems. Recently, deep neural networks have…

Machine Learning · Statistics 2018-05-15 Duc Minh Nguyen , Evaggelia Tsiligianni , Nikos Deligiannis

Deep neural networks are state-of-the-art in a wide variety of tasks, however, they exhibit important limitations which hinder their use and deployment in real-world applications. When developing and training neural networks, the accuracy…

Machine Learning · Computer Science 2021-09-03 Alexandre Araujo

This note establishes a theoretical framework for finding (potentially overparameterized) approximations of a function on a compact set with a-priori bounds for the generalization error. The approximation method considered is to choose,…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Arthur C. B. de Oliveira , Ruigang Wang , Ian R. Manchester , Eduardo D. Sontag

Rational and neural network based approximations are efficient tools in modern approximation. These approaches are able to produce accurate approximations to nonsmooth and non-Lipschitz functions, including multivariate domain functions. In…

Optimization and Control · Mathematics 2023-09-08 Vinesha Peiris , Reinier Diaz Millan , Nadezda Sukhorukova , Julien Ugon

The purpose of this article is to develop a machinery to study the capacity of deep neural networks (DNNs) to approximate high-dimensional functions. In particular, we show that DNNs have the expressive power to overcome the curse of…

Numerical Analysis · Mathematics 2026-04-30 Pierfrancesco Beneventano , Patrick Cheridito , Robin Graeber , Arnulf Jentzen , Benno Kuckuck

A novel artificial neural network method is proposed for solving Cauchy inverse problems. It allows multiple hidden layers with arbitrary width and depth, which theoretically yields better approximations to the inverse problems. In this…

Numerical Analysis · Mathematics 2020-01-07 Yixin Li , Xianliang Hu

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

The inherent diversity of computation types within the deep neural network (DNN) models often requires a variety of specialized units in hardware processors, which limits computational efficiency, increasing both inference latency and power…

Machine Learning · Computer Science 2024-08-21 Ruiqi Sun , Siwei Ye , Jie Zhao , Xin He , Jianzhe Lin , Yiran Li , An Zou
‹ Prev 1 2 3 10 Next ›