English
Related papers

Related papers: Big in Japan: Regularizing networks for solving in…

200 papers

The solution of linear inverse problems arising, for example, in signal and image processing is a challenging problem since the ill-conditioning amplifies, in the solution, the noise present in the data. Recently introduced algorithms based…

Numerical Analysis · Mathematics 2024-02-08 Davide Evangelista , James Nagy , Elena Morotti , Elena Loli Piccolomini

Equivariant and invariant deep learning models have been developed to exploit intrinsic symmetries in data, demonstrating significant effectiveness in certain scenarios. However, these methods often suffer from limited representation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yulu Bai , Jiahong Fu , Qi Xie , Deyu Meng

Training deep neural networks is known to require a large number of training samples. However, in many applications only few training samples are available. In this work, we tackle the issue of training neural networks for classification…

Machine Learning · Computer Science 2017-12-25 Soufiane Belharbi , Clément Chatelain , Romain Hérault , Sébastien Adam

We propose a non-stationary iterated network Tikhonov (iNETT) method for the solution of ill-posed inverse problems. The iNETT employs deep neural networks to build a data-driven regularizer, and it avoids the difficult task of estimating…

Numerical Analysis · Mathematics 2023-04-05 Davide Bianchi , Guanghao Lai , Wenbin Li

Deep neural networks are learning models with a very high capacity and therefore prone to over-fitting. Many regularization techniques such as Dropout, DropConnect, and weight decay all attempt to solve the problem of over-fitting by…

Machine Learning · Computer Science 2016-12-06 Armen Aghajanyan

Deep Neural Networks (DNNs) have obtained impressive performance across tasks, however they still remain as black boxes, e.g., hard to theoretically analyze. At the same time, Polynomial Networks (PNs) have emerged as an alternative method…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Grigorios G Chrysos , Bohan Wang , Jiankang Deng , Volkan Cevher

Neural networks have shown tremendous potential for reconstructing high-resolution images in inverse problems. The non-convex and opaque nature of neural networks, however, hinders their utility in sensitive applications such as medical…

Machine Learning · Computer Science 2020-12-10 Arda Sahiner , Morteza Mardani , Batu Ozturkler , Mert Pilanci , John Pauly

We propose an end-to-end deep learning framework that comprehensively solves the inverse wave scattering problem across all length scales. Our framework consists of the newly introduced wide-band butterfly network coupled with a simple…

Numerical Analysis · Mathematics 2021-06-03 Matthew Li , Laurent Demanet , Leonardo Zepeda-Núñez

The solution of inverse problems is of fundamental interest in medical and astronomical imaging, geophysics as well as engineering and life sciences. Recent advances were made by using methods from machine learning, in particular deep…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Moritz Piening , Fabian Altekrüger , Johannes Hertrich , Paul Hagemann , Andrea Walther , Gabriele Steidl

Rectifying the orientation of images represents a daily task for every photographer. This task may be complicated even for the human eye, especially when the horizon or other horizontal and vertical lines in the image are missing. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Ionut Mironica , Andrei Zugravu

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. In recent years, the…

Machine Learning · Computer Science 2022-02-17 Abinash Nayak

In recent years, new regularization methods based on (deep) neural networks have shown very promising empirical performance for the numerical solution of ill-posed problems, e.g., in medical imaging and imaging science. Due to the…

Numerical Analysis · Mathematics 2024-06-07 Tim Jahn , Bangti Jin

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

While the depth of convolutional neural networks has attracted substantial attention in the deep learning research, the width of these networks has recently received greater interest. The width of networks, defined as the size of the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Peng Liu , Xiaoxiao Zhou , Yangjunyi Li , El Basha Mohammad D , Ruogu Fang

Direct image-to-image alignment that relies on the optimization of photometric error metrics suffers from limited convergence range and sensitivity to lighting conditions. Deep learning approaches has been applied to address this problem by…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Lei Han , Mengqi Ji , Lu Fang , Matthias Nießner

While variational methods have been among the most powerful tools for solving linear inverse problems in imaging, deep (convolutional) neural networks have recently taken the lead in many challenging benchmarks. A remaining drawback of deep…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tim Meinhardt , Michael Moeller , Caner Hazirbas , Daniel Cremers

This paper is concerned with a novel regularisation technique for solving linear ill-posed operator equations in Hilbert spaces from data that is corrupted by white noise. We combine convex penalty functionals with extreme-value statistics…

Statistics Theory · Mathematics 2012-04-03 Klaus Frick , Philipp Marnitz , Axel Munk

There is a significant performance gap between Binary Neural Networks (BNNs) and floating point Deep Neural Networks (DNNs). We propose to improve the binary training method, by introducing a new regularization function that encourages…

Machine Learning · Computer Science 2020-04-22 Sajad Darabi , Mouloud Belbahri , Matthieu Courbariaux , Vahid Partovi Nia

The success of deep neural networks is mostly due their ability to learn meaningful features from the data. Features learned in the hidden layers of deep neural networks trained in computer vision tasks have been shown to be similar to…

Machine Learning · Computer Science 2017-01-04 Biswajit Paria , Vikas Reddy , Anirban Santara , Pabitra Mitra

In this paper, we consider deep neural networks for solving inverse problems that are robust to forward model mis-specifications. Specifically, we treat sensing problems with model mismatch where one wishes to recover a sparse…

Machine Learning · Computer Science 2021-10-22 Wei Pu , Chao Zhou , Yonina C. Eldar , Miguel R. D. Rodrigues