English
Related papers

Related papers: A Test-Time Learning Approach to Reparameterize th…

200 papers

We propose to use techniques from Bayesian inference and deep neural networks to translate uncertainty in seismic imaging to uncertainty in tasks performed on the image, such as horizon tracking. Seismic imaging is an ill-posed inverse…

Geophysics · Physics 2022-06-17 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

Variations of deep neural networks such as convolutional neural network (CNN) have been successfully applied to image denoising. The goal is to automatically learn a mapping from a noisy image to a clean image given training data consisting…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Tianyang Wang , Mingxuan Sun , Kaoning Hu

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

We present a method for learning discriminative filters using a shallow Convolutional Neural Network (CNN). We encode rotation invariance directly in the model by tying the weights of groups of filters to several rotated versions of the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-03 Diego Marcos , Michele Volpi , Devis Tuia

The generalized Gauss-Newton (GGN) optimization method incorporates curvature estimates into its solution steps, and provides a good approximation to the Newton method for large-scale optimization problems. GGN has been found particularly…

Machine Learning · Computer Science 2024-04-24 Adeyemi D. Adeoye , Philipp Christian Petersen , Alberto Bemporad

Recently, deep learning based methods appeared as a new paradigm for solving inverse problems. These methods empirically show excellent performance but lack of theoretical justification; in particular, no results on the regularization…

Numerical Analysis · Mathematics 2019-01-30 Johannes Schwab , Stephan Antholzer , Markus Haltmeier

We propose a convolutional neural network (CNN) architecture for image classification based on subband decomposition of the image using wavelets. The proposed architecture decomposes the input image spectra into multiple critically sampled…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Over the past decade, deep learning research has been accelerated by increasingly powerful hardware, which facilitated rapid growth in the model complexity and the amount of data ingested. This is becoming unsustainable and therefore…

Machine Learning · Computer Science 2024-02-08 Damian Owerko , Charilaos I. Kanatsoulis , Alejandro Ribeiro

Most existing methods usually formulate the non-blind deconvolution problem into a maximum-a-posteriori framework and address it by manually designing kinds of regularization terms and data terms of the latent clear images. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Pin-Hung Kuo , Jinshan Pan , Shao-Yi Chien , Ming-Hsuan Yang

Regularization techniques are widely used to improve the generality, robustness, and efficiency of deep convolutional neural networks (DCNNs). In this paper, we propose a novel approach of regulating DCNN convolutional kernels by a…

Machine Learning · Computer Science 2019-11-28 Seyed Mehdi Ayyoubzadeh , Xiaolin Wu

We propose a convolutional neural network (CNN) denoising based method for seismic data interpolation. It provides a simple and efficient way to break though the lack problem of geophysical training labels that are often required by deep…

Geophysics · Physics 2020-08-25 Hao Zhang , Xiuyan Yang , Jianwei Ma

This paper introduces an adaptive convolutional neural network (CNN) architecture capable of automating various topology optimization (TO) problems with diverse underlying physics. The proposed architecture has an encoder-decoder-type…

Computational Engineering, Finance, and Science · Computer Science 2024-04-19 Khaish Singh Chadha , Prabhat Kumar

The reconstruction of the 3D permittivity map from ground-penetrating radar (GPR) data is of great importance for mapping subsurface environments and inspecting underground structural integrity. Traditional iterative 3D reconstruction…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Qiqi Dai , Yee Hui Lee , Hai-Han Sun , Genevieve Ow , Mohamed Lokman Mohd Yusof , Abdulkadir C. Yucel

Convolutional Neural Networks (CNNs) are known to be significantly over-parametrized, and difficult to interpret, train and adapt. In this paper, we introduce a structural regularization across convolutional kernels in a CNN. In our…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu

In this paper, we introduce a physics-driven regularization method for training of deep neural networks (DNNs) for use in engineering design and analysis problems. In particular, we focus on prediction of a physical system, for which in…

Machine Learning · Computer Science 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

Convolutional neural networks (CNN) have been successful in machine learning applications. Their success relies on their ability to consider space invariant local features. We consider the use of CNN to fit nuisance models in semiparametric…

Machine Learning · Statistics 2025-09-08 Mohammad Ghasempour , Niloofar Moosavi , Xavier de Luna

Deep neural network approaches to inverse imaging problems have produced impressive results in the last few years. In this paper, we consider the use of generative models in a variational regularisation approach to inverse problems. The…

Image and Video Processing · Electrical Eng. & Systems 2022-06-22 Margaret Duff , Neill D. F. Campbell , Matthias J. Ehrhardt

In this paper we consider the training of single hidden layer neural networks by pseudoinversion, which, in spite of its popularity, is sometimes affected by numerical instability issues. Regularization is known to be effective in such…

Neural and Evolutionary Computing · Computer Science 2015-08-26 Rossella Cancelliere , Mario Gai , Patrick Gallinari , Luca Rubini

Machine learning methods such as convolutional neural networks (CNNs) are becoming an integral part of scientific research in many disciplines, spatial vector data often fail to be analyzed using these powerful learning methods because of…

Machine Learning · Statistics 2018-09-24 Xiongfeng Yan , Tinghua Ai

There remains an important need for the development of image reconstruction methods that can produce diagnostically useful images from undersampled measurements. In magnetic resonance imaging (MRI), for example, such methods can facilitate…

Image and Video Processing · Electrical Eng. & Systems 2021-06-28 Varun A. Kelkar , Sayantan Bhadra , Mark A. Anastasio