English
Related papers

Related papers: Neural Networks Based on Power Method and Inverse …

200 papers

We present a simple linear regression based approach for learning the weights and biases of a neural network, as an alternative to standard gradient based backpropagation. The present work is exploratory in nature, and we restrict the…

Machine Learning · Computer Science 2023-07-17 Harshad Khadilkar

We study and derive algorithms for nonlinear eigenvalue problems, where the system matrix depends on the eigenvector, or several eigenvectors (or their corresponding invariant subspace). The algorithms are derived from an implicit…

Numerical Analysis · Mathematics 2020-03-02 Elias Jarlebring , Parikshit Upadhyaya

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

The study of solving the inverse eigenvalue problem for nonnegative matrices has been around for decades. It is clear that an inverse eigenvalue problem is trivial if the desirable matrix is not restricted to a certain structure. Provided…

Numerical Analysis · Mathematics 2014-08-13 Matthew M. Lin

Many problems in machine learning and statistics can be formulated as (generalized) eigenproblems. In terms of the associated optimization problem, computing linear eigenvectors amounts to finding critical points of a quadratic function…

Machine Learning · Computer Science 2015-03-17 Matthias Hein , Thomas Bühler

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be tackled by solving a linear least-square problem, which can be done by finding the eigenvector…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Zheng Dang , Kwang Moo Yi , Yinlin Hu , Fei Wang , Pascal Fua , Mathieu Salzmann

We propose a new method to solve eigenvalue problems for linear and semilinear second order differential operators in high dimensions based on deep neural networks. The eigenvalue problem is reformulated as a fixed point problem of the…

Machine Learning · Computer Science 2020-10-28 Jiequn Han , Jianfeng Lu , Mo Zhou

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

The last decade has seen the parallel emergence in computational neuroscience and machine learning of neural network structures which spread the input signal randomly to a higher dimensional space; perform a nonlinear activation; and then…

Neural and Evolutionary Computing · Computer Science 2013-06-11 Jonathan Tapson , Andre van Schaik

Neural network systems describe complex mappings that can be very difficult to understand. In this paper, we study the inverse problem of determining the input images that get mapped to specific neural network classes. Ultimately, we expect…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Rebecca Pattichis , Sebastian Janampa , Constantinos S. Pattichis , Marios S. Pattichis

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

While deep learning methods have achieved state-of-the-art performance in many challenging inverse problems like image inpainting and super-resolution, they invariably involve problem-specific training of the networks. Under this approach,…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 J. H. Rick Chang , Chun-Liang Li , Barnabas Poczos , B. V. K. Vijaya Kumar , Aswin C. Sankaranarayanan

We present a finite difference method to compute the principal eigenvalue and the corresponding eigenfunction for a large class of second order elliptic operators including notably linear operators in nondivergence form and fully nonlinear…

Numerical Analysis · Mathematics 2016-02-18 Isabeau Birindelli , Fabio Camilli , Italo Capuzzo Dolcetta

We investigate a technique to transform a linear two-parameter eigenvalue problem, into a nonlinear eigenvalue problem (NEP). The transformation stems from an elimination of one of the equations in the two-parameter eigenvalue problem, by…

Numerical Analysis · Mathematics 2021-06-17 Emil Ringh , Elias Jarlebring

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be solved by finding the eigenvector corresponding to the smallest, or zero, eigenvalue of a matrix…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Zheng Dang , Kwang Moo Yi , Yinlin Hu , Fei Wang , Pascal Fua , Mathieu Salzmann

In this paper, we propose a type of tensor-neural-network-based machine learning method to compute multi-eigenpairs of high dimensional eigenvalue problems without Monte-Carlo procedure. Solving multi-eigenvalues and their corresponding…

Numerical Analysis · Mathematics 2023-05-23 Yifan Wang , Hehi Xie

This paper introduces a novel method for eigenvalue computation using a distributed cooperative neural network framework. Unlike traditional techniques that face scalability challenges in large systems, our decentralized algorithm enables…

Machine Learning · Computer Science 2024-09-20 Ronald Katende

We propose a new type of multilevel method for solving eigenvalue problems based on Newton iteration. With the proposed iteration method, solving eigenvalue problem on the finest finite element space is replaced by solving a small scale…

Numerical Analysis · Mathematics 2015-11-13 Yunhui He , Yu Li , Hehu Xie

This paper introduces a structured, adaptive-length deep representation called Neural Eigenmap. Unlike prior spectral methods such as Laplacian Eigenmap that operate in a nonparametric manner, Neural Eigenmap leverages NeuralEF to…

Machine Learning · Computer Science 2023-12-11 Zhijie Deng , Jiaxin Shi , Hao Zhang , Peng Cui , Cewu Lu , Jun Zhu