English
Related papers

Related papers: Subspace method based on neural networks for eigen…

200 papers

This paper explores variants of the subspace iteration algorithm for computing approximate invariant subspaces. The standard subspace iteration approach is revisited and new variants that exploit gradient-type techniques combined with a…

Numerical Analysis · Mathematics 2024-05-14 Foivos Alimisis , Yousef Saad , Bart Vandereycken

Deep neural networks are powerful tools for approximating functions, and they are applied to successfully solve various problems in many fields. In this paper, we propose a neural network-based numerical method to solve partial differential…

Numerical Analysis · Mathematics 2022-02-01 Yong Shang , Fei Wang , Jingbo Sun

This article is devoted to computing the eigenvalue of the Laplace eigenvalue problem by the weak Galerkin (WG) finite element method with emphasis on obtaining lower bounds. The WG method is on the use of weak functions and their weak…

Numerical Analysis · Mathematics 2015-08-24 Hehu Xie , Qilong Zhai , Ran Zhang

This paper aims at the efficient numerical solution of stochastic eigenvalue problems. Such problems often lead to prohibitively high dimensional systems with tensor product structure when discretized with the stochastic Galerkin method.…

Numerical Analysis · Mathematics 2018-09-28 Peter Benner , Akwum Onwunta , Martin Stoll

In recent years, there has been an increasing interest in using deep learning and neural networks to tackle scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods, such…

Machine Learning · Computer Science 2025-02-14 Adrian Celaya , Yimo Wang , David Fuentes , Beatrice Riviere

This paper presents a method for computing eigenvalues and eigenvectors for some types of nonlinear eigenvalue problems. The main idea is to approximate the functions involved in the eigenvalue problem by rational functions and then apply a…

Numerical Analysis · Mathematics 2020-06-11 Yousef Saad , Mohamed El-Guide , Agnieszka Międlar

We propose a projection-based model order reduction method for the solution of parameter-dependent dynamical systems. The proposed method relies on the construction of time-dependent reduced spaces generated from evaluations of the solution…

Numerical Analysis · Mathematics 2019-09-11 Marie Billaud-Friess , Anthony Nouy

The conforming finite element Galerkin method is applied to discretise in the spatial direction for a class of strongly nonlinear parabolic problems. Using elliptic projection of the associated linearised stationary problem with Gronwall…

Numerical Analysis · Mathematics 2021-08-04 Ambit Kumar Pany , Morrakot Khebchareon , Amiya K. Pani

We propose a new type of multilevel method for solving eigenvalue problems based on Newton iteration. With the proposed iteration method, solving eigenvalue problem on the finest finite element space is replaced by solving a small scale…

Numerical Analysis · Mathematics 2015-11-13 Yunhui He , Yu Li , Hehu Xie

This paper introduces a novel method for eigenvalue computation using a distributed cooperative neural network framework. Unlike traditional techniques that face scalability challenges in large systems, our decentralized algorithm enables…

Machine Learning · Computer Science 2024-09-20 Ronald Katende

This paper is to give a new understanding and applications of the subspace projection method for selfadjoint eigenvalue problems. A new error estimate in the energy norm, which is induced by the stiff matrix, of the subspace projection…

Numerical Analysis · Mathematics 2017-08-24 Yunhui He , Qichen Hong , Hehu Xie , Meiling Yue , Chunguang You

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Using an autoencoder for dimensionality reduction, this paper presents a novel projection-based reduced-order model for eigenvalue problems. Reduced-order modelling relies on finding suitable basis functions which define a low-dimensional…

Numerical Analysis · Mathematics 2022-12-06 Toby Phillips , Claire E. Heaney , Paul N. Smith , Christopher C. Pain

We propose a self-supervised approach for learning physics-based subspaces for real-time simulation. Existing learning-based methods construct subspaces by approximating pre-defined simulation data in a purely geometric way. However, this…

Machine Learning · Computer Science 2024-04-30 Jiahong Wang , Yinwei Du , Stelian Coros , Bernhard Thomaszewski

We present a new numerical technique to solve large-scale eigenvalue problems. It is based on the projection technique, used in strongly correlated quantum many-body systems, where first an effective approximate model of smaller complexity…

Strongly Correlated Electrons · Physics 2015-05-19 Ralf Gamillscheg , Gundolf Haase , Wolfgang von der Linden

Randomized neural networks (RNN) are a variation of neural networks in which the hidden-layer parameters are fixed to randomly assigned values and the output-layer parameters are obtained by solving a linear system by least squares. This…

Numerical Analysis · Mathematics 2022-06-14 Jingbo Sun , Suchuan Dong , Fei Wang

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

In this Master Thesis, we study the approximation capabilities of Neural Networks in the context of numerical resolution of elliptic PDEs and Approximation Theory. First of all, in Chapter 1, we introduce the mathematical definition of…

Numerical Analysis · Mathematics 2024-10-07 Gonzalo Romera

In this article we apply reduced order techniques for the approximation of parametric eigenvalue problems. The effect of the choice of sampling points is investigated. Here we use the standard proper orthogonal decomposition technique to…

Numerical Analysis · Mathematics 2023-03-28 Daniele Boffi , Abdul Halim , Gopal Priyadarshi

Recent observations have advanced our understanding of the neural network optimization landscape, revealing the existence of (1) paths of high accuracy containing diverse solutions and (2) wider minima offering improved performance.…

Machine Learning · Computer Science 2021-09-14 Mitchell Wortsman , Maxwell Horton , Carlos Guestrin , Ali Farhadi , Mohammad Rastegari