English
Related papers

Related papers: Neural Network Acceleration of Iterative Methods f…

200 papers

We develop a spacetime neural network method with second order optimization for solving quantum dynamics from the high dimensional Schr\"{o}dinger equation. In contrast to the standard iterative first order optimization and the…

Disordered Systems and Neural Networks · Physics 2021-08-05 Jiangran Wang , Zhuo Chen , Di Luo , Zhizhen Zhao , Vera Mikyoung Hur , Bryan K. Clark

This paper aims to accelerate the test-time computation of deep convolutional neural networks (CNNs). Unlike existing methods that are designed for approximating linear filters or linear responses, our method takes the nonlinear units into…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Xiangyu Zhang , Jianhua Zou , Xiang Ming , Kaiming He , Jian Sun

Iterative methods have led to better understanding and solving problems such as missing sampling, deconvolution, inverse systems, impulsive and Salt and Pepper noise removal problems. However, the challenges such as the speed of convergence…

Signal Processing · Electrical Eng. & Systems 2024-09-23 Mahdi Shamsi , Mahmoud Ghandi , Farokh Marvasti

In this paper, we consider Nesterov's Accelerated Gradient method for solving Nonlinear Inverse and Ill-Posed Problems. Known to be a fast gradient-based iterative method for solving well-posed convex optimization problems, this method also…

Numerical Analysis · Mathematics 2020-01-13 Simon Hubmer , Ronny Ramlau

Due to the good performance of neural networks in high-dimensional and nonlinear problems, machine learning is replacing traditional methods and becoming a better approach for eigenvalue and wave function solutions of multi-dimensional…

Computational Physics · Physics 2023-02-17 Jinde Liu , Chen Yang , Gang Jiang

Recent advances in machine learning have facilitated numerically accurate solution of the electronic Schr\"{o}dinger equation (SE) by integrating various neural network (NN)-based wavefunction ansatzes with variational Monte Carlo methods.…

Chemical Physics · Physics 2024-12-13 Yaolong Zhang , Bin Jiang , Hua Guo

In this article we are interested for the numerical study of nonlinear eigenvalue problems. We begin with a review of theoretical results obtained by functional analysis methods, especially for the Schrodinger pencils. Some recall are given…

Numerical Analysis · Mathematics 2016-08-24 Fatima Aboud , Francois Jauberteau , Guy Moebs , Didier Robert

This paper develops a new class of algorithms for general linear systems and eigenvalue problems. These algorithms apply fast randomized sketching to accelerate subspace projection methods, such as GMRES and Rayleigh--Ritz. This approach…

Numerical Analysis · Mathematics 2022-02-17 Yuji Nakatsukasa , Joel A. Tropp

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

We propose a Newton-based scheme, initialized by neural operator predictions, to accelerate the parametric solution of nonlinear problems in computational solid mechanics. First, a physics informed conditional neural field is trained to…

Machine Learning · Computer Science 2025-11-11 Kianoosh Taghikhani , Yusuke Yamazaki , Jerry Paul Varghese , Markus Apel , Reza Najian Asl , Shahed Rezaei

Iterative methods are ubiquitous in large-scale scientific computing applications, and a number of approaches based on meta-learning have been recently proposed to accelerate them. However, a systematic study of these approaches and how…

Numerical Analysis · Mathematics 2023-01-31 Sohei Arisaka , Qianxiao Li

In this paper, we study and implement the structural iterative eigensolvers for the large-scale eigenvalue problem in the Bethe-Salpeter equation (BSE) based on the reduced basis approach via low-rank factorizations in generating matrices,…

Numerical Analysis · Mathematics 2017-03-08 Peter Benner , Sergey Dolgov , Venera Khoromskaia , Boris N. Khoromskij

Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be…

Numerical Analysis · Mathematics 2024-09-23 Jun-Ting Hsieh , Shengjia Zhao , Stephan Eismann , Lucia Mirabella , Stefano Ermon

Finding model parameters from data is an essential task in science and engineering, from weather and climate forecasts to plasma control. Previous works have employed neural networks to greatly accelerate finding solutions to inverse…

Machine Learning · Computer Science 2024-08-16 Philipp Holl , Nils Thuerey

We present the first accelerated randomized algorithm for solving linear systems in Euclidean spaces. One essential problem of this type is the matrix inversion problem. In particular, our algorithm can be specialized to invert positive…

Optimization and Control · Mathematics 2018-06-21 Robert M. Gower , Filip Hanzely , Peter Richtárik , Sebastian Stich

In this paper, we introduce an iterative numerical method to solve systems of nonlinear equations. The third-order convergence of this method is analyzed. Several examples are given to illustrate the efficiency of the proposed method.

Dynamical Systems · Mathematics 2009-04-23 M. Eshaghi Gordji , A. Ebadian , M. B. Ghaemi , J. Shokri

We consider a special nonconvex quartic minimization problem over a single spherical constraint, which includes the discretized energy functional minimization problem of non-rotating Bose-Einstein condensates (BECs) as one of the important…

Numerical Analysis · Mathematics 2020-12-04 Pengfei Huang , Qingzhi Yang , Yuning Yang

This paper develops an efficient and robust solution technique for the steady Boussinesq model of non-isothermal flow using Anderson acceleration applied to a Picard iteration. After analyzing the fixed point operator associated with the…

Numerical Analysis · Mathematics 2020-04-15 Sara Pollock , Leo G. Rebholz , Mengying Xiao

Combinatorial optimization (CO) is the fundamental problem at the intersection of computer science, applied mathematics, etc. The inherent hardness in CO problems brings up challenge for solving CO exactly, making deep-neural-network-based…

Machine Learning · Computer Science 2024-10-02 Runzhong Wang , Yang Li , Junchi Yan , Xiaokang Yang

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran