English
Related papers

Related papers: Neural-Initialized Newton: Accelerating Nonlinear …

200 papers

This work introduces a new approach for accelerating the numerical analysis of time-domain partial differential equations (PDEs) governing complex physical systems. The methodology is based on a combination of a classical reduced-order…

Machine Learning · Computer Science 2024-06-06 Victor Matray , Faisal Amlani , Frédéric Feyel , David Néron

A new method to solve computationally challenging (random) parametric obstacle problems is developed and analyzed, where the parameters can influence the related partial differential equation (PDE) and determine the position and surface…

Machine Learning · Computer Science 2025-04-08 Martin Eigel , Cosmas Heiß , Janina E. Schütte

A convergence analysis is developed for the regularized Newton method for training neural networks (NNs) in the overparameterized limit. As the number of hidden units tends to infinity, the NN training dynamics converge in probability to…

Machine Learning · Computer Science 2026-05-21 Konstantin Riedl , Konstantinos Spiliopoulos , Justin Sirignano

We introduce physics informed neural networks -- neural networks that are trained to solve supervised learning tasks while respecting any given law of physics described by general nonlinear partial differential equations. In this two part…

Artificial Intelligence · Computer Science 2017-11-30 Maziar Raissi , Paris Perdikaris , George Em Karniadakis

Machine Learning models incorporating multiple layered learning networks have been seen to provide effective models for various classification problems. The resulting optimization problem to solve for the optimal vector minimizing the…

Optimization and Control · Mathematics 2018-07-03 Vyacheslav Kungurtsev , Tomas Pevny

We show that the error achievable using physics-informed neural networks for solving systems of differential equations can be substantially reduced when these networks are trained using meta-learned optimization methods rather than to using…

Machine Learning · Computer Science 2023-03-15 Alex Bihlo

Neural network force field (NNFF) is a method for performing regression on atomic structure-force relationships, bypassing expensive quantum mechanics calculation which prevents the execution of long ab-initio quality molecular dynamics…

This paper proposes a rank inspired neural network (RINN) to tackle the initialization sensitivity issue of physics informed extreme learning machines (PIELM) when numerically solving partial differential equations (PDEs). Unlike PIELM…

Numerical Analysis · Mathematics 2025-06-24 Wentao Peng , Yunqing Huang , Nianyu Yi

Most existing work uses dual decomposition and subgradient methods to solve Network Utility Maximization (NUM) problems in a distributed manner, which suffer from slow rate of convergence properties. This work develops an alternative…

Optimization and Control · Mathematics 2015-03-17 Ermin Wei , Asuman Ozdaglar , Ali Jadbabaie

Physics-Informed Neural Networks (PINNs) are a powerful deep learning method capable of providing solutions and parameter estimations of physical systems. Given the complexity of their neural network structure, the convergence speed is…

Machine Learning · Computer Science 2025-01-28 Sirui Li , Federica Bragone , Matthieu Barreau , Kateryna Morozovska

Neural Networks (NNs) are the method of choice for building learning algorithms. Their popularity stems from their empirical success on several challenging learning problems. However, most scholars agree that a convincing theoretical…

Numerical Analysis · Mathematics 2021-01-01 Ronald DeVore , Boris Hanin , Guergana Petrova

This work presents a novel methodology for analysis and control of nonlinear fluid systems using neural networks. The approach is demonstrated on four different study cases being the Lorenz system, a modified version of the…

Fluid Dynamics · Physics 2023-08-28 Tarcísio Déda , William Wolf , Scott Dawson

Recent advances in scientific machine learning (SciML) have enabled neural operators (NOs) to serve as powerful surrogates for modeling the dynamic evolution of physical systems governed by partial differential equations (PDEs). While…

Machine Learning · Computer Science 2026-02-18 Siying Ma , Mehrdad M. Zadeh , Mauricio Soroco , Wuyang Chen , Jiguo Cao , Vijay Ganesh

Recent technological developments have led to big data processing, which resulted in significant computational difficulties when solving large-scale linear systems or inverting matrices. As a result, fast approximate iterative matrix…

Other Computer Science · Computer Science 2023-05-24 Marcus Engsig , Qingjie Yang

Modern applications of atomic physics, including the determination of frequency standards, and the analysis of astrophysical spectra, require prediction of atomic properties with exquisite accuracy. For complex atomic systems,…

Atomic Physics · Physics 2024-08-02 Pavlo Bilous , Charles Cheung , Marianna Safronova

This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of…

Computational Physics · Physics 2021-08-17 Suraj Pawar , Omer San , Adil Rasheed , Ionel M. Navon

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi

This rapid communication devises a Neural Induction Machine (NeuIM) model, which pilots the use of physics-informed machine learning to enable AI-based electromagnetic transient simulations. The contributions are threefold: (1) a formation…

Machine Learning · Computer Science 2023-10-02 Qing Shen , Yifan Zhou , Peng Zhang

In this paper, we present a Newton-like method based on model reduction techniques, which can be used in implicit numerical methods for approximating the solution to ordinary differential equations. In each iteration, the Newton-like method…

Numerical Analysis · Mathematics 2023-03-14 Tobias K. S. Ritschel

Physics-informed neural networks have been widely applied to learn general parametric solutions of differential equations. Here, we propose a neural network to discover parametric eigenvalue and eigenfunction surfaces of quantum systems. We…

Machine Learning · Computer Science 2022-11-22 Marios Mattheakis , Gabriel R. Schleder , Daniel T. Larson , Efthimios Kaxiras
‹ Prev 1 4 5 6 7 8 10 Next ›