English
Related papers

Related papers: Neural-Initialized Newton: Accelerating Nonlinear …

200 papers

Deep neural networks, despite their success in numerous applications, often function without established theoretical foundations. In this paper, we bridge this gap by drawing parallels between deep learning and classical numerical analysis.…

Machine Learning · Computer Science 2023-10-04 Emanuele Zappala , Daniel Levine , Sizhuang He , Syed Rizvi , Sacha Levy , David van Dijk

Recently, the advent of deep learning has spurred interest in the development of physics-informed neural networks (PINN) for efficiently solving partial differential equations (PDEs), particularly in a parametric setting. Among all…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Han Gao , Luning Sun , Jian-Xun Wang

We develop a data-driven machine learning approach to identifying parameters with steady-state solutions, locating such solutions, and determining their linear stability for systems of ordinary differential equations and dynamical systems…

Numerical Analysis · Mathematics 2025-03-11 Yimeng Zhang , Alexander Cloninger , Bo Li , Xiaochuan Tian

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

Diverse optimization algorithms correctly identify, in finite time, intrinsic constraints that must be active at optimality. Analogous behavior extends beyond optimization to systems involving partly smooth operators, and in particular to…

Optimization and Control · Mathematics 2019-02-05 Adrian S. Lewis , Calvin Wylie

Numerical modeling errors are unavoidable in finite element analysis. The presence of model errors inherently reflects both model accuracy and uncertainty. To date there have been few methods for explicitly quantifying errors at points of…

Machine Learning · Computer Science 2024-11-19 Bozhou Zhuang , Sashank Rana , Brandon Jones , Danny Smyl

Artificial Neural Networks are computational network models inspired by signal processing in the brain. These models have dramatically improved the performance of many learning tasks, including speech and object recognition. However,…

Scientific discovery and engineering design are currently limited by the time and cost of physical experiments, selected mostly through trial-and-error and intuition that require deep domain expertise. Numerical simulations present an…

Machine Learning · Computer Science 2024-01-08 Kamyar Azizzadenesheli , Nikola Kovachki , Zongyi Li , Miguel Liu-Schiaffini , Jean Kossaifi , Anima Anandkumar

In the realm of computational science and engineering, constructing models that reflect real-world phenomena requires solving partial differential equations (PDEs) with different conditions. Recent advancements in neural operators, such as…

Quantum Physics · Physics 2025-06-11 Pengpeng Xiao , Muqing Zheng , Anran Jiao , Xiu Yang , Lu Lu

In this work, we present a study combining two approaches in the context of solving PDEs: the continuous finite element method (FEM) and more recent techniques based on neural networks. In recent years, physics-informed neural networks…

The iterative problem of solving nonlinear equations is studied. A new Newton like iterative method with adjustable parameters is designed based on the dynamic system theory. In order to avoid the derivative function in the iterative…

Numerical Analysis · Mathematics 2022-11-09 Yonglong Liao , Limin Cui

Power flow (PF) calculations are fundamental to power system analysis to ensure stable and reliable grid operation. The Newton-Raphson (NR) method is commonly used for PF analysis due to its rapid convergence when initialized properly.…

Neural networks have emerged as a powerful tool for modeling physical systems, offering the ability to learn complex representations from limited data while integrating foundational scientific knowledge. In particular, neuro-symbolic…

Machine Learning · Computer Science 2025-07-30 Wenkai Tan , Alvaro Velasquez , Houbing Song

In design of optical systems based on LED (Light emitting diode) technology, a crucial task is to handle the unstructured data describing properties of optical elements in standard formats. This leads to the problem of data fitting within…

Other Computer Science · Computer Science 2016-04-27 David Kaljun , Joze Petrišič , Janez Žerovnik

Nonlinear parametric systems have been widely used in modeling nonlinear dynamics in science and engineering. Bifurcation analysis of these nonlinear systems on the parameter space are usually used to study the solution structure such as…

Numerical Analysis · Mathematics 2022-01-26 Wenrui Hao , Chunyue Zheng

Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when…

Machine Learning · Computer Science 2023-07-11 Rajat Arora

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters in the algorithms.…

Machine Learning · Computer Science 2021-04-23 Byung Hyun Lee , Se Young Chun

Neural Networks (NNs) can be used to solve Ordinary and Partial Differential Equations (ODEs and PDEs) by redefining the question as an optimization problem. The objective function to be optimized is the sum of the squares of the PDE to be…

Machine Learning · Computer Science 2021-03-17 Veronica Guidetti , Francesco Muia , Yvette Welling , Alexander Westphal

Machine learning, as a tool to learn and model complicated (non)linear relationships between input and output data sets, has shown preliminary success in some HPC problems. Using machine learning, scientists are able to augment existing…

Performance · Computer Science 2018-12-19 Wenqian Dong , Anzheng Guolu , Dong Li

Modelling complex multiphysics systems governed by nonlinear and strongly coupled partial differential equations (PDEs) is a cornerstone in computational science and engineering. However, it remains a formidable challenge for traditional…

Machine Learning · Computer Science 2025-02-28 Biao Yuan , He Wang , Yanjie Song , Ana Heitor , Xiaohui Chen