English
Related papers

Related papers: DOF: Accelerating High-order Differential Operator…

200 papers

Model-based control for robots has increasingly been dependent on optimization-based methods like Differential Dynamic Programming and iterative LQR (iLQR). These methods can form the basis of Model-Predictive Control (MPC), which is…

Robotics · Computer Science 2023-02-14 Shubham Singh , Ryan P. Russell , Patrick M. Wensing

In this paper, numerical methods using Physics-Informed Neural Networks (PINNs) are presented with the aim to solve higher-order ordinary differential equations (ODEs). Indeed, this deep-learning technique is successfully applied for…

Computational Physics · Physics 2023-07-17 Hubert Baty

Dual numbers are a well-established tool for computing derivatives and constitute the basis of forward-mode automatic differentiation. While the theoretical framework for computing derivatives of arbitrary order is well understood,…

Numerical Analysis · Mathematics 2026-02-06 F. Peñuñuri , K. B. Cantún-Avila , R. Peón-Escalante

The use of deep learning methods for solving PDEs is a field in full expansion. In particular, Physical Informed Neural Networks, that implement a sampling of the physical domain and use a loss function that penalizes the violation of the…

Machine Learning · Computer Science 2021-12-08 Valentin Mercier , Serge Gratton , Pierre Boudier

We present a novel framework combining Deep Operator Networks (DeepONets) with Physics-Informed Neural Networks (PINNs) to solve partial differential equations (PDEs) and estimate their unknown parameters. By integrating data-driven…

Machine Learning · Computer Science 2025-08-05 Amogh Raj , Carol Eunice Gudumotou , Sakol Bun , Keerthana Srinivasa , Arash Sarshar

The challenge of applying learned knowledge from one domain to solve problems in another related but distinct domain, known as transfer learning, is fundamental in operator learning models that solve Partial Differential Equations (PDEs).…

Machine Learning · Computer Science 2024-08-21 Haoyang Jiang , Yongzhi Qu

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

Machine Learning · Computer Science 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang

In this paper, we propose neural networks that tackle the problems of stability and field-of-view of a Convolutional Neural Network (CNN). As an alternative to increasing the network's depth or width to improve performance, we propose…

Machine Learning · Computer Science 2021-11-03 Bastian Bohn , Michael Griebel , Dinesh Kannan

Physics-Informed Neural Network (PINN) has become a commonly used machine learning approach to solve partial differential equations (PDE). But, facing high-dimensional secondorder PDE problems, PINN will suffer from severe scalability…

Machine Learning · Computer Science 2023-02-27 Di He , Shanda Li , Wenlei Shi , Xiaotian Gao , Jia Zhang , Jiang Bian , Liwei Wang , Tie-Yan Liu

The hierarchical interpolative factorization (HIF) offers an efficient way for solving or preconditioning elliptic partial differential equations. By exploiting locality and low-rank properties of the operators, the HIF achieves…

Numerical Analysis · Mathematics 2017-06-12 Yingzhou Li , Lexing Ying

Parametric differential equations of the form du/dt = f(u, x, t, p) are fundamental in science and engineering. While deep learning frameworks such as the Fourier Neural Operator (FNO) can efficiently approximate solutions, they struggle…

Machine Learning · Computer Science 2025-06-03 Abdolmehdi Behroozi , Chaopeng Shen and , Daniel Kifer

Derivative-free optimization (DFO) is vital in solving complex optimization problems where only noisy function evaluations are available through an oracle. Within this domain, DFO via finite difference (FD) approximation has emerged as a…

Machine Learning · Computer Science 2025-02-19 Wang Du-Yi , Liang Guo , Liu Guangwu , Zhang Kun

In this article we propose a new deep learning approach to approximate operators related to parametric partial differential equations (PDEs). In particular, we introduce a new strategy to design specific artificial neural network (ANN)…

Numerical Analysis · Mathematics 2026-05-01 Arnulf Jentzen , Adrian Riekert , Philippe von Wurstemberger

Enforcing exact macroscopic conservation laws, such as mass and energy, in neural partial differential equation (PDE) solvers is computationally challenging in high dimensions. Traditional discrete projections rely on deterministic…

Machine Learning · Computer Science 2026-04-01 Zhangyong Liang

It is well known that Newton's method can have trouble converging if the initial guess is too far from the solution. Such a problem particularly occurs when this method is used to solve nonlinear elliptic partial differential equations…

Numerical Analysis · Mathematics 2024-12-10 Joubine Aghili , Emmanuel Franck , Romain Hild , Victor Michel-Dansac , Vincent Vigon

Physics-Informed Neural Networks (PINNs) incorporate physics into neural networks by embedding partial differential equations (PDEs) into their loss function. Despite their success in learning the underlying physics, PINN models remain…

Machine Learning · Computer Science 2026-03-04 Alberto Miño Calero , Luis Salamanca , Konstantinos E. Tatsis

In this paper, we consider approximating the parameter-to-solution maps of parametric partial differential equations (PPDEs) using deep neural networks (DNNs). We propose an efficient approach combining reduced collocation methods (RCMs)…

Numerical Analysis · Mathematics 2025-08-18 Guanhang Lei , Zhen Lei , Lei Shi , Chenyu Zeng

Deep learning for distribution grid optimization can be advocated as a promising solution for near-optimal yet timely inverter dispatch. The principle is to train a deep neural network (DNN) to predict the solutions of an optimal power flow…

Optimization and Control · Mathematics 2020-07-09 Manish K. Singh , Sarthak Gupta , Vassilis Kekatos , Guido Cavraro , Andrey Bernstein

As is well known, differential algebraic equations (DAEs), which are able to describe dynamic changes and underlying constraints, have been widely applied in engineering fields such as fluid dynamics, multi-body dynamics, mechanical systems…

Numerical Analysis · Mathematics 2023-10-20 Jiasheng Chen , Juan Tang , Ming Yan , Shuai Lai , Kun Liang , Jianguang Lu , Wenqiang Yang

Numerical simulation of time-dependent partial differential equations (PDEs) is central to scientific and engineering applications, but high-fidelity solvers are often prohibitively expensive for long-horizon or time-critical settings.…

Machine Learning · Computer Science 2025-12-23 Rajyasri Roy , Dibyajyoti Nayak , Somdatta Goswami