English
Related papers

Related papers: Multi-Preconditioned LBFGS for Training Finite-Bas…

200 papers

We introduce a new method for training deep Boltzmann machines jointly. Prior methods of training DBMs require an initial learning pass that trains the model greedily, one layer at a time, or do not perform well on classification tasks. In…

Machine Learning · Statistics 2013-05-02 Ian J. Goodfellow , Aaron Courville , Yoshua Bengio

Physics-informed neural networks (PINNs) offer a promising avenue for tackling both forward and inverse problems in partial differential equations (PDEs) by incorporating deep learning with fundamental physics principles. Despite their…

Machine Learning · Computer Science 2024-02-06 Hemanth Saratchandran , Shin-Fang Chng , Simon Lucey

Solving partial differential equations (PDEs) serves as a cornerstone for modeling complex dynamical systems. Recent progresses have demonstrated grand benefits of data-driven neural-based models for predicting spatiotemporal dynamics…

Machine Learning · Computer Science 2025-03-04 Bocheng Zeng , Qi Wang , Mengtao Yan , Yang Liu , Ruizhi Chengze , Yi Zhang , Hongsheng Liu , Zidong Wang , Hao Sun

We present the Multilevel Bregman Proximal Gradient Descent (ML BPGD) method, a novel multilevel optimization framework tailored to constrained convex problems with relative Lipschitz smoothness. Our approach extends the classical…

Optimization and Control · Mathematics 2026-05-06 Yara Elshiaty , Stefania Petra

The physics-informed neural network (PINN) is effective in solving the partial differential equation (PDE) by capturing the physics constraints as a part of the training loss function through the Automatic Differentiation (AD). This study…

Computational Physics · Physics 2022-02-17 Zixue Xiang , Wei Peng , Weien Zhou , Wen Yao

We introduce a sampling based machine learning approach, Monte Carlo physics informed neural networks (MC-PINNs), for solving forward and inverse fractional partial differential equations (FPDEs). As a generalization of physics informed…

Machine Learning · Computer Science 2022-09-28 Ling Guo , Hao Wu , Xiaochen Yu , Tao Zhou

Physics-informed neural networks (PINNs) provide a deep learning framework for numerically solving partial differential equations (PDEs), and have been widely used in a variety of PDE problems. However, there still remain some challenges in…

Machine Learning · Computer Science 2022-05-19 Wensheng Li , Chao Zhang , Chuncheng Wang , Hanting Guan , Dacheng Tao

The accurate solution of nonlinear hyperbolic partial differential equations (PDEs) remains challenging due to steep gradients, discontinuities, and multiscale structures that make conventional solvers computationally demanding.…

Machine Learning · Computer Science 2025-12-02 Saif Ur Rehman , Wajid Yousuf

Physics-Informed Neural Networks (PINNs) represent a groundbreaking paradigm in scientific computing, seamlessly integrating the robust framework of deep learning with fundamental physical laws. This paper meticulously applies the standard…

Numerical Analysis · Mathematics 2026-01-19 Ahmed Aberqi , Ahmed Miloudi

Neural networks (NNs) have emerged as a state-of-the-art method for modeling nonlinear systems in model predictive control (MPC). However, the robustness of NNs, in terms of sensitivity to small input perturbations, remains a critical…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Wallace Tan Gian Yion , Zhe Wu

We present a physics-informed neural network (PINN) approach for the discovery of slow invariant manifolds (SIMs), for the most general class of fast/slow dynamical systems of ODEs. In contrast to other machine learning (ML) approaches that…

Numerical Analysis · Mathematics 2025-06-24 Dimitrios G. Patsatzis , Lucia Russo , Constantinos Siettos

Multifidelity simulation methodologies are often used in an attempt to judiciously combine low-fidelity and high-fidelity simulation results in an accuracy-increasing, cost-saving way. Candidates for this approach are simulation…

Computational Physics · Physics 2023-01-09 Michael Penwarden , Shandian Zhe , Akil Narayan , Robert M. Kirby

Physics-Informed Neural Networks (PINNs) have demonstrated considerable success in solving complex fluid dynamics problems. However, their performance often deteriorates in regimes characterized by steep gradients, intricate boundary…

Fluid Dynamics · Physics 2025-12-29 Ze Tao , Ke Xu , Fujun Liu

Recently, physics-informed neural networks (PINNs) and their variants have gained significant popularity as a scientific computing method for solving partial differential equations (PDEs), whereas accuracy is still its main shortcoming.…

Computational Physics · Physics 2025-03-11 Feng Chen , Yiran Meng , Kegan Li , Chaoran Yang , Jiong Yang

Physics-Informed Neural Networks (PINN) are algorithms from deep learning leveraging physical laws by including partial differential equations together with a respective set of boundary and initial conditions as penalty terms into their…

Machine Learning · Computer Science 2025-09-30 Rafael Bischof , Michael Kraus

Interest is rising in Physics-Informed Neural Networks (PINNs) as a mesh-free alternative to traditional numerical solvers for partial differential equations (PDEs). However, PINNs often struggle to learn high-frequency and multi-scale…

Machine Learning · Computer Science 2025-02-25 Madison Cooley , Varun Shankar , Robert M. Kirby , Shandian Zhe

Embedding parameterized optimization problems as layers into machine learning architectures serves as a powerful inductive bias. Training such architectures with stochastic gradient descent requires care, as degenerate derivatives of the…

Machine Learning · Computer Science 2024-12-16 Anselm Paulus , Georg Martius , Vít Musil

The recently developed physics-informed machine learning has made great progress for solving nonlinear partial differential equations (PDEs), however, it may fail to provide reasonable approximations to the PDEs with discontinuous…

Numerical Analysis · Mathematics 2021-12-06 Chunyue Lv , Lei Wang , Chenming Xie

Reinforcement Learning (RL) algorithms allow artificial agents to improve their action selections so as to increase rewarding experiences in their environments. Deep Reinforcement Learning algorithms require solving a nonconvex and…

Machine Learning · Computer Science 2019-04-18 Jacob Rafati , Roummel F. Marcia

Physics-Informed Neural Networks (PINNs) have gained much attention in various fields of engineering thanks to their capability of incorporating physical laws into the models. PINNs integrate the physical constraints by minimizing the…

Machine Learning · Computer Science 2025-07-28 Thi Nguyen Khoa Nguyen , Thibault Dairay , Raphaël Meunier , Christophe Millet , Mathilde Mougeot