中文
相关论文

相关论文: A Simultaneous Approach for Training Neural Differ…

200 篇论文

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

机器学习 · 计算机科学 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are…

机器学习 · 计算机科学 2019-04-16 Tim Dockhorn

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable…

Differential equations parameterized by neural networks become expensive to solve numerically as training progresses. We propose a remedy that encourages learned dynamics to be easier to solve. Specifically, we introduce a differentiable…

机器学习 · 计算机科学 2020-10-26 Jacob Kelly , Jesse Bettencourt , Matthew James Johnson , David Duvenaud

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

机器学习 · 计算机科学 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

机器学习 · 计算机科学 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Recent work has introduced a simple numerical method for solving partial differential equations (PDEs) with deep neural networks (DNNs). This paper reviews and extends the method while applying it to analyze one of the most fundamental…

机器学习 · 计算机科学 2019-05-14 Craig Michoski , Milos Milosavljevic , Todd Oliver , David Hatch

The spatiotemporal resolution of Partial Differential Equations (PDEs) plays important roles in the mathematical description of the world's physical phenomena. In general, scientists and engineers solve PDEs numerically by the use of…

人工智能 · 计算机科学 2023-06-29 Lucas Meyer , Marc Schouler , Robert Alexander Caulk , Alejandro Ribés , Bruno Raffin

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

机器学习 · 计算机科学 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

Developing efficient numerical algorithms for the solution of high dimensional random Partial Differential Equations (PDEs) has been a challenging task due to the well-known curse of dimensionality. We present a new solution framework for…

机器学习 · 计算机科学 2019-10-17 Mohammad Amin Nabian , Hadi Meidani

Stochastic differential equations (SDEs) are a staple of mathematical modelling of temporal dynamics. However, a fundamental limitation has been that such models have typically been relatively inflexible, which recent work introducing…

机器学习 · 计算机科学 2021-05-12 Patrick Kidger , James Foster , Xuechen Li , Harald Oberhauser , Terry Lyons

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

数值分析 · 数学 2022-09-07 Xiaodan Ren

Simulation and modeling are essential in product development, integrated into the design and manufacturing process to enhance efficiency and quality. They are typically represented as complex nonlinear differential algebraic equations. The…

机器学习 · 计算机科学 2026-03-25 Wenqiang Yang , Wenyuan Wu , Yong Feng , Changbo Chen

Continuous-depth neural networks, such as the Neural Ordinary Differential Equations (ODEs), have aroused a great deal of interest from the communities of machine learning and data science in recent years, which bridge the connection…

机器学习 · 计算机科学 2022-01-05 Qunxi Zhu , Yifei Shen , Dongsheng Li , Wei Lin

The recent introduction of the Least-Squares Support Vector Regression (LS-SVR) algorithm for solving differential and integral equations has sparked interest. In this study, we expand the application of this algorithm to address systems of…

数值分析 · 数学 2024-01-26 Tayebeh Taheri , Alireza Afzal Aghaei , Kourosh Parand

Learning the solution of partial differential equations (PDEs) with a neural network is an attractive alternative to traditional solvers due to its elegance, greater flexibility and the ease of incorporating observed data. However, training…

机器学习 · 计算机科学 2024-07-18 Katsiaryna Haitsiukevich , Alexander Ilin

Partial differential equations (PDEs) are often computationally challenging to solve, and in many settings many related PDEs must be be solved either at every timestep or for a variety of candidate boundary conditions, parameters, or…

机器学习 · 计算机科学 2022-11-04 Tian Qin , Alex Beatson , Deniz Oktay , Nick McGreivy , Ryan P. Adams

With increasing data and model complexities, the time required to train neural networks has become prohibitively large. To address the exponential rise in training time, users are turning to data parallel neural networks (DPNN) to utilize…

Democratization of machine learning requires architectures that automatically adapt to new problems. Neural Differential Equations (NDEs) have emerged as a popular modeling framework by removing the need for ML practitioners to choose the…

机器学习 · 计算机科学 2022-02-08 Avik Pal , Yingbo Ma , Viral Shah , Christopher Rackauckas

Recently, neural networks have been widely applied for solving partial differential equations (PDEs). Although such methods have been proven remarkably successful on practical engineering problems, they have not been shown, theoretically or…

数值分析 · 数学 2023-03-27 Jonathan W. Siegel , Qingguo Hong , Xianlin Jin , Wenrui Hao , Jinchao Xu