English
Related papers

Related papers: New Designed Loss Functions to Solve Ordinary Diff…

200 papers

Parametric optimal control problems governed by partial differential equations (PDEs) are widely found in scientific and engineering applications. Traditional grid-based numerical methods for such problems generally require repeated…

Optimization and Control · Mathematics 2023-02-07 Pengfei Yin , Guangqiang Xiao , Kejun Tang , Chao Yang

Deep neural networks (DNNs) are efficient solvers for ill-posed problems and have been shown to outperform classical optimization techniques in several computational imaging problems. DNNs are trained by solving an optimization problem…

Image and Video Processing · Electrical Eng. & Systems 2019-06-14 Mo Deng , Alexandre Goy , Shuai Li , Kwabena Arthur , George Barbastathis

Neural Ordinary Differential Equations (N-ODEs) are a powerful building block for learning systems, which extend residual networks to a continuous-time dynamical system. We propose a Bayesian version of N-ODEs that enables well-calibrated…

Machine Learning · Computer Science 2020-02-19 Andreas Look , Melih Kandemir

The Artificial Neural network is a functional imitation of simplified model of the biological neurons and their goal is to construct useful computers for real world problems. The ANN applications have increased dramatically in the last few…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Nitin Malik

We suggest a universal map capable to recover a behavior of a wide range of dynamical systems given by ODEs. The map is built as an artificial neural network whose weights encode a modeled system. We assume that ODEs are known and prepare…

Disordered Systems and Neural Networks · Physics 2023-05-02 Pavel V. Kuptsov , Anna V. Kuptsova , Nataliya V. Stankevich

Neural network-based methods for solving differential equations have been gaining traction. They work by improving the differential equation residuals of a neural network on a sample of points in each iteration. However, most of them employ…

Machine Learning · Computer Science 2021-11-24 Kshitij Parwani , Pavlos Protopapas

With the increasing use of nonlinear devices in both generation and consumption of power, it is essential that we develop accurate and quick control for active filters to suppress harmonics. Time delays between input and output are…

Systems and Control · Electrical Eng. & Systems 2024-10-04 Dixant Bikal Sapkota , Puskar Neupane , Kajal Pokharel , Shahabuddin Khan

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

Using neural networks to solve partial differential equations (PDEs) is gaining popularity as an alternative approach in the scientific computing community. Neural networks can integrate different types of information into the loss…

Machine Learning · Computer Science 2024-05-07 Zhiwei Wang , Lulu Zhang , Zhongwang Zhang , Zhi-Qin John Xu

Neural ordinary differential equations (Neural ODEs) is a class of machine learning models that approximate the time derivative of hidden states using a neural network. They are powerful tools for modeling continuous-time dynamical systems,…

Machine Learning · Statistics 2024-07-16 Wenbo Hao

Recently, deep learning-based algorithms are widely adopted due to the advantage of being able to establish anomaly detection models without or with minimal domain knowledge of the task. Instead, to train the artificial neural network more…

Machine Learning · Computer Science 2023-04-17 YeongHyeon Park

Enhancing neural networks with knowledge of physical equations has become an efficient way of solving various physics problems, from fluid flow to electromagnetism. Graph neural networks show promise in accurately representing irregularly…

Machine Learning · Computer Science 2022-04-01 Mike Y. Michelis , Robert K. Katzschmann

To combine a feedforward neural network (FNN) and Lie group (symmetry) theory of differential equations (DEs), an alternative artificial NN approach is proposed to solve the initial value problems (IVPs) of ordinary DEs (ODEs). Introducing…

Numerical Analysis · Mathematics 2022-05-04 Ying Wen , Temuer Chaolu , Xiangsheng Wang

Can neural networks learn to solve partial differential equations (PDEs)? We investigate this question for two (systems of) PDEs, namely, the Poisson equation and the steady Navier--Stokes equations. The contributions of this paper are…

Machine Learning · Computer Science 2019-04-16 Tim Dockhorn

This paper explores the difficulties in solving partial differential equations (PDEs) using physics-informed neural networks (PINNs). PINNs use physics as a regularization term in the objective function. However, a drawback of this approach…

Machine Learning · Computer Science 2023-06-21 Shamsulhaq Basir

Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive…

Computational Engineering, Finance, and Science · Computer Science 2021-01-14 Xiaoxuan Zhang , Krishna Garikipati

Recent developments in AI have made it ubiquitous, every industry is trying to adopt some form of intelligent processing of their data. Despite so many advances in the field, AIs full capability is yet to be exploited by the industry.…

Machine Learning · Computer Science 2021-11-10 Vishal Rajput

The study of a machine learning problem is in many ways is difficult to separate from the study of the loss function being used. One avenue of inquiry has been to look at these loss functions in terms of their properties as scoring rules…

Machine Learning · Computer Science 2022-09-02 Zac Cranko , Robert C. Williamson , Richard Nock

In this paper we use neural networks to learn governing equations from data. Specifically we reconstruct the right-hand side of a system of ODEs $\dot{x}(t) = f(t, x(t))$ directly from observed uniformly time-sampled data using a neural…

Machine Learning · Computer Science 2021-08-18 Elisa Negrini , Giovanna Citti , Luca Capogna

Many physical processes such as weather phenomena or fluid mechanics are governed by partial differential equations (PDEs). Modelling such dynamical systems using Neural Networks is an active research field. However, current methods are…

Machine Learning · Computer Science 2022-10-12 Andrzej Dulny , Andreas Hotho , Anna Krause